Sarro, F;
Hort, M;
(2020)
Optimising Word Embeddings With Search-Based Approaches.
In:
Proceedings of the 2020 Genetic and Evolutionary Computation Conference Companion:GECCO '20.
(pp. pp. 269-270).
ACM: Cancún Mexico.
Preview |
Text
GECCO20_OptimisingWordEmbeddings.pdf - Accepted Version Download (430kB) | Preview |
Abstract
Word embeddings have rapidly become an all-purpose tool for a diverse range of real world applications. This development is nurtured by the availability and applicability of pre-trained models. However, their usage faces the risk of being inaccurate when used in domains different from the ones they were trained on. In this paper, we formulate the adaptation of word embeddings as a vector multiplication problem, which enables us to apply search methods to explore potential word embedding adaptations with respect to their semantic correctness. To assess the effectiveness of our proposal, we empirically investigate the use of both local and global search-based approaches (i.e. Hill Climbing, Tabu Search and Genetic Algorithm) in order to maximise the semantic correctness of a popular Word2Vec pre-trained model (namely GoogleNews) when applied to another domain (i.e. the MEN dataset). The results of our study reveal that Hill Climbing, Tabu Search and Genetic Algorithm perform equally well and all outperform the original GoogleNews model as well as a baseline model based on Random Search. This shows that optimising word embeddings with search-based approaches is possible and effective.
Type: | Proceedings paper |
---|---|
Title: | Optimising Word Embeddings With Search-Based Approaches |
Event: | Genetic and Evolutionary Computation Conference |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1145/3377929.3390039 |
Publisher version: | https://doi.org/10.1145/3377929.3390039 |
Language: | English |
Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions. |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
URI: | https://discovery.ucl.ac.uk/id/eprint/10096074 |




Archive Staff Only
![]() |
View Item |