Kutuzov, Andrey;
Giulianelli, Mario;
(2020)
UiO-UvA at SemEval-2020 Task 1: Contextualised Embeddings for Lexical Semantic Change Detection.
In:
Proceedings of the Fourteenth Workshop on Semantic Evaluation.
(pp. pp. 126-134).
International Committee for Computational Linguistics
Preview |
Text
2020.semeval-1.14.pdf - Published Version Download (824kB) | Preview |
Abstract
We apply contextualised word embeddings to lexical semantic change detection in the SemEval-2020 Shared Task 1. This paper focuses on Subtask 2, ranking words by the degree of their semantic drift over time. We analyse the performance of two contextualising architectures (BERT and ELMo) and three change detection algorithms. We find that the most effective algorithms rely on the cosine similarity between averaged token embeddings and the pairwise distances between token embeddings. They outperform strong baselines by a large margin (in the post-evaluation phase, we have the best Subtask 2 submission for SemEval-2020 Task 1), but interestingly, the choice of a particular algorithm depends on the distribution of gold scores in the test set.
| Type: | Proceedings paper |
|---|---|
| Title: | UiO-UvA at SemEval-2020 Task 1: Contextualised Embeddings for Lexical Semantic Change Detection |
| Event: | Fourteenth Workshop on Semantic Evaluation |
| Dates: | Dec 2020 - Dec 2020 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.18653/v1/2020.semeval-1.14 |
| Publisher version: | https://doi.org/10.18653/v1/2020.semeval-1.14 |
| Language: | English |
| Additional information: | © 1963–2025 ACL; other materials are copyrighted by their respective copyright holders. Materials prior to 2016 here are licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 International License. Permission is granted to make copies for the purposes of teaching and research. Materials published in or after 2016 are licensed on a Creative Commons Attribution 4.0 International License. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Linguistics |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10216489 |
Archive Staff Only
 |
View Item |
