Giulianelli, Mario;
Del Tredici, Marco;
Fernández, Raquel;
(2020)
Analysing Lexical Semantic Change with Contextualised Word Representations.
In:
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.
(pp. pp. 3960-3973).
Association for Computational Linguistics
Preview |
Text
2020.acl-main.365.pdf - Published Version Download (1MB) | Preview |
Abstract
This paper presents the first unsupervised approach to lexical semantic change that makes use of contextualised word representations. We propose a novel method that exploits the BERT neural language model to obtain representations of word usages, clusters these representations into usage types, and measures change along time with three proposed metrics. We create a new evaluation dataset and show that the model representations and the detected semantic shifts are positively correlated with human judgements. Our extensive qualitative analysis demonstrates that our method captures a variety of synchronic and diachronic linguistic phenomena. We expect our work to inspire further research in this direction.
| Type: | Proceedings paper |
|---|---|
| Title: | Analysing Lexical Semantic Change with Contextualised Word Representations |
| Event: | 58th Annual Meeting of the Association for Computational Linguistics |
| Dates: | Jul 2020 - Jul 2020 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.18653/v1/2020.acl-main.365 |
| Publisher version: | https://doi.org/10.18653/v1/2020.acl-main.365 |
| Language: | English |
| Additional information: | © 1963–2025 ACL; other materials are copyrighted by their respective copyright holders. Materials prior to 2016 here are licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 International License. Permission is granted to make copies for the purposes of teaching and research. Materials published in or after 2016 are licensed on a Creative Commons Attribution 4.0 International License. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Linguistics |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10216469 |
Archive Staff Only
 |
View Item |
