Wijnholds, G;
Sadrzadeh, M;
(2019)
Evaluating Composition Models for Verb Phrase Elliptical Sentence Embeddings.
In: Burstein, J and Doran, C and Solorio, T, (eds.)
Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers).
(pp. pp. 261-271).
Association for Computational Linguistics (ACL): Minneapolis, MN, USA.
Preview |
Text
N19-1023.pdf - Published Version Download (332kB) | Preview |
Abstract
Ellipsis is a natural language phenomenon where part of a sentence is missing and its information must be recovered from its surrounding context, as in “Cats chase dogs and so do foxes.”. Formal semantics has different methods for resolving ellipsis and recovering the missing information, but the problem has not been considered for distributional semantics, where words have vector embeddings and combinations thereof provide embeddings for sentences. In elliptical sentences these combinations go beyond linear as copying of elided information is necessary. In this paper, we develop different models for embedding VP-elliptical sentences. We extend existing verb disambiguation and sentence similarity datasets to ones containing elliptical phrases and evaluate our models on these datasets for a variety of non-linear combinations and their linear counterparts. We compare results of these compositional models to state of the art holistic sentence encoders. Our results show that non-linear addition and a non-linear tensor-based composition outperform the naive non-compositional baselines and the linear models, and that sentence encoders perform well on sentence similarity, but not on verb disambiguation.
| Type: | Proceedings paper |
|---|---|
| Title: | Evaluating Composition Models for Verb Phrase Elliptical Sentence Embeddings |
| Event: | 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.18653/v1/N19-1023 |
| Publisher version: | http://dx.doi.org/10.18653/v1/N19-1023 |
| Language: | English |
| Additional information: | This is an Open Access paper published under a Creative Commons Attribution 4.0 International (CC BY 4.0) Licence (https://creativecommons.org/licenses/by/4.0/). |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10119757 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
