Sadrzadeh, M;
Kartsaklis, D;
Balkir, E;
(2018)
Sentence entailment in compositional distributional semantics.
Annals of Mathematics and Artificial Intelligence
, 82
pp. 189-218.
10.1007/s10472-017-9570-x.
Preview |
Text
Sadrzadeh2018_Article_SentenceEntailmentInCompositio.pdf - Published Version Download (713kB) | Preview |
Abstract
Distributional semantic models provide vector representations for words by gathering co-occurrence frequencies from corpora of text. Compositional distributional models extend these from words to phrases and sentences. In categorical compositional distributional semantics, phrase and sentence representations are functions of their grammatical structure and representations of the words therein. In this setting, grammatical structures are formalised by morphisms of a compact closed category and meanings of words are formalised by objects of the same category. These can be instantiated in the form of vectors or density matrices. This paper concerns the applications of this model to phrase and sentence level entailment. We argue that entropy-based distances of vectors and density matrices provide a good candidate to measure word-level entailment, show the advantage of density matrices over vectors for word level entailments, and prove that these distances extend compositionally from words to phrases and sentences. We exemplify our theoretical constructions on real data and a toy entailment dataset and provide preliminary experimental evidence.
| Type: | Article |
|---|---|
| Title: | Sentence entailment in compositional distributional semantics |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1007/s10472-017-9570-x |
| Publisher version: | https://doi.org/10.1007/s10472-017-9570-x |
| Language: | English |
| Additional information: | This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. |
| Keywords: | Distributional semantics, Compositional distributional semantics, Distributional inclusion hypothesis, Density matrices, Entailment, Entropy |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10119885 |
Archive Staff Only
 |
View Item |
