UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Sentence entailment in compositional distributional semantics

Sadrzadeh, M; Kartsaklis, D; Balkir, E; (2018) Sentence entailment in compositional distributional semantics. Annals of Mathematics and Artificial Intelligence , 82 pp. 189-218. 10.1007/s10472-017-9570-x. Green open access

[thumbnail of Sadrzadeh2018_Article_SentenceEntailmentInCompositio.pdf]
Preview
Text
Sadrzadeh2018_Article_SentenceEntailmentInCompositio.pdf - Published version

Download (713kB) | Preview

Abstract

Distributional semantic models provide vector representations for words by gathering co-occurrence frequencies from corpora of text. Compositional distributional models extend these from words to phrases and sentences. In categorical compositional distributional semantics, phrase and sentence representations are functions of their grammatical structure and representations of the words therein. In this setting, grammatical structures are formalised by morphisms of a compact closed category and meanings of words are formalised by objects of the same category. These can be instantiated in the form of vectors or density matrices. This paper concerns the applications of this model to phrase and sentence level entailment. We argue that entropy-based distances of vectors and density matrices provide a good candidate to measure word-level entailment, show the advantage of density matrices over vectors for word level entailments, and prove that these distances extend compositionally from words to phrases and sentences. We exemplify our theoretical constructions on real data and a toy entailment dataset and provide preliminary experimental evidence.

Type: Article
Title: Sentence entailment in compositional distributional semantics
Open access status: An open access version is available from UCL Discovery
DOI: 10.1007/s10472-017-9570-x
Publisher version: https://doi.org/10.1007/s10472-017-9570-x
Language: English
Additional information: This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Keywords: Distributional semantics, Compositional distributional semantics, Distributional inclusion hypothesis, Density matrices, Entailment, Entropy
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10119885
Downloads since deposit
35Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item