Wang, Daphne;
Sadrzadeh, Mehrnoosh;
(2024)
Causality and signalling of garden-path sentences.
Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
, 382
(2268)
, Article 20230013. 10.1098/rsta.2023.0013.
Preview |
PDF
wang-sadrzadeh-2024-causality-and-signalling-of-garden-path-sentences.pdf - Published Version Download (1MB) | Preview |
Abstract
Sheaves are mathematical objects that describe the globally compatible data associated with open sets of a topological space. Original examples of sheaves were continuous functions; later they also became powerful tools in algebraic geometry, as well as logic and set theory. More recently, sheaves have been applied to the theory of contextuality in quantum mechanics. Whenever the local data are not necessarily compatible, sheaves are replaced by the simpler setting of presheaves. In previous work, we used presheaves to model lexically ambiguous phrases in natural language and identified the order of their disambiguation. In the work presented here, we model syntactic ambiguities and study a phenomenon in human parsing called garden-pathing. It has been shown that the information-theoretic quantity known as ‘surprisal’ correlates with human reading times in natural language but fails to do so in garden-path sentences. We compute the degree of signalling in our presheaves using probabilities from the large language model BERT and evaluate predictions on two psycholinguistic datasets. Our degree of signalling outperforms surprisal in two ways: (i) it distinguishes between hard and easy garden-path sentences (with a p-value <10−5), whereas existing work could not, (ii) its garden-path effect is larger in one of the datasets (32 ms versus 8.75 ms per word), leading to better prediction accuracies.
Type: | Article |
---|---|
Title: | Causality and signalling of garden-path sentences |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1098/rsta.2023.0013 |
Publisher version: | http://dx.doi.org/10.1098/rsta.2023.0013 |
Language: | English |
Additional information: | © 2024 The Authors. Published by the Royal Society under the terms of the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/, which permits unrestricted use, provided the original author and source are credited. |
Keywords: | sheaf theory, causality, contextuality, natural language ambiguities, psycholinguistics,garden path phenomena |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
URI: | https://discovery.ucl.ac.uk/id/eprint/10186504 |
Archive Staff Only
View Item |