Giulianelli, Mario;
Wallbridge, Sarenne;
Fernández, Raquel;
(2023)
Information Value: Measuring Utterance Predictability as Distance from Plausible Alternatives.
In: Bouamor, Houda and Pino, Juan and Bali, Kalika, (eds.)
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing.
(pp. pp. 5633-5653).
Association for Computational Linguistics: Singapore.
Preview |
Text
2023.emnlp-main.343.pdf - Published Version Download (5MB) | Preview |
Abstract
We present information value, a measure which quantifies the predictability of an utterance relative to a set of plausible alternatives. We introduce a method to obtain interpretable estimates of information value using neural text generators, and exploit their psychometric predictive power to investigate the dimensions of predictability that drive human comprehension behaviour. Information value is a stronger predictor of utterance acceptability in written and spoken dialogue than aggregates of token-level surprisal and it is complementary to surprisal for predicting eye-tracked reading times.
| Type: | Proceedings paper |
|---|---|
| Title: | Information Value: Measuring Utterance Predictability as Distance from Plausible Alternatives |
| Event: | Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing |
| Dates: | Dec 2023 - Dec 2023 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.18653/v1/2023.emnlp-main.343 |
| Publisher version: | https://doi.org/10.18653/v1/2023.emnlp-main.343 |
| Language: | English |
| Additional information: | ACL materials are Copyright © 1963–2025 ACL; other materials are copyrighted by their respective copyright holders. Materials prior to 2016 here are licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 International License. Permission is granted to make copies for the purposes of teaching and research. Materials published in or after 2016 are licensed on a Creative Commons Attribution 4.0 International License. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Linguistics |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10216481 |
Archive Staff Only
 |
View Item |
