Gu, Yan;
Donnellan, Ed;
Grzyb, Beata;
Murgiano, Margherita;
Brieke, Ricarda;
Perniss, Pamela;
Vigliocco, Gabriella;
(2025)
The ECOLANG Multimodal Corpus of adult-child and adult-adult Language.
Scientific Data
, 12
, Article 89. 10.1038/s41597-025-04405-1.
Preview |
Text
Gu_s41597-025-04405-1.pdf Download (3MB) | Preview |
Abstract
Communication comprises a wealth of multimodal signals (e.g., gestures, eye gaze, intonation) in addition to speech and there is a growing interest in the study of multimodal language by psychologists, linguists, neuroscientists and computer scientists. The ECOLANG corpus provides audiovisual recordings and ELAN annotations of multimodal behaviours (speech transcription, gesture, object manipulation, and eye gaze) by British and American English-speaking adults engaged in semi-naturalistic conversation with their child (N = 38, children 3-4 years old, face-blurred) or a familiar adult (N = 31). Speakers were asked to talk about objects to their interlocutors. We further manipulated whether the objects were familiar or novel to the interlocutor and whether the objects could be seen and manipulated (present or absent) during the conversation. These conditions reflect common interaction scenarios in real-world communication. Thus, ECOLANG provides ecologically-valid data about the distribution and co-occurrence of multimodal signals across these conditions for cognitive scientists and neuroscientists interested in addressing questions concerning real-world language acquisition, production and comprehension, and for computer scientists to develop multimodal language models and more human-like artificial agents.
| Type: | Article |
|---|---|
| Title: | The ECOLANG Multimodal Corpus of adult-child and adult-adult Language |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1038/s41597-025-04405-1 |
| Publisher version: | http://dx.doi.org/10.1038/s41597-025-04405-1 |
| Language: | English |
| Additional information: | This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. |
| Keywords: | Communication, Human behaviour |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Experimental Psychology |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10203394 |
Archive Staff Only
 |
View Item |
