UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Timing relationships between representational gestures and speech: A corpus based investigation

Donnellan, E; Özder, LE; Man, H; Grzyb, B; Gu, Y; Vigliocco, G; (2022) Timing relationships between representational gestures and speech: A corpus based investigation. In: Proceedings of the Annual Meeting of the Cognitive Science Society. (pp. pp. 2052-2058). University of California Green open access

[thumbnail of eScholarship UC item 7w349725.pdf]
Preview
Text
eScholarship UC item 7w349725.pdf - Published Version

Download (471kB) | Preview

Abstract

Theories suggest that representational gestures depicting properties of referents in accompanying speech could facilitate language production and comprehension. In order to shed light on how gesture and speech are coordinated during production, we investigate whether representational gestures are time-locked to the onset of utterances (hence planned when full events are encoded) or Lexical Affiliates (LAs; words most closely aligned with the gesture meaning; hence planned when individual concepts are encoded) in a large corpus of naturalistic conversation (n = 1803 gestures from n = 24 speakers). Our data shows that representational gestures are more tightly tied to LA onsets than utterance onsets, which is consistent with theories of multimodal communication in which gestures aid conceptual packaging or retrieval of individual concepts rather than events. We also demonstrate that in naturalistic speech, representational gestures tend to precede their LAs by around 370ms, which means that they could plausibly allow for an addressee to predict upcoming words (ter Bekke, Drijvers & Holler, 2021; Ferré, 2010; Habets et al., 2011).

Type: Proceedings paper
Title: Timing relationships between representational gestures and speech: A corpus based investigation
Event: CogSci 2022 - 44th Annual Meeting of the Cognitive Science Society
Open access status: An open access version is available from UCL Discovery
Publisher version: https://escholarship.org/uc/item/7w349725
Language: English
Additional information: This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third-party material in this article are included in the Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Experimental Psychology
URI: https://discovery.ucl.ac.uk/id/eprint/10164137
Downloads since deposit
67Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item