Donnellan, E;
Özder, LE;
Man, H;
Grzyb, B;
Gu, Y;
Vigliocco, G;
(2022)
Timing relationships between representational gestures and speech: A corpus based investigation.
In:
Proceedings of the Annual Meeting of the Cognitive Science Society.
(pp. pp. 2052-2058).
University of California
Preview |
Text
eScholarship UC item 7w349725.pdf - Published Version Download (471kB) | Preview |
Abstract
Theories suggest that representational gestures depicting properties of referents in accompanying speech could facilitate language production and comprehension. In order to shed light on how gesture and speech are coordinated during production, we investigate whether representational gestures are time-locked to the onset of utterances (hence planned when full events are encoded) or Lexical Affiliates (LAs; words most closely aligned with the gesture meaning; hence planned when individual concepts are encoded) in a large corpus of naturalistic conversation (n = 1803 gestures from n = 24 speakers). Our data shows that representational gestures are more tightly tied to LA onsets than utterance onsets, which is consistent with theories of multimodal communication in which gestures aid conceptual packaging or retrieval of individual concepts rather than events. We also demonstrate that in naturalistic speech, representational gestures tend to precede their LAs by around 370ms, which means that they could plausibly allow for an addressee to predict upcoming words (ter Bekke, Drijvers & Holler, 2021; Ferré, 2010; Habets et al., 2011).
| Type: | Proceedings paper |
|---|---|
| Title: | Timing relationships between representational gestures and speech: A corpus based investigation |
| Event: | CogSci 2022 - 44th Annual Meeting of the Cognitive Science Society |
| Open access status: | An open access version is available from UCL Discovery |
| Publisher version: | https://escholarship.org/uc/item/7w349725 |
| Language: | English |
| Additional information: | This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third-party material in this article are included in the Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Experimental Psychology |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10164137 |
Archive Staff Only
 |
View Item |
