Lavan, N;
Smith, HJ;
McGettigan, C;
(2021)
Unimodal and cross-modal identity judgements using an audiovisual sorting task: Evidence for independent processing of faces and voices.
Memory and Cognition
10.3758/s13421-021-01198-7.
(In press).
Preview |
Text
McGettigan_Lavan2021_Article_UnimodalAndCross-modalIdentity.pdf - Published Version Download (926kB) | Preview |
Abstract
Unimodal and cross-modal information provided by faces and voices contribute to identity percepts. To examine how these sources of information interact, we devised a novel audio-visual sorting task in which participants were required to group video-only and audio-only clips into two identities. In a series of three experiments, we show that unimodal face and voice sorting were more accurate than cross-modal sorting: While face sorting was consistently most accurate followed by voice sorting, cross-modal sorting was at chancel level or below. In Experiment 1, we compared performance in our novel audio-visual sorting task to a traditional identity matching task, showing that unimodal and cross-modal identity perception were overall moderately more accurate than the traditional identity matching task. In Experiment 2, separating unimodal from cross-modal sorting led to small improvements in accuracy for unimodal sorting, but no change in cross-modal sorting performance. In Experiment 3, we explored the effect of minimal audio-visual training: Participants were shown a clip of the two identities in conversation prior to completing the sorting task. This led to small, nonsignificant improvements in accuracy for unimodal and cross-modal sorting. Our results indicate that unfamiliar face and voice perception operate relatively independently with no evidence of mutual benefit, suggesting that extracting reliable cross-modal identity information is challenging.
| Type: | Article |
|---|---|
| Title: | Unimodal and cross-modal identity judgements using an audiovisual sorting task: Evidence for independent processing of faces and voices |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.3758/s13421-021-01198-7 |
| Publisher version: | https://doi.org/10.3758/s13421-021-01198-7 |
| Language: | English |
| Additional information: | This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |
| Keywords: | Face . Voice . Unimodal . Cross-modal . Identity perception . Sorting |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Speech, Hearing and Phonetic Sciences |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10129051 |
Archive Staff Only
 |
View Item |
