Tsantani, M;
Kriegeskorte, N;
McGettigan, C;
Garrido, L;
(2019)
Faces and voices in the brain: A modality-general person-identity representation in superior temporal sulcus.
Neuroimage
, 201
, Article 116004. 10.1016/j.neuroimage.2019.07.017.
Preview |
Text
1-s2.0-S1053811919305853-main.pdf - Published Version Download (2MB) | Preview |
Abstract
Face-selective and voice-selective brain regions have been shown to represent face-identity and voice-identity, respectively. Here we investigated whether there are modality-general person-identity representations in the brain that can be driven by either a face or a voice, and that invariantly represent naturalistically varying face videos and voice recordings of the same identity. Models of face and voice integration suggest that such representations could exist in multimodal brain regions, and in unimodal regions via direct coupling between face- and voice-selective regions. Therefore, in this study we used fMRI to measure brain activity patterns elicited by the faces and voices of familiar people in face-selective, voice-selective, and person-selective multimodal brain regions. We used representational similarity analysis to (1) compare representational geometries (i.e. representational dissimilarity matrices) of face- and voice-elicited identities, and to (2) investigate the degree to which pattern discriminants for pairs of identities generalise from one modality to the other. We did not find any evidence of similar representational geometries across modalities in any of our regions of interest. However, our results showed that pattern discriminants that were trained to discriminate pairs of identities from their faces could also discriminate the respective voices (and vice-versa) in the right posterior superior temporal sulcus (rpSTS). Our findings suggest that the rpSTS is a person-selective multimodal region that shows a modalitygeneral person-identity representation and integrates face and voice identity information.
| Type: | Article |
|---|---|
| Title: | Faces and voices in the brain: A modality-general person-identity representation in superior temporal sulcus |
| Location: | United States |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1016/j.neuroimage.2019.07.017 |
| Publisher version: | https://doi.org/10.1016/j.neuroimage.2019.07.017 |
| Language: | English |
| Additional information: | This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/). |
| Keywords: | Face recognition, Multisensory processing, Person-identity recognition, Representational similarity analysis, Voice recognition |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Speech, Hearing and Phonetic Sciences |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10078706 |
Archive Staff Only
 |
View Item |
