UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

The Effect of Auditory Input on Multimodal Reading Comprehension: An Examination of Adult Readers’ Eye Movements

Pellicer Sanchez, A; Conklin, K; Rodgers, M; Parente, F; (2021) The Effect of Auditory Input on Multimodal Reading Comprehension: An Examination of Adult Readers’ Eye Movements. The Modern Language Journal , 105 (4) pp. 936-956. 10.1111/modl.12743. Green open access

[thumbnail of Pellicer Sanchez_The Effect of Auditory Input on Multimodal Reading Comprehension- An Examination of Adult Readers’ Eye Movements_AAM.pdf]
Preview
Text
Pellicer Sanchez_The Effect of Auditory Input on Multimodal Reading Comprehension- An Examination of Adult Readers’ Eye Movements_AAM.pdf - Accepted Version

Download (791kB) | Preview

Abstract

Comprehension of many types of texts involves constructing meaning from text and pictures. However, research examining how second language (L2) learners process text and pictures and the relationship with comprehension is scarce. Thus, while verbal input is often presented in written and auditory modes simultaneously (i.e., audio of text with simultaneous reading of it), we do not know how the auditory input affects L2 adult learners’ processing of text and pictures and its relation to comprehension. In the current study, L2 adult learners and native (L1) adults read and read while listening to an illustrated story while their eye movements were recorded. Immediately after reading, they completed a comprehension test. Results showed that the presence of auditory input allowed learners to spend more time looking at pictures and supported a better integration of text and pictures. No differences were observed between L2 and L1 readers’ allocation of attention to text and pictures. Both reading conditions led to similar levels of comprehension. Processing time on the text was positively related to comprehension for L2 readers, while it was associated to lower comprehension for L1 readers. Processing time on images was positively related to comprehension only for L1 readers.

Type: Article
Title: The Effect of Auditory Input on Multimodal Reading Comprehension: An Examination of Adult Readers’ Eye Movements
Open access status: An open access version is available from UCL Discovery
DOI: 10.1111/modl.12743
Publisher version: https://doi.org/10.1111/modl.12743
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions.
Keywords: multimodal reading, multimedia learning, second language, reading while listening, eye-tracking, reading comprehension
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Education
UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education
UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education > IOE - Culture, Communication and Media
URI: https://discovery.ucl.ac.uk/id/eprint/10137348
Downloads since deposit
22Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item