UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Key challenges in using automatic dubbing to translate educational YouTube videos

Baños, Rocío; (2023) Key challenges in using automatic dubbing to translate educational YouTube videos. Linguistica Antverpiensia, New Series: Themes in Translation Studies , 22 10.52034/lans-tts.v22i.763. Green open access

[thumbnail of Banos_3_Banos_FINAL.pdf]
Preview
Text
Banos_3_Banos_FINAL.pdf - Published Version

Download (4MB) | Preview

Abstract

The dubbing industry has been particularly concerned with how to cope with the higher demand in dubbing experienced over the past few years. Media companies have invested in Artificial Intelligence, with significant developments on automatic dubbing spearheaded by companies like Google (Kottahachchi & Abeysinghe, 2022), Amazon (Federico et al., 2020; Lakew et al., 2021) or AppTek (Di Gangi et al., 2022). These organisations have clearly seen the potential in automatic dubbing, understood as the combination of automatic speech recognition, machine translation and text to speech technologies to automatically replace the audio track of an original audiovisual text with synthetic speech in a different language, taking into consideration relevant synchronies. Against this backdrop, this article sets out to: 1) provide an overview of automatic dubbing in the current mediascape and to contextualise this practice accordingly; and 2) to identify some of the main challenges of its implementation, especially as regards the integration of MT and speech synthesis in the dubbing workflow. To this end, the performance of the tool Aloud will be evaluated, by analysing the videos currently available in the Spanish version of the YouTube Channel Amoeba Sisters, which have been dubbed using this tool. The evaluation will focus on the issues highlighted by YouTube users in their comments on this YouTube channel, which include naturalness and accuracy. Special attention will be paid to the use of synthetic voices, which are heavily criticised by users. However, they also highlight the usefulness of automatic dubbing for students interested in biology-related topics who are not fluent in English, in line with the original intent of the tool developers of increasing accessibility.

Type: Article
Title: Key challenges in using automatic dubbing to translate educational YouTube videos
Open access status: An open access version is available from UCL Discovery
DOI: 10.52034/lans-tts.v22i.763
Publisher version: https://doi.org/10.52034/lans-tts.v22i.763
Language: English
Additional information: Copyright (c) 2023 Rocío Baños Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Keywords: automatic dubbing, machine translation, speech synthesis, dubbing, educational videos
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL SLASH
UCL > Provost and Vice Provost Offices > UCL SLASH > Faculty of Arts and Humanities
UCL > Provost and Vice Provost Offices > UCL SLASH > Faculty of Arts and Humanities > SELCS
UCL > Provost and Vice Provost Offices > UCL SLASH > Faculty of Arts and Humanities > SELCS > Translation Studies
URI: https://discovery.ucl.ac.uk/id/eprint/10187164
Downloads since deposit
16Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item