UCL logo

UCL Discovery

UCL home » Library Services » Electronic resources » UCL Discovery

Evaluation of a multilingual synthetic talking face as a communication aid for the hearing impaired

Siciliano, C; Williams, G; Beskow, J; Faulkner, A; (2003) Evaluation of a multilingual synthetic talking face as a communication aid for the hearing impaired. In: Proceedings of the 15th International Congress of Phonetic Sciences: 15th ICPhS, Barcelona 3-9 August 2003. (pp. 131 - 134). Universitat Autònoma de Barcelona / International Phonetic Association: Barcelona, Spain. Green open access

[img]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
98Kb

Abstract

The Synface project is developing a synthetic talking face to aid the hearing impaired in telephone conversation. This report investigates the gain in intelligibility from the synthetic talking head when controlled by hand-annotated speech. Audio from Swedish, English and Dutch sentences was degraded to simulate the information losses that arise in severe-to-profound hearing impairment. 12 normal-hearing native speakers for each language took part. Auditory signals were presented alone, with the synthetic face, and with a video of the original talker. Purely auditory intelligibility was low. With the addition of the synthetic face, average intelligibility increased by 20%. Scores with the synthetic face were significantly lower than for the natural face for English and Dutch, but not Swedish. Visual identification of English consonants showed that the synthetic face fell short of a natural face on both place and manner of articulation. This information will be used to improve the synthesis.

Type:Proceedings paper
Title:Evaluation of a multilingual synthetic talking face as a communication aid for the hearing impaired
Open access status:An open access version is available from UCL Discovery
Publisher version:http://www.langsci.ucl.ac.uk/ipa/conferences.html
Language:English
UCL classification:UCL > School of Arts and Social Sciences > Faculty of Arts and Humanities > School of EU Langs, Culture and Society > Translation Studies
UCL > School of Life and Medical Sciences > Faculty of Brain Sciences > Psychology and Language Sciences (Division of) > Speech, Hearing and Phonetic Sciences
UCL > School of Life and Medical Sciences > Faculty of Life Sciences

View download statistics for this item

Archive Staff Only: edit this record