Siciliano, C; Williams, G; Beskow, J; Faulkner, A; (2003) Evaluation of a multilingual synthetic talking face as a communication aid for the hearing impaired. In: Proceedings of the 15th International Congress of Phonetic Sciences: 15th ICPhS, Barcelona 3-9 August 2003. (pp. 131 - 134). Universitat Autònoma de Barcelona / International Phonetic Association: Barcelona, Spain.
|PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader|
The Synface project is developing a synthetic talking face to aid the hearing impaired in telephone conversation. This report investigates the gain in intelligibility from the synthetic talking head when controlled by hand-annotated speech. Audio from Swedish, English and Dutch sentences was degraded to simulate the information losses that arise in severe-to-profound hearing impairment. 12 normal-hearing native speakers for each language took part. Auditory signals were presented alone, with the synthetic face, and with a video of the original talker. Purely auditory intelligibility was low. With the addition of the synthetic face, average intelligibility increased by 20%. Scores with the synthetic face were significantly lower than for the natural face for English and Dutch, but not Swedish. Visual identification of English consonants showed that the synthetic face fell short of a natural face on both place and manner of articulation. This information will be used to improve the synthesis.
|Title:||Evaluation of a multilingual synthetic talking face as a communication aid for the hearing impaired|
|Open access status:||An open access version is available from UCL Discovery|
|UCL classification:||UCL > School of Life and Medical Sciences > Faculty of Brain Sciences > Psychology and Language Sciences (Division of) > Speech, Hearing and Phonetic Sciences|
UCL > School of Life and Medical Sciences > Faculty of Life Sciences
View download statistics for this item
Activity - last month
Activity - last 12 months
Archive Staff Only: edit this record