Siciliano, C; Williams, G; Beskow, J; Faulkner, A; (2003) Evaluation of a multilingual synthetic talking face as a communication aid for the hearing impaired. In: Proceedings of the 15th International Congress of Phonetic Sciences: 15th ICPhS, Barcelona 3-9 August 2003. (pp. 131 - 134). Universitat Autònoma de Barcelona / International Phonetic Association: Barcelona, Spain.

Preview

PDF Siciliano_etal_SYnface.pdf Available under License : See the attached licence file. Download (100kB)

Abstract

The Synface project is developing a synthetic talking face to aid the hearing impaired in telephone conversation. This report investigates the gain in intelligibility from the synthetic talking head when controlled by hand-annotated speech. Audio from Swedish, English and Dutch sentences was degraded to simulate the information losses that arise in severe-to-profound hearing impairment. 12 normal-hearing native speakers for each language took part. Auditory signals were presented alone, with the synthetic face, and with a video of the original talker. Purely auditory intelligibility was low. With the addition of the synthetic face, average intelligibility increased by 20%. Scores with the synthetic face were significantly lower than for the natural face for English and Dutch, but not Swedish. Visual identification of English consonants showed that the synthetic face fell short of a natural face on both place and manner of articulation. This information will be used to improve the synthesis.

Download activity - last month

Export as JSONXMLCSV

Download activity - last 12 months

Export as CSVXMLJSON

Downloads by country - last 12 months

Export as XMLCSVJSON

Archive Staff Only

View Item