Karlsson, I; Faulkner, A; Salvi, G; (2003) SYNFACE - a talking face telephone. In: EUROSPEECH 2003: 8th European Conference on Speech Communication and Technology: (EUROSPEECH 2003 - INTERSPEECH 2003): Geneva, Switzerland: September 1-4, 2003. (pp. 1297 - 1300). International Speech Communication Association: Baixas, France.

Preview

PDF Synface_Eurospeech.pdf Available under License : See the attached licence file. Download (303kB)

Abstract

The SYNFACE project has as its primary goal to facilitate for hearing-impaired people to use an ordinary telephone. This will be achieved by using a talking face connected to the telephone. The incoming speech signal will govern the speech movements of the talking face, hence the talking face will provide lip-reading support for the user. The project will define the visual speech information that supports lip-reading, and develop techniques to derive this information from the acoustic speech signal in near real time for three different languages: Dutch, English and Swedish. This requires the development of automatic speech recognition methods that detect information in the acoustic signal that correlates with the speech movements. This information will govern the speech movements in a synthetic face and synchronise them with the acoustic speech signal. A prototype system is being constructed. The prototype contains results achieved so far in SYNFACE. This system will be tested and evaluated for the three languages by hearing-impaired users. SYNFACE is an IST project (IST-2001-33327) with partners from the Netherlands, UK and Sweden. SYNFACE builds on experiences gained in the Swedish Teleface project.

Download activity - last month

Export as JSONXMLCSV

Download activity - last 12 months

Export as JSONXMLCSV

Downloads by country - last 12 months

Export as JSONXMLCSV

Archive Staff Only

View Item