UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

SeeHear: Signer Diarisation and a New Dataset

Albanie, S; Varol, G; Momeni, L; Afouras, T; Brown, A; Zhang, C; Coto, E; ... Zisserman, A; + view all (2021) SeeHear: Signer Diarisation and a New Dataset. In: Proceedings of ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). (pp. pp. 2280-2284). IEEE: Toronto, Canada. Green open access

[thumbnail of albanie2021icassp.pdf]
Preview
Text
albanie2021icassp.pdf - Accepted version

Download (5MB) | Preview

Abstract

In this work, we propose a framework to collect a large-scale, diverse sign language dataset that can be used to train automatic sign language recognition models.The first contribution of this work is SDTrack, a generic method for signer tracking and diarisation in the wild. Our second contribution is SeeHear, a dataset of 90 hours of British Sign Language (BSL) content featuring more than 1000 signers, and including interviews, monologues and debates. Using SDTrack, the SeeHear dataset is annotated with 35K active signing tracks, with corresponding signer identities and subtitles, and 40K automatically localised sign labels. As a third contribution, we provide benchmarks for signer diarisation and sign recognition on SeeHear.

Type: Proceedings paper
Title: SeeHear: Signer Diarisation and a New Dataset
Event: ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
ISBN-13: 978-1-7281-7605-5
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/ICASSP39728.2021.9414856
Publisher version: https://doi.org/10.1109/ICASSP39728.2021.9414856
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Signer Diarisation, Sign Language Datasets
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Linguistics
URI: https://discovery.ucl.ac.uk/id/eprint/10135499
Downloads since deposit
13Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item