Albanie, S;
Varol, G;
Momeni, L;
Afouras, T;
Brown, A;
Zhang, C;
Coto, E;
... Zisserman, A; + view all
(2021)
SeeHear: Signer Diarisation and a New Dataset.
In:
Proceedings of ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).
(pp. pp. 2280-2284).
IEEE: Toronto, Canada.
Preview |
Text
albanie2021icassp.pdf - Accepted Version Download (5MB) | Preview |
Abstract
In this work, we propose a framework to collect a large-scale, diverse sign language dataset that can be used to train automatic sign language recognition models.The first contribution of this work is SDTrack, a generic method for signer tracking and diarisation in the wild. Our second contribution is SeeHear, a dataset of 90 hours of British Sign Language (BSL) content featuring more than 1000 signers, and including interviews, monologues and debates. Using SDTrack, the SeeHear dataset is annotated with 35K active signing tracks, with corresponding signer identities and subtitles, and 40K automatically localised sign labels. As a third contribution, we provide benchmarks for signer diarisation and sign recognition on SeeHear.
| Type: | Proceedings paper |
|---|---|
| Title: | SeeHear: Signer Diarisation and a New Dataset |
| Event: | ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) |
| ISBN-13: | 978-1-7281-7605-5 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/ICASSP39728.2021.9414856 |
| Publisher version: | https://doi.org/10.1109/ICASSP39728.2021.9414856 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Signer Diarisation, Sign Language Datasets |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Linguistics |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10135499 |
Archive Staff Only
 |
View Item |
