Renz, K;
Stache, NC;
Fox, N;
Varol, G;
Albanie, S;
(2021)
Sign segmentation with changepoint-modulated pseudo-labelling.
In:
Proceedings: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops.
(pp. pp. 3398-3407).
IEEE
Preview |
Text
Sign Segmentation Changepoint.pdf - Accepted Version Download (7MB) | Preview |
Abstract
The objective of this work is to find temporal boundaries between signs in continuous sign language. Motivated by the paucity of annotation available for this task, we propose a simple yet effective algorithm to improve segmentation performance on unlabelled signing footage from a domain of interest. We make the following contributions: (1) We motivate and introduce the task of source-free domain adaptation for sign language segmentation, in which labelled source data is available for an initial training phase, but is not available during adaptation. (2) We propose the Changepoint-Modulated Pseudo-Labelling (CMPL) algorithm to leverage cues from abrupt changes in motion-sensitive feature space to improve pseudo-labelling quality for adaptation. (3) We showcase the effectiveness of our approach for category-agnostic sign segmentation, transferring from the BSLCORPUS to the BSL-1K and RWTH-PHOENIX-Weather 2014 datasets, where we outperform the prior state of the art.
| Type: | Proceedings paper |
|---|---|
| Title: | Sign segmentation with changepoint-modulated pseudo-labelling |
| Event: | 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Nashville, TN, USA, 19-25 June 2021 |
| ISBN-13: | 9781665448994 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/CVPRW53098.2021.00379 |
| Publisher version: | https://doi.org/10.1109/CVPRW53098.2021.00379 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Training, Adaptation models, Assistive technology, Motion segmentation, Conferences, Gesture recognition, Data models |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Linguistics |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10136869 |
Archive Staff Only
 |
View Item |
