UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Sign segmentation with changepoint-modulated pseudo-labelling

Renz, K; Stache, NC; Fox, N; Varol, G; Albanie, S; (2021) Sign segmentation with changepoint-modulated pseudo-labelling. In: Proceedings: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. (pp. pp. 3398-3407). IEEE Green open access

[thumbnail of Sign Segmentation Changepoint.pdf]
Preview
Text
Sign Segmentation Changepoint.pdf - Accepted Version

Download (7MB) | Preview

Abstract

The objective of this work is to find temporal boundaries between signs in continuous sign language. Motivated by the paucity of annotation available for this task, we propose a simple yet effective algorithm to improve segmentation performance on unlabelled signing footage from a domain of interest. We make the following contributions: (1) We motivate and introduce the task of source-free domain adaptation for sign language segmentation, in which labelled source data is available for an initial training phase, but is not available during adaptation. (2) We propose the Changepoint-Modulated Pseudo-Labelling (CMPL) algorithm to leverage cues from abrupt changes in motion-sensitive feature space to improve pseudo-labelling quality for adaptation. (3) We showcase the effectiveness of our approach for category-agnostic sign segmentation, transferring from the BSLCORPUS to the BSL-1K and RWTH-PHOENIX-Weather 2014 datasets, where we outperform the prior state of the art.

Type: Proceedings paper
Title: Sign segmentation with changepoint-modulated pseudo-labelling
Event: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Nashville, TN, USA, 19-25 June 2021
ISBN-13: 9781665448994
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/CVPRW53098.2021.00379
Publisher version: https://doi.org/10.1109/CVPRW53098.2021.00379
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Training, Adaptation models, Assistive technology, Motion segmentation, Conferences, Gesture recognition, Data models
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Linguistics
URI: https://discovery.ucl.ac.uk/id/eprint/10136869
Downloads since deposit
30Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item