Hou, J; Wang, G; Chen, X; Xue, JH; Zhu, R; Yang, H; (2018) Spatial-temporal attention res-TCN for skeleton-based dynamic hand gesture recognition. In: Leal-Taixé, L and Roth, S, (eds.) Computer Vision – ECCV 2018 Workshops. (pp. pp. 273-286). Springer Nature: Cham, Switzerland.

Preview

Text Xue_Spatial-Temporal Attention Res-TCN for Skeleton-Based Dynamic Hand Gesture Recognition_AAM.pdf - Accepted Version Download (1MB) | Preview

Abstract

Dynamic hand gesture recognition is a crucial yet challenging task in computer vision. The key of this task lies in an effective extraction of discriminative spatial and temporal features to model the evolutions of different gestures. In this paper, we propose an end-to-end Spatial-Temporal Attention Residual Temporal Convolutional Network (STA-Res-TCN) for skeleton-based dynamic hand gesture recognition, which learns different levels of attention and assigns them to each spatial-temporal feature extracted by the convolution filters at each time step. The proposed attention branch assists the networks to adaptively focus on the informative time frames and features while exclude the irrelevant ones that often bring in unnecessary noise. Moreover, our proposed STA-Res-TCN is a lightweight model that can be trained and tested in an extremely short time. Experiments on DHG-14/28 Dataset and SHREC’17 Track Dataset show that STA-Res-TCN outperforms state-of-the-art methods on both the 14 gestures setting and the more complicated 28 gestures setting.

Download activity - last month

Export as XMLCSVJSON

Download activity - last 12 months

Export as CSVXMLJSON

Downloads by country - last 12 months

Export as XMLCSVJSON

Archive Staff Only

View Item