Shi, D; Zhang, X; Cheng, J; Xiong, T; Ni, H; (2025) Adaptive Global Gesture Paths and Signature Features for Skeleton-based Gesture Recognition. In: Pattern Recognition. ICPR 2024. (pp. pp. 278-292). Springer Nature Switzerland: Cham, Switzerland.

Preview

Text ICPR2024.pdf - Accepted Version Download (1MB) | Preview

Abstract

Gestures exhibit sparse joint variations and different time scales, making local dynamic analysis and global spatio-temporal modeling important. Path signature provides mathematical and dynamic analysis of joint trajectories to assist in spatio-temporal modeling. However, previous methods relied on predefined local spatio-temporal joint trajectories, also known as paths. This limitation makes it challenging to directly capture the dynamics of the entire gesture and adapt to varying scales of gesture changes. In this work, we construct the Adaptive Global Gesture Path and extract its signature features as gesture representations. Specifically, we designed global branch to model the global spatio-temporal variation relationship of joints. The dynamic branch is based on the proposed Motion Guided Cluster Attention Block, which emphasizes joints exhibiting similar motion patterns. Combining two branches, the predicted dynamic and global score can distinguish key joints at different times to construct the Adaptive Global Gesture Path that condensely represents the entire gesture. We conducted experiments on the ChaLearn2013 and WLASL datasets, and achieved the state-of-the-art results with much smaller model size.

Download activity - last month

Export as JSONXMLCSV

Download activity - last 12 months

Export as CSVJSONXML

Downloads by country - last 12 months

Export as CSVJSONXML

Archive Staff Only

View Item