UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Skeleton Split Strategies for Spatial Temporal Graph Convolution Networks

Alsawadi, Motasem S; Rio, Miguel; (2022) Skeleton Split Strategies for Spatial Temporal Graph Convolution Networks. Computers, Materials & Continua , 71 (3) pp. 4643-4658. 10.32604/cmc.2022.022783. Green open access

[thumbnail of TSP_CMC_22783.pdf]
Preview
Text
TSP_CMC_22783.pdf - Published Version

Download (910kB) | Preview

Abstract

Action recognition has been recognized as an activity in which individuals’ behaviour can be observed. Assembling profiles of regular activities such as activities of daily living can support identifying trends in the data during critical events. A skeleton representation of the human body has been proven to be effective for this task. The skeletons are presented in graphs form-like. However, the topology of a graph is not structured like Euclidean-based data. Therefore, a new set of methods to perform the convolution operation upon the skeleton graph is proposed. Our proposal is based on the Spatial Temporal-Graph Convolutional Network (ST-GCN) framework. In this study, we proposed an improved set of label mapping methods for the ST-GCN framework. We introduce three split techniques (full distance split, connection split, and index split) as an alternative approach for the convolution operation. The experiments presented in this study have been trained using two benchmark datasets: NTU-RGB + D and Kinetics to evaluate the performance. Our results indicate that our split techniques outperform the previous partition strategies and are more stable during training without using the edge importance weighting additional training parameter. Therefore, our proposal can provide a more realistic solution for real-time applications centred on daily living recognition systems activities for indoor environments.

Type: Article
Title: Skeleton Split Strategies for Spatial Temporal Graph Convolution Networks
Open access status: An open access version is available from UCL Discovery
DOI: 10.32604/cmc.2022.022783
Publisher version: https://www.techscience.com/cmc/v71n3/46481
Language: English
Additional information: © The Authors 2022. This work is licensed under a Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0/).
Keywords: Skeleton split strategies; spatial temporal graph convolutional neural networks; skeleton joints; action recognition
UCL classification: UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL
URI: https://discovery.ucl.ac.uk/id/eprint/10151838
Downloads since deposit
36Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item