Zhong, Mingze;
Long, Zexuan;
Wang, Xinglei;
Cheng, Tao;
Fang, Meng;
Chen, Ling;
(2025)
A unified multi-subgraph pre-training framework for spatio-temporal graph.
Knowledge-Based Systems
, 330
(Part A)
, Article 114428. 10.1016/j.knosys.2025.114428.
Preview |
Text
Knowledge-based system 2025.pdf - Published Version Download (3MB) | Preview |
Abstract
Spatio-temporal graph (STG) learning has shown great potential in capturing complex spatio-temporal dependencies and has achieved significant success in various fields such as traffic flow prediction, climate forecasting, and epidemiological spread research. By learning general features from spatio-temporal graphs, pre-trained graph models can capture hidden semantic information in the data, thereby enhancing the learning effect of downstream tasks and improving overall model performance. However, most existing spatio-temporal graph learning methods use the entire graph for training, which may not fully capture local structure and feature information. In addition, existing methods usually adopt sequence modeling techniques without fully considering the time decay effect, i.e., the need to apply decaying attention to distant time steps. To address these issues, this paper proposes a unified dual-phase multi-subgraph pre-training spatio-temporal graph framework (UMSST). Specifically, in the first phase, the framework learns the global representation of the spatio-temporal graph and locates key graph nodes, while learning the “unit representations” of these key nodes. In the second phase, multiple spatio-temporal subgraphs are constructed based on these “unit representations” to further capture the implicit encoding information of more general features around the corresponding subgraphs, thereby helping the model make full use of general features. Experimental results on real datasets show that the proposed pre-trained spatio-temporal graph framework significantly improves the performance of downstream tasks and demonstrates its effectiveness in comparison with recent strong baseline models.
| Type: | Article |
|---|---|
| Title: | A unified multi-subgraph pre-training framework for spatio-temporal graph |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1016/j.knosys.2025.114428 |
| Publisher version: | https://doi.org/10.1016/j.knosys.2025.114428 |
| Language: | English |
| Additional information: | Copyright © 2025 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/). |
| Keywords: | Graph neural network; Pre-training; Spatio-temporal graph; Multi-subgraphs; Time decay |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of the Built Environment UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Civil, Environ and Geomatic Eng UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of the Built Environment > Bartlett School Env, Energy and Resources |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10215394 |
Archive Staff Only
 |
View Item |
