UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Stochastic Recurrent Neural Network for Multistep Time Series Forecasting

Yin, Z; Barucca, P; (2021) Stochastic Recurrent Neural Network for Multistep Time Series Forecasting. In: Neural Information Processing. (pp. pp. 14-26). Springer: Cham, Switzerland. Green open access

[thumbnail of Stochastic Recurrent Neural Network for Multistep Time Series Forecasting.pdf]
Preview
Text
Stochastic Recurrent Neural Network for Multistep Time Series Forecasting.pdf - Accepted Version

Download (2MB) | Preview

Abstract

Time series forecasting based on deep architectures has been gaining popularity in recent years due to their ability to model complex non-linear temporal dynamics. The recurrent neural network is one such model capable of handling variable-length input and output. In this paper, we leverage recent advances in deep generative models and the concept of state space models to propose a stochastic adaptation of the recurrent neural network for multistep-ahead time series forecasting, which is trained with stochastic gradient variational Bayes. To capture the stochasticity in time series temporal dynamics, we incorporate a latent random variable into the recurrent neural network to make its transition function stochastic. Our model preserves the architectural workings of a recurrent neural network for which all relevant information is encapsulated in its hidden states, and this flexibility allows our model to be easily integrated into any deep architecture for sequential modelling. We test our model on a wide range of datasets from finance to healthcare; results show that the stochastic recurrent neural network consistently outperforms its deterministic counterpart.

Type: Proceedings paper
Title: Stochastic Recurrent Neural Network for Multistep Time Series Forecasting
Event: International Conference on Neural Information Processing (ICONIP 2021)
Open access status: An open access version is available from UCL Discovery
DOI: 10.1007/978-3-030-92185-9_2
Publisher version: https://doi.org/10.1007/978-3-030-92185-9_2
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: State space models, Deep generative models, Variational inference
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10142046
Downloads since deposit
21Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item