Yin, Z;
Barucca, P;
(2021)
Stochastic Recurrent Neural Network for Multistep Time Series Forecasting.
In:
Neural Information Processing.
(pp. pp. 14-26).
Springer: Cham, Switzerland.
Preview |
Text
Stochastic Recurrent Neural Network for Multistep Time Series Forecasting.pdf - Accepted Version Download (2MB) | Preview |
Abstract
Time series forecasting based on deep architectures has been gaining popularity in recent years due to their ability to model complex non-linear temporal dynamics. The recurrent neural network is one such model capable of handling variable-length input and output. In this paper, we leverage recent advances in deep generative models and the concept of state space models to propose a stochastic adaptation of the recurrent neural network for multistep-ahead time series forecasting, which is trained with stochastic gradient variational Bayes. To capture the stochasticity in time series temporal dynamics, we incorporate a latent random variable into the recurrent neural network to make its transition function stochastic. Our model preserves the architectural workings of a recurrent neural network for which all relevant information is encapsulated in its hidden states, and this flexibility allows our model to be easily integrated into any deep architecture for sequential modelling. We test our model on a wide range of datasets from finance to healthcare; results show that the stochastic recurrent neural network consistently outperforms its deterministic counterpart.
Type: | Proceedings paper |
---|---|
Title: | Stochastic Recurrent Neural Network for Multistep Time Series Forecasting |
Event: | International Conference on Neural Information Processing (ICONIP 2021) |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1007/978-3-030-92185-9_2 |
Publisher version: | https://doi.org/10.1007/978-3-030-92185-9_2 |
Language: | English |
Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
Keywords: | State space models, Deep generative models, Variational inference |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
URI: | https://discovery.ucl.ac.uk/id/eprint/10142046 |
Archive Staff Only
View Item |