Leroy, Arthur;
Latouche, Pierre;
Guedj, Benjamin;
Gey, Servane;
(2022)
MAGMA: inference and prediction using multi-task Gaussian processes with common mean.
Machine Learning
10.1007/s10994-022-06172-1.
(In press).
Preview |
Text
Guedj_MAGMA. Inference and prediction using multi-task Gaussian processes with common mean_AOP.pdf - Published Version Download (2MB) | Preview |
Abstract
A novel multi-task Gaussian process (GP) framework is proposed, by using a common mean process for sharing information across tasks. In particular, we investigate the problem of time series forecasting, with the objective to improve multiple-step-ahead predictions. The common mean process is defined as a GP for which the hyper-posterior distribution is tractable. Therefore an EM algorithm is derived for handling both hyper-parameters optimisation and hyper-posterior computation. Unlike previous approaches in the literature, the model fully accounts for uncertainty and can handle irregular grids of observations while maintaining explicit formulations, by modelling the mean process in a unified GP framework. Predictive analytical equations are provided, integrating information shared across tasks through a relevant prior mean. This approach greatly improves the predictive performances, even far from observations, and may reduce significantly the computational complexity compared to traditional multi-task GP models. Our overall algorithm is called MAGMA (standing for Multi tAsk GPs with common MeAn). The quality of the mean process estimation, predictive performances, and comparisons to alternatives are assessed in various simulated scenarios and on real datasets.
| Type: | Article |
|---|---|
| Title: | MAGMA: inference and prediction using multi-task Gaussian processes with common mean |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1007/s10994-022-06172-1 |
| Publisher version: | https://doi.org/10.1007/s10994-022-06172-1 |
| Language: | English |
| Additional information: | This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visithttp://creativecommons.org/licenses/by/4.0/. |
| Keywords: | Multi-task learning, Gaussian processes, EM algorithm, Common mean process, Functional data analysis |
| UCL classification: | UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science UCL > Provost and Vice Provost Offices > UCL BEAMS UCL |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10148633 |
Archive Staff Only
 |
View Item |
