UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Learning Data-Driven Uncertainty Set Partitions for Robust and Adaptive Energy Forecasting with Missing Data

Stratigakos, Akylas; Andrianesis, Panagiotis; (2025) Learning Data-Driven Uncertainty Set Partitions for Robust and Adaptive Energy Forecasting with Missing Data. IEEE Transactions on Smart Grid 10.1109/tsg.2025.3620957. (In press). Green open access

[thumbnail of Learning_Data-Driven_Uncertainty_Set_Partitions_for_Robust_and_Adaptive_Energy_Forecasting_with_Missing_Data.pdf]
Preview
PDF
Learning_Data-Driven_Uncertainty_Set_Partitions_for_Robust_and_Adaptive_Energy_Forecasting_with_Missing_Data.pdf - Accepted Version

Download (4MB) | Preview

Abstract

Short-term forecasting models typically assume the availability of input data (features) when they are deployed and in use. However, equipment failures, disruptions, cyberattacks, may lead to missing features when such models are used operationally, which could negatively affect forecast accuracy, and result in suboptimal operational decisions. In this paper, we use adaptive robust optimization and adversarial machine learning to develop forecasting models that seamlessly handle missing data operationally. We propose linear- and neural network-based forecasting models with parameters that adapt to available features, combining linear adaptation with a novel algorithm for learning data-driven uncertainty set partitions. The proposed adaptive models do not rely on identifying historical missing data patterns and are suitable for real-time operations under stringent time constraints. Extensive numerical experiments on short-term wind power forecasting considering horizons from 15 minutes to 4 hours ahead illustrate that our proposed adaptive models are on par with imputation when data are missing for very short periods (e.g., when only the latest measurement is missing) whereas they significantly outperform imputation when data are missing for longer periods. We further provide insights by showcasing how linear adaptation and data-driven partitions (even with a few subsets) approach the performance of the optimal, yet impractical, method of retraining for every possible realization of missing data.

Type: Article
Title: Learning Data-Driven Uncertainty Set Partitions for Robust and Adaptive Energy Forecasting with Missing Data
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/tsg.2025.3620957
Publisher version: https://doi.org/10.1109/tsg.2025.3620957
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Forecasting , Predictive models , Data models , Adaptation models , Imputation , Uncertainty , Wind power generation , Training , Real-time systems , Numerical models
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of the Built Environment
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of the Built Environment > Bartlett School Env, Energy and Resources
URI: https://discovery.ucl.ac.uk/id/eprint/10215885
Downloads since deposit
0Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item