UCL logo

UCL Discovery

UCL home » Library Services » Electronic resources » UCL Discovery

Data-driven methods for the assessment and improvement of forecasts

Aboukhamseen, S.M.; (2001) Data-driven methods for the assessment and improvement of forecasts. Doctoral thesis , University of London. Green open access


Download (9MB)


This thesis uses data-driven techniques to analyse and assess both point and probability forecasts within a prequential framework. Point forecasts are assessed using recursive residuals. Examination of the properties of the recursive residual found them to be unique to this residual. Recursive residuals for the hidden state of HMM are also defined by taking the difference between the one step ahead forecast and the forecast's filtered update. The quality of forecasts generated from different models can be assessed by comparing the information content in their corresponding residuals. When faced with model to correct this misspecification it is shown how this residual can be modelled to correct this misspecification, thereby improving forecasts. It is also shown how the residual content can be used to judge the predictive sufficiency of alternative forecasting methods. Using the theory of probability forecasting, the technique of forecasting assessment by calibration is extended to HMM's to assess how well the one step ahead forecast is explained by its filtered update. A test statistic to test the empirical calibration of the forecasts is also defined and applied to the real world problem of CpG island detection in Human DNA sequences. The distribution of the test statistic is investigated using a prequential frame of reference and is found to be N(0.1). Calibration of HMMs is also examined using smoothed predictions and cross- validation forecasts. A test statistic is defined for this scenario and the its distribution is examined using a cross- validation frame of reference. A prequential estimation algorithm for HMMs is also developed.

Type: Thesis (Doctoral)
Title: Data-driven methods for the assessment and improvement of forecasts
Open access status: An open access version is available from UCL Discovery
Language: English
Additional information: Thesis digitised by British Library EThOS
UCL classification: UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science
URI: http://discovery.ucl.ac.uk/id/eprint/1317569
Downloads since deposit
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item