Dewaskar, Miheer;
Tosh, Christopher;
Knoblauch, Jeremias;
Dunson, David B;
(2025)
Robustifying Likelihoods by Optimistically Re-weighting Data.
Journal of the American Statistical Association
10.1080/01621459.2025.2468012.
(In press).
|
Text
Knoblauch_2303.10525v2.pdf - Accepted Version Access restricted to UCL open access staff until 12 April 2026. Download (4MB) |
Abstract
Likelihood-based inferences have been remarkably successful in wide-spanning application areas. However, even after due diligence in selecting a good model for the data at hand, there is inevitably some amount of model misspecification: outliers, data contamination or inappropriate parametric assumptions such as Gaussianity mean that most models are at best rough approximations of reality. A significant practical concern is that for certain inferences, even small amounts of model misspecification may have a substantial impact; a problem we refer to as brittleness. This article attempts to address the brittleness problem in likelihood-based inferences by choosing the most model friendly data generating process in a distance-based neighborhood of the empirical measure. This leads to a new Optimistically Weighted Likelihood (OWL), which robustifies the original likelihood by formally accounting for a small amount of model misspecification. Focusing on total variation (TV) neighborhoods, we study theoretical properties, develop estimation algorithms and illustrate the methodology in applications to mixture models and regression. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.
| Type: | Article |
|---|---|
| Title: | Robustifying Likelihoods by Optimistically Re-weighting Data |
| DOI: | 10.1080/01621459.2025.2468012 |
| Publisher version: | https://doi.org/10.1080/01621459.2025.2468012 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Coarsened Bayes, Data contamination, DISTANCE, DISTRIBUTIONS, EFFICIENCY, ESTIMATORS, LOCATION, Mathematics, Mixture models, Model misspecification, MODELS, Outliers, Physical Sciences, Robust inference, ROBUSTNESS, Science & Technology, Statistics & Probability, Total variation distance |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10208829 |
Archive Staff Only
![]() |
View Item |

