Matsubara, T;
Knoblauch, J;
Briol, FX;
Oates, CJ;
(2024)
Generalized Bayesian Inference for Discrete Intractable Likelihood.
Journal of the American Statistical Association
, 119
(547)
pp. 2345-2355.
10.1080/01621459.2023.2257891.
Preview |
Text
2206.08420.pdf - Other Download (733kB) | Preview |
Abstract
Discrete state spaces represent a major computational challenge to statistical inference, since the computation of normalization constants requires summation over large or possibly infinite sets, which can be impractical. This article addresses this computational challenge through the development of a novel generalized Bayesian inference procedure suitable for discrete intractable likelihood. Inspired by recent methodological advances for continuous data, the main idea is to update beliefs about model parameters using a discrete Fisher divergence, in lieu of the problematic intractable likelihood. The result is a generalized posterior that can be sampled from using standard computational tools, such as Markov chain Monte Carlo, circumventing the intractable normalizing constant. The statistical properties of the generalized posterior are analyzed, with sufficient conditions for posterior consistency and asymptotic normality established. In addition, a novel and general approach to calibration of generalized posteriors is proposed. Applications are presented on lattice models for discrete spatial data and on multivariate models for count data, where in each case the methodology facilitates generalized Bayesian inference at low computational cost. Supplementary materials for this article are available online.
Type: | Article |
---|---|
Title: | Generalized Bayesian Inference for Discrete Intractable Likelihood |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1080/01621459.2023.2257891 |
Publisher version: | https://doi.org/10.1080/01621459.2023.2257891 |
Language: | English |
Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
Keywords: | Calibration of generalized posteriors, Discrete Fisher divergence, Multivariate count data |
UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science |
URI: | https://discovery.ucl.ac.uk/id/eprint/10180574 |
Archive Staff Only
View Item |