UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

A kernel Stein test for comparing latent variable models

Kanagawa, Heishiro; Jitkrittum, Wittawat; Mackey, Lester; Fukumizu, Kenji; Gretton, Arthur; (2023) A kernel Stein test for comparing latent variable models. Journal of the Royal Statistical Society: Statistical Methodology Series B , Article qkad050. 10.1093/jrsssb/qkad050. (In press). Green open access

[thumbnail of qkad050.pdf]
Preview
Text
qkad050.pdf - Published Version

Download (935kB) | Preview

Abstract

We propose a kernel-based nonparametric test of relative goodness of fit, where the goal is to compare two models, both of which may have unobserved latent variables, such that the marginal distribution of the observed variables is intractable. The proposed test generalizes the recently proposed kernel Stein discrepancy (KSD) tests (Liu et al., Proceedings of the 33rd international conference on machine learning (pp. 276–284); Chwialkowski et al., (2016), In Proceedings of the 33rd international conference on machine learning (pp. 2606–2615); Yang et al., (2018), In Proceedings of the 35th international conference on machine learning (pp. 5561–5570)) to the case of latent variable models, a much more general class than the fully observed models treated previously. The new test, with a properly calibrated threshold, has a well-controlled type-I error. In the case of certain models with low-dimensional latent structures and high-dimensional observations, our test significantly outperforms the relative maximum mean discrepancy test, which is based on samples from the models and does not exploit the latent structure.

Type: Article
Title: A kernel Stein test for comparing latent variable models
Open access status: An open access version is available from UCL Discovery
DOI: 10.1093/jrsssb/qkad050
Publisher version: https://doi.org/10.1093/jrsssb/qkad050
Language: English
Additional information: © (RSS) Royal Statistical Society 2023. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https:// creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.
Keywords: hypothesis testing, kernel methods, mixture models, model selection, Stein’s method
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences > Gatsby Computational Neurosci Unit
URI: https://discovery.ucl.ac.uk/id/eprint/10171166
Downloads since deposit
38Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item