UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

A Kernel Two-Sample Test

Gretton, A; Borgwardt, K; Rasch, M; Schoelkopf, B; Smola, A; (2012) A Kernel Two-Sample Test. Journal of Machine Learning Research , 13 pp. 723-773. Green open access

[thumbnail of Gretton_GreBorRasSchetal12%5B1%5D.pdf]
Preview
Text
Gretton_GreBorRasSchetal12%5B1%5D.pdf

Download (432kB) | Preview

Abstract

We propose a framework for analyzing and comparing distributions, which we use to construct statistical tests to determine if two samples are drawn from different distributions. Our test statistic is the largest difference in expectations over functions in the unit ball of a reproducing kernel Hilbert space (RKHS), and is called the maximum mean discrepancy (MMD). We present two distribution-free tests based on large deviation bounds for the MMD, and a third test based on the asymptotic distribution of this statistic. The MMD can be computed in quadratic time, although efficient linear time approximations are available. Our statistic is an instance of an integral probability metric, and various classical metrics on distributions are obtained when alternative function classes are used in place of an RKHS. We apply our two-sample tests to a variety of problems, including attribute matching for databases using the Hungarian marriage method, where they perform strongly. Excellent performance is also obtained when comparing distributions over graphs, for which these are the first such tests.

Type: Article
Title: A Kernel Two-Sample Test
Open access status: An open access version is available from UCL Discovery
Publisher version: http://jmlr.csail.mit.edu/papers/v13/gretton12a.ht...
Language: English
Additional information: Copyright © 2012 Arthur Gretton, Karsten M. Borgwardt, Malte J. Rasch, Bernhard Scholkopf and Alexander Smola.
Keywords: kernel methods, two-sample test, uniform convergence bounds, schema matching, integral probability metric, hypothesis testing
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences > Gatsby Computational Neurosci Unit
URI: https://discovery.ucl.ac.uk/id/eprint/1378288
Downloads since deposit
169Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item