UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Robust Improper Maximum Likelihood: Tuning, Computation, and a Comparison With Other Methods for Robust Gaussian Clustering

Coretto, P; Hennig, C; (2016) Robust Improper Maximum Likelihood: Tuning, Computation, and a Comparison With Other Methods for Robust Gaussian Clustering. Journal of the American Statistical Association , 111 (516) pp. 1648-1659. 10.1080/01621459.2015.1100996. Green open access

[thumbnail of Robust Improper Maximum Likelihood Tuning.pdf]
Preview
Text
Robust Improper Maximum Likelihood Tuning.pdf

Download (1MB) | Preview

Abstract

The two main topics of this article are the introduction of the “optimally tuned robust improper maximum likelihood estimator” (OTRIMLE) for robust clustering based on the multivariate Gaussian model for clusters, and a comprehensive simulation study comparing the OTRIMLE to maximum likelihood in Gaussian mixtures with and without noise component, mixtures of t-distributions, and the TCLUST approach for trimmed clustering. The OTRIMLE uses an improper constant density for modeling outliers and noise. This can be chosen optimally so that the nonnoise part of the data looks as close to a Gaussian mixture as possible. Some deviation from Gaussianity can be traded in for lowering the estimated noise proportion. Covariance matrix constraints and computation of the OTRIMLE are also treated. In the simulation study, all methods are confronted with setups in which their model assumptions are not exactly fulfilled, and to evaluate the experiments in a standardized way by misclassification rates, a new model-based definition of “true clusters” is introduced that deviates from the usual identification of mixture components with clusters. In the study, every method turns out to be superior for one or more setups, but the OTRIMLE achieves the most satisfactory overall performance. The methods are also applied to two real datasets, one without and one with known “true” clusters. Supplementary materials for this article are available online.

Type: Article
Title: Robust Improper Maximum Likelihood: Tuning, Computation, and a Comparison With Other Methods for Robust Gaussian Clustering
Open access status: An open access version is available from UCL Discovery
DOI: 10.1080/01621459.2015.1100996
Publisher version: http://dx.doi.org/10.1080/01621459.2015.1100996
Language: English
Additional information: © Pietro Coretto and Christian Hennig. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Keywords: Science & Technology, Physical Sciences, Statistics & Probability, Mathematics, Cluster analysis, EM-algorithm, Improper density, Mixture models, Model-based clustering, Robustness, DISTRIBUTIONS, MIXTURE, IDENTIFICATION, ESTIMATORS, POINT, MCD
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science
URI: https://discovery.ucl.ac.uk/id/eprint/1529792
Downloads since deposit
91Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item