UCL logo

UCL Discovery

UCL home » Library Services » Electronic resources » UCL Discovery

On Smoothing and Inference for Topic Models

Asuncion, A; Welling, M; Smyth, P; Teh, YW; On Smoothing and Inference for Topic Models. Presented at: UNSPECIFIED.

Full text not available from this repository.

Abstract

Latent Dirichlet analysis, or topic modeling, is a flexible latent variable framework for modeling high-dimensional sparse count data. Various learning algorithms have been developed in recent years, including collapsed Gibbs sampling, variational inference, and maximum a posteriori estimation, and this variety motivates the need for careful empirical comparisons. In this paper, we highlight the close connections between these approaches. We find that the main differences are attributable to the amount of smoothing applied to the counts. When the hyperparameters are optimized, the differences in performance among the algorithms diminish significantly. The ability of these algorithms to achieve solutions of comparable accuracy gives us the freedom to select computationally efficient approaches. Using the insights gained from this comparative study, we show how accurate topic models can be learned in several seconds on text corpora with thousands of documents.

Type: Conference item (UNSPECIFIED)
Title: On Smoothing and Inference for Topic Models
Additional information: Appears in Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence (UAI2009)
Keywords: cs.LG, cs.LG, stat.ML
UCL classification: UCL > School of Life and Medical Sciences
UCL > School of Life and Medical Sciences > Faculty of Life Sciences
UCL > School of Life and Medical Sciences > Faculty of Life Sciences > Gatsby Computational Neuroscience Unit
URI: http://discovery.ucl.ac.uk/id/eprint/150501
Downloads since deposit
0Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item