UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Maximum-Entropy Inference with a Programmable Annealer

Chancellor, N; Szoke, S; Vinci, W; Aeppli, G; Warburton, PA; (2016) Maximum-Entropy Inference with a Programmable Annealer. Scientific Reports , 6 , Article 22318. 10.1038/srep22318. Green open access

[img] Text
Maximum-Entropy Inference with a Programmable Annealer.pdf - Published version

Download (1MB)

Abstract

Optimisation problems typically involve finding the ground state (i.e. the minimum energy configuration) of a cost function with respect to many variables. If the variables are corrupted by noise then this maximises the likelihood that the solution is correct. The maximum entropy solution on the other hand takes the form of a Boltzmann distribution over the ground and excited states of the cost function to correct for noise. Here we use a programmable annealer for the information decoding problem which we simulate as a random Ising model in a field. We show experimentally that finite temperature maximum entropy decoding can give slightly better bit-error-rates than the maximum likelihood approach, confirming that useful information can be extracted from the excited states of the annealer. Furthermore we introduce a bit-by-bit analytical method which is agnostic to the specific application and use it to show that the annealer samples from a highly Boltzmann-like distribution. Machines of this kind are therefore candidates for use in a variety of machine learning applications which exploit maximum entropy inference, including language processing and image recognition.

Type: Article
Title: Maximum-Entropy Inference with a Programmable Annealer
Location: England
Open access status: An open access version is available from UCL Discovery
DOI: 10.1038/srep22318
Publisher version: http://dx.doi.org/10.1038/srep22318
Language: English
Additional information: This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/
UCL classification: UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > London Centre for Nanotechnology
URI: https://discovery.ucl.ac.uk/id/eprint/1493700
Downloads since deposit
80Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item