UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Controlling Multiple Errors Simultaneously with a PAC-Bayes Bound.

Adams, Reuben; Shawe-Taylor, John; Guedj, Benjamin; (2024) Controlling Multiple Errors Simultaneously with a PAC-Bayes Bound. In: Globersons, Amir and Mackey, Lester and Belgrave, Danielle and Fan, Angela and Paquet, Ulrich and Tomczak, Jakub M and Zhang, Cheng, (eds.) Advances in Neural Information Processing Systems 37 (NeurIPS 2024). (pp. pp. 1-30). NeurIPS Green open access

[thumbnail of 20923_Controlling_Multiple_Err.pdf]
Preview
PDF
20923_Controlling_Multiple_Err.pdf - Published Version

Download (2MB) | Preview

Abstract

Current PAC-Bayes generalisation bounds are restricted to scalar metrics of performance, such as the loss or error rate. However, one ideally wants more informationrich certificates that control the entire distribution of possible outcomes, such as the distribution of the test loss in regression, or the probabilities of different mis-classifications. We provide the first PAC-Bayes bound capable of providing such rich information by bounding the Kullback-Leibler divergence between the empirical and true probabilities of a set of M error types, which can either be discretized loss values for regression, or the elements of the confusion matrix (or a partition thereof) for classification. We transform our bound into a differentiable training objective. Our bound is especially useful in cases where the severity of different mis-classifications may change over time; existing PAC-Bayes bounds can only bound a particular pre-decided weighting of the error types. In contrast our bound implicitly controls all uncountably many weightings simultaneously.

Type: Proceedings paper
Title: Controlling Multiple Errors Simultaneously with a PAC-Bayes Bound.
Event: 38th conference on Neural Information Processing Systems (NeurIPS 2024)
ISBN-13: 9798331314385
Open access status: An open access version is available from UCL Discovery
Publisher version: https://papers.nips.cc/paper_files/paper/2024
Language: English
Additional information: This version is the version of record. For information on re-use, please refer to the publisher's terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10206709
Downloads since deposit
3Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item