Chakravarti, Purvasha;
Kuusela, Mikael;
Lei, Jing;
Wasserman, Larry;
(2023)
Model-independent detection of new physics signals using interpretable SemiSupervised classifier tests.
Annals of Applied Statistics
, 17
(4)
pp. 2759-2795.
10.1214/22-AOAS1722.
Preview |
PDF
22-AOAS1722.pdf - Published Version Download (2MB) | Preview |
Abstract
A central goal in experimental high energy physics is to detect new physics signals that are not explained by known physics. In this paper we aim to search for new signals that appear as deviations from known Standard Model physics in high-dimensional particle physics data. To do this, we determine whether there is any statistically significant difference between the distribution of Standard Model background samples and the distribution of the experimental observations which are a mixture of the background and a potential new signal. Traditionally, one also assumes access to a sample from a model for the hypothesized signal distribution. Here we instead investigate a model-independent method that does not make any assumptions about the signal and uses a semisupervised classifier to detect the presence of the signal in the experimental data. We construct three test statistics using the classifier: an estimated likelihood ratio test (LRT) statistic, a test based on the area under the ROC curve (AUC), and a test based on the misclassification error (MCE). Additionally, we propose a method for estimating the signal strength parameter and explore active subspace methods to interpret the proposed semisupervised classifier in order to understand the properties of the detected signal. We also propose a score test statistic that can be used in the model-dependent setting. We investigate the performance of the methods on a simulated data set related to the search for the Higgs boson at the Large Hadron Collider at CERN. We demonstrate that the semisupervised tests have power competitive with the classical supervised methods for a well-specified signal but much higher power for an unexpected signal which might be entirely missed by the supervised tests.
| Type: | Article |
|---|---|
| Title: | Model-independent detection of new physics signals using interpretable SemiSupervised classifier tests |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1214/22-AOAS1722 |
| Publisher version: | http://dx.doi.org/10.1214/22-aoas1722 |
| Language: | English |
| Additional information: | This version is the version of record. For information on re-use, please refer to the publisher's terms and conditions. |
| Keywords: | active subspace , Collective anomaly detection , high-dimensional two-sample testing , Large Hadron Collider , likelihood ratio test , mixture proportion estimation , signal strength estimation |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10197139 |
Archive Staff Only
 |
View Item |
