UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Multivariate Bayesian Global–Local Shrinkage Methods for Regularisation in the High-Dimensional Linear Model

Mameli, Valentina; Slanzi, Debora; Griffin, Jim E; Brown, Philip J; (2025) Multivariate Bayesian Global–Local Shrinkage Methods for Regularisation in the High-Dimensional Linear Model. Mathematics , 13 (11) , Article 1812. 10.3390/math13111812. Green open access

[thumbnail of mathematics-13-01812.pdf]
Preview
PDF
mathematics-13-01812.pdf - Published Version

Download (363kB) | Preview

Abstract

This paper considers Bayesian regularisation using global–local shrinkage priors in the multivariate general linear model when there are many more explanatory variables than observations. We adopt priors’ structures used extensively in univariate problems (conjugate and non-conjugate with tail behaviour ranging from polynomial to exponential) and consider how the addition of error correlation in the multivariate set-up affects the performance of these priors. Two different datasets (from drug discovery and chemometrics) with many covariates are used for comparison, and these are supplemented by a small simulation study to corroborate the role of error correlation. We find that structural assumptions of the prior distribution on regression coefficients can be more significant than the tail behaviour. In particular, if the structural assumption of conjugacy is used, the performance of the posterior predictive distribution deteriorates relative to non-conjugate choices as the error correlation becomes stronger.

Type: Article
Title: Multivariate Bayesian Global–Local Shrinkage Methods for Regularisation in the High-Dimensional Linear Model
Open access status: An open access version is available from UCL Discovery
DOI: 10.3390/math13111812
Publisher version: https://doi.org/10.3390/math13111812
Language: English
Additional information: This work is licensed under a Creative Commons License. The images or other third-party material in this article are included in the Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/
Keywords: Seemingly unrelated multivariate normal regression; structured priors; global– local priors; exponential-tailed and polynomial-tailed priors; drug discovery; chemometrics; MSC: 62F15; 62H12; 62J07
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science
URI: https://discovery.ucl.ac.uk/id/eprint/10209426
Downloads since deposit
9Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item