UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Robust priors for regularized regression

Bobadilla-Suarez, S; Jones, M; Love, BC; (2021) Robust priors for regularized regression. Cognitive Psychology , 132 , Article 101444. 10.1016/j.cogpsych.2021.101444. Green open access

[thumbnail of 1-s2.0-S0010028521000670-main.pdf]
Preview
Text
1-s2.0-S0010028521000670-main.pdf - Published Version

Download (1MB) | Preview

Abstract

Induction benefits from useful priors. Penalized regression approaches, like ridge regression, shrink weights toward zero but zero association is usually not a sensible prior. Inspired by simple and robust decision heuristics humans use, we constructed non-zero priors for penalized regression models that provide robust and interpretable solutions across several tasks. Our approach enables estimates from a constrained model to serve as a prior for a more general model, yielding a principled way to interpolate between models of differing complexity. We successfully applied this approach to a number of decision and classification problems, as well as analyzing simulated brain imaging data. Models with robust priors had excellent worst-case performance. Solutions followed from the form of the heuristic that was used to derive the prior. These new algorithms can serve applications in data analysis and machine learning, as well as help in understanding how people transition from novice to expert performance.

Type: Article
Title: Robust priors for regularized regression
Location: Netherlands
Open access status: An open access version is available from UCL Discovery
DOI: 10.1016/j.cogpsych.2021.101444
Publisher version: https://doi.org/10.1016/j.cogpsych.2021.101444
Language: English
Additional information: © 2021 Published by Elsevier Ltd. This is an open access article under the CC BY 4.0 license Attribution 4.0 International (https://creativecommons.org/licenses/by/4.0/)
Keywords: Decision making, Heuristics, Inductive bias, Inference, Robust priors, fMRI
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Experimental Psychology
URI: https://discovery.ucl.ac.uk/id/eprint/10140084
Downloads since deposit
41Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item