Watson, David;
(2022)
Rational Shapley Values.
In:
FAccT '22: 2022 ACM Conference on Fairness, Accountability, and Transparency.
(pp. pp. 1083-1094).
ACM
Preview |
Text
2106.10191v2.pdf - Other Download (1MB) | Preview |
Abstract
Explaining the predictions of opaque machine learning algorithms is an important and challenging task, especially as complex models are increasingly used to assist in high-stakes decisions such as those arising in healthcare and finance. Most popular tools for post-hoc explainable artificial intelligence (XAI) are either insensitive to context (e.g., feature attributions) or difficult to summarize (e.g., counterfactuals). In this paper, I introduce $\textit{rational Shapley values}$, a novel XAI method that synthesizes and extends these seemingly incompatible approaches in a rigorous, flexible manner. I leverage tools from decision theory and causal modeling to formalize and implement a pragmatic approach that resolves a number of known challenges in XAI. By pairing the distribution of random variables with the appropriate reference class for a given explanation task, I illustrate through theory and experiments how user goals and knowledge can inform and constrain the solution set in an iterative fashion. The method compares favorably to state of the art XAI tools in a range of quantitative and qualitative comparisons.
Type: | Proceedings paper |
---|---|
Title: | Rational Shapley Values |
Event: | FAccT '22: 2022 ACM Conference on Fairness, Accountability, and Transparency |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1145/3531146.3533170 |
Publisher version: | http://dx.doi.org/10.1145/3531146.3533170 |
Language: | English |
Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
Keywords: | cs.LG, cs.LG, cs.AI |
UCL classification: | UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Maths and Physical Sciences > Dept of Statistical Science UCL > Provost and Vice Provost Offices > UCL BEAMS UCL |
URI: | https://discovery.ucl.ac.uk/id/eprint/10150923 |
Archive Staff Only
View Item |