UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Deep Proxy Causal Learning and its Application to Confounded Bandit Policy Evaluation

Jo, Ritsugen; Kanagawa, Heishiro; Gretton, Arthur; (2021) Deep Proxy Causal Learning and its Application to Confounded Bandit Policy Evaluation. In: Proceedings of the 35th Conference on Neural Information Processing Systems (NeurIPS 2021). NeurIPS Green open access

[thumbnail of deep_proxy_causal_learning_and.pdf]
Preview
PDF
deep_proxy_causal_learning_and.pdf - Published Version

Download (392kB) | Preview

Abstract

Proxy causal learning (PCL) is a method for estimating the causal effect of treatments on outcomes in the presence of unobserved confounding, using proxies (structured side information) for the confounder. This is achieved via two-stage regression: in the first stage, we model relations among the treatment and proxies; in the second stage, we use this model to learn the effect of treatment on the outcome, given the context provided by the proxies. PCL guarantees recovery of the true causal effect, subject to identifiability conditions. We propose a novel method for PCL, the deep feature proxy variable method (DFPV), to address the case where the proxies, treatments, and outcomes are high-dimensional and have nonlinear complex relationships, as represented by deep neural network features. We show that DFPV outperforms recent state-of-the-art PCL methods on challenging synthetic benchmarks, including settings involving high dimensional image data. Furthermore, we show that PCL can be applied to off-policy evaluation for the confounded bandit problem, in which DFPV also exhibits competitive performance.

Type: Proceedings paper
Title: Deep Proxy Causal Learning and its Application to Confounded Bandit Policy Evaluation
Event: Advances in Neural Information Processing Systems
Open access status: An open access version is available from UCL Discovery
Publisher version: https://proceedings.neurips.cc/paper/2021/hash/dcf...
Language: English
Additional information: This version is the version of record. For information on re-use, please refer to the publisher’s terms and conditions.
UCL classification: UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL
URI: https://discovery.ucl.ac.uk/id/eprint/10151139
Downloads since deposit
9Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item