UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Inequity aversion improves cooperation in intertemporal social dilemmas

Hughes, E; Leibo, JZ; Phillips, M; Tuyls, K; Duenez-Guzman, E; Castaneda, AG; Dunning, I; ... Graepel, T; + view all (2018) Inequity aversion improves cooperation in intertemporal social dilemmas. In: Bengio, S and Wallach, H and Larochelle, H and Grauman, K and CesaBianchi, N and Garnett, R, (eds.) Advances in Neural Information Processing Systems 31 (NIPS 2018). (pp. pp. 1-11). Neural Information Processing Systems Foundation, Inc. Green open access

[img]
Preview
Text
Graepel_Inequity aversion improves cooperation in intertemporal social dilemmas_AAM.pdf - Accepted version

Download (2MB) | Preview

Abstract

Groups of humans are often able to find ways to cooperate with one another in complex, temporally extended social dilemmas. Models based on behavioral economics are only able to explain this phenomenon for unrealistic stateless matrix games. Recently, multi-agent reinforcement learning has been applied to generalize social dilemma problems to temporally and spatially extended Markov games. However, this has not yet generated an agent that learns to cooperate in social dilemmas as humans do. A key insight is that many, but not all, human individuals have inequity averse social preferences. This promotes a particular resolution of the matrix game social dilemma wherein inequity-averse individuals are personally pro-social and punish defectors. Here we extend this idea to Markov games and show that it promotes cooperation in several types of sequential social dilemma, via a profitable interaction with policy learnability. In particular, we find that inequity aversion improves temporal credit assignment for the important class of intertemporal social dilemmas. These results help explain how large-scale cooperation may emerge and persist.

Type: Proceedings paper
Title: Inequity aversion improves cooperation in intertemporal social dilemmas
Event: The 32nd Conference on Neural Information Processing Systems (NIPS)
Location: Montreal, Canada
Dates: 2nd-8th December 2018
Open access status: An open access version is available from UCL Discovery
Publisher version: https://papers.nips.cc/paper/7593-inequity-aversio...
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10076315
Downloads since deposit
13Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item