<> <http://www.w3.org/2000/01/rdf-schema#comment> "The repository administrator has not yet configured an RDF license."^^<http://www.w3.org/2001/XMLSchema#string> . <> <http://xmlns.com/foaf/0.1/primaryTopic> <https://discovery.ucl.ac.uk/id/eprint/10161343> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://purl.org/ontology/bibo/Thesis> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://purl.org/ontology/bibo/Article> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://purl.org/dc/terms/title> "Cooperation and Social Dilemmas with Reinforcement Learning"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://purl.org/ontology/bibo/abstract> "Cooperation between humans has been foundational for the development of civilisation and yet there are many questions about how it emerges from social interactions. \r\nAs artificial agents begin to play a more significant role in our lives and are introduced into our societies, it is apparent that understanding the mechanisms of cooperation is important also for the design of next-generation multi-agent AI systems. Indeed, this is particularly important in the case of supporting cooperation between self-interested AI agents.\r\n \r\nIn this thesis, we focus on the analysis of the application of mechanisms that are at the basis of human cooperation to the training of reinforcement learning agents. Human behaviour is a product of cultural norms, emotions and intuition amongst other things: we argue it is possible to use similar mechanisms to deal with the complexities of multi-agent cooperation. We outline the problem of cooperation in mixed-motive games, also known as social dilemmas, and we focus on the mechanisms of reputation dynamics and partner selection, two mechanisms that have been strongly linked to indirect reciprocity in Evolutionary Game Theory. A key point that we want to emphasise is the fact we assume no prior knowledge and explicit definition of strategies, which instead are fully learnt by the agents during the games.\r\n \r\nIn our experimental evaluation, we demonstrate the benefits of applying these mechanisms to the training process of the agents, and we compare our findings with results presented in a variety of other disciplines, including Economics and Evolutionary Biology."^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://purl.org/dc/terms/date> "2022-12-28" . <https://discovery.ucl.ac.uk/id/document/1518446> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://purl.org/ontology/bibo/Document> . <https://discovery.ucl.ac.uk/id/org/ext-a64c3df5861c6582807add1abaadf2af> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://xmlns.com/foaf/0.1/Organization> . <https://discovery.ucl.ac.uk/id/org/ext-a64c3df5861c6582807add1abaadf2af> <http://xmlns.com/foaf/0.1/name> "UCL (University College London)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://purl.org/dc/terms/issuer> <https://discovery.ucl.ac.uk/id/org/ext-a64c3df5861c6582807add1abaadf2af> . <https://discovery.ucl.ac.uk/id/org/ext-8f7ed5b3450912d77936e05323506a1f> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://xmlns.com/foaf/0.1/Organization> . <https://discovery.ucl.ac.uk/id/org/ext-8f7ed5b3450912d77936e05323506a1f> <http://xmlns.com/foaf/0.1/name> "Computer Science, UCL (University College London)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/org/ext-8f7ed5b3450912d77936e05323506a1f> <http://purl.org/dc/terms/isPartOf> <https://discovery.ucl.ac.uk/id/org/ext-a64c3df5861c6582807add1abaadf2af> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://purl.org/dc/terms/issuer> <https://discovery.ucl.ac.uk/id/org/ext-8f7ed5b3450912d77936e05323506a1f> . <https://discovery.ucl.ac.uk/id/org/ext-a64c3df5861c6582807add1abaadf2af> <http://purl.org/dc/terms/hasPart> <https://discovery.ucl.ac.uk/id/org/ext-8f7ed5b3450912d77936e05323506a1f> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://purl.org/ontology/bibo/status> <http://purl.org/ontology/bibo/status/unpublished> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://purl.org/dc/terms/creator> <https://discovery.ucl.ac.uk/id/person/ext-aa1b0897bfa11207b2edf9122d874bce> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://purl.org/ontology/bibo/authorList> <https://discovery.ucl.ac.uk/id/eprint/10161343#authors> . <https://discovery.ucl.ac.uk/id/eprint/10161343#authors> <http://www.w3.org/1999/02/22-rdf-syntax-ns#_1> <https://discovery.ucl.ac.uk/id/person/ext-aa1b0897bfa11207b2edf9122d874bce> . <https://discovery.ucl.ac.uk/id/person/ext-aa1b0897bfa11207b2edf9122d874bce> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://xmlns.com/foaf/0.1/Person> . <https://discovery.ucl.ac.uk/id/person/ext-aa1b0897bfa11207b2edf9122d874bce> <http://xmlns.com/foaf/0.1/givenName> "Nicolas"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/person/ext-aa1b0897bfa11207b2edf9122d874bce> <http://xmlns.com/foaf/0.1/familyName> "Anastassacos"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/person/ext-aa1b0897bfa11207b2edf9122d874bce> <http://xmlns.com/foaf/0.1/name> "Nicolas Anastassacos"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/EPrint> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/ThesisEPrint> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://purl.org/dc/terms/isPartOf> <https://discovery.ucl.ac.uk/id/repository> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/document/1518446> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/1518446> <http://www.w3.org/2000/01/rdf-schema#label> "Cooperation and Social Dilemmas with Reinforcement Learning (Text)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://purl.org/dc/elements/1.1/hasVersion> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://eprints.org/ontology/hasAccepted> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/document/1518446> <http://eprints.org/ontology/hasFile> <https://discovery.ucl.ac.uk/id/eprint/10161343/2/Cooperation_and_Social_Dilemmas_with_Reinforcement_Learning-1.pdf> . <https://discovery.ucl.ac.uk/id/document/1518446> <http://purl.org/dc/terms/hasPart> <https://discovery.ucl.ac.uk/id/eprint/10161343/2/Cooperation_and_Social_Dilemmas_with_Reinforcement_Learning-1.pdf> . <https://discovery.ucl.ac.uk/id/eprint/10161343/2/Cooperation_and_Social_Dilemmas_with_Reinforcement_Learning-1.pdf> <http://www.w3.org/2000/01/rdf-schema#label> "Cooperation_and_Social_Dilemmas_with_Reinforcement_Learning-1.pdf"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/1571432> . <https://discovery.ucl.ac.uk/id/document/1571432> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/1571432> <http://www.w3.org/2000/01/rdf-schema#label> "Cooperation and Social Dilemmas with Reinforcement Learning (Other)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/document/1571432> <http://eprints.org/relation/isVersionOf> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/document/1571432> <http://eprints.org/relation/isVolatileVersionOf> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/document/1571432> <http://eprints.org/relation/islightboxThumbnailVersionOf> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/1571433> . <https://discovery.ucl.ac.uk/id/document/1571433> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/1571433> <http://www.w3.org/2000/01/rdf-schema#label> "Cooperation and Social Dilemmas with Reinforcement Learning (Other)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/document/1571433> <http://eprints.org/relation/isVersionOf> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/document/1571433> <http://eprints.org/relation/isVolatileVersionOf> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/document/1571433> <http://eprints.org/relation/ispreviewThumbnailVersionOf> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/1571434> . <https://discovery.ucl.ac.uk/id/document/1571434> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/1571434> <http://www.w3.org/2000/01/rdf-schema#label> "Cooperation and Social Dilemmas with Reinforcement Learning (Other)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/document/1571434> <http://eprints.org/relation/isVersionOf> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/document/1571434> <http://eprints.org/relation/isVolatileVersionOf> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/document/1571434> <http://eprints.org/relation/ismediumThumbnailVersionOf> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/1571435> . <https://discovery.ucl.ac.uk/id/document/1571435> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/1571435> <http://www.w3.org/2000/01/rdf-schema#label> "Cooperation and Social Dilemmas with Reinforcement Learning (Other)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/document/1571435> <http://eprints.org/relation/isVersionOf> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/document/1571435> <http://eprints.org/relation/isVolatileVersionOf> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/document/1571435> <http://eprints.org/relation/issmallThumbnailVersionOf> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://eprints.org/ontology/hasDocument> <https://discovery.ucl.ac.uk/id/document/1571436> . <https://discovery.ucl.ac.uk/id/document/1571436> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://eprints.org/ontology/Document> . <https://discovery.ucl.ac.uk/id/document/1571436> <http://www.w3.org/2000/01/rdf-schema#label> "Cooperation and Social Dilemmas with Reinforcement Learning (Other)"^^<http://www.w3.org/2001/XMLSchema#string> . <https://discovery.ucl.ac.uk/id/document/1571436> <http://eprints.org/relation/isVersionOf> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/document/1571436> <http://eprints.org/relation/isVolatileVersionOf> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/document/1571436> <http://eprints.org/relation/isIndexCodesVersionOf> <https://discovery.ucl.ac.uk/id/document/1518446> . <https://discovery.ucl.ac.uk/id/eprint/10161343> <http://www.w3.org/2000/01/rdf-schema#seeAlso> <https://discovery.ucl.ac.uk/id/eprint/10161343/> . <https://discovery.ucl.ac.uk/id/eprint/10161343/> <http://purl.org/dc/elements/1.1/title> "HTML Summary of #10161343 \n\nCooperation and Social Dilemmas with Reinforcement Learning\n\n" . <https://discovery.ucl.ac.uk/id/eprint/10161343/> <http://purl.org/dc/elements/1.1/format> "text/html" . <https://discovery.ucl.ac.uk/id/eprint/10161343/> <http://xmlns.com/foaf/0.1/primaryTopic> <https://discovery.ucl.ac.uk/id/eprint/10161343> .