UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Neural DNF-MT: A Neuro-symbolic Approach for Learning Interpretable and Editable Policies

Anonymous Author(s); (2025) Neural DNF-MT: A Neuro-symbolic Approach for Learning Interpretable and Editable Policies. In: El Fallah Seghrouchni, A and Vorobeychik, Y and Das, S and Nowe, A, (eds.) Proceedings of the 24th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2025). (pp. pp. 1-10). IFAAMAS (International Foundation for Autonomous Agents and Multiagent Systems): Detroit, Michigan, USA. Green open access

[thumbnail of 944_Neural_DNF_MT_A_Neuro_symb.pdf]
Preview
Text
944_Neural_DNF_MT_A_Neuro_symb.pdf - Accepted Version

Download (2MB) | Preview

Abstract

Although deep reinforcement learning has been shown to be effective, the model’s black-box nature presents barriers to direct policy interpretation. To address this problem, we propose a neurosymbolic approach called neural DNF-MT for end-to-end policy learning. The di!erentiable nature of the neural DNF-MT model enables the use of deep actor-critic algorithms for training. At the same time, its architecture is designed so that trained models can be directly translated into interpretable policies expressed as standard (bivalent or probabilistic) logic programs. Moreover, additional layers can be included to extract abstract features from complex observations, acting as a form of predicate invention. The logic representations are highly interpretable, and we show how the bivalent representations of deterministic policies can be edited and incorporated back into a neural model, facilitating manual intervention and adaptation of learned policies. We evaluate our approach on a range of tasks requiring learning deterministic or stochastic behaviours from various forms of observations. Our empirical results show that our neural DNF-MT model performs at the level of competing black-box methods whilst providing interpretable policies.

Type: Proceedings paper
Title: Neural DNF-MT: A Neuro-symbolic Approach for Learning Interpretable and Editable Policies
Event: 24th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2025)
Dates: 19 May 2025 - 23 May 2025
Open access status: An open access version is available from UCL Discovery
Publisher version: https://www.ifaamas.org/proceedings.html
Language: English
Additional information: This work is licenced under the Creative Commons Attribution 4.0 International (CC-BY 4.0) licence, https://creativecommons.org/licenses/by/4.0/deed.en.
Keywords: Neuro-symbolic Learning; Neuro-symobilc Reinforcement Learning
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL SLASH
UCL > Provost and Vice Provost Offices > UCL SLASH > Faculty of Arts and Humanities
UCL > Provost and Vice Provost Offices > UCL SLASH > Faculty of Arts and Humanities > Dept of Information Studies
URI: https://discovery.ucl.ac.uk/id/eprint/10203910
Downloads since deposit
74Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item