Shi, Z;
Zhang, Q;
Lipani, A;
(2022)
StepGame: A New Benchmark for Robust Multi-Hop Spatial Reasoning in Texts.
In:
Proceedings of 36th AAAI conference on Artificial intelligence.
(pp. pp. 11321-11329).
AAAI (Association for the Advancement of Artificial Intelligence): Palo Alto, CA, USA.
Preview |
Text
8490.StepGameS.pdf - Accepted Version Download (686kB) | Preview |
Abstract
Inferring spatial relations in natural language is a crucial abil- ity an intelligent system should possess. The bAbI dataset tries to capture tasks relevant to this domain (task 17 and 19). However, these tasks have several limitations. Most impor- tantly, they are limited to fixed expressions, they are limited in the number of reasoning steps required to solve them, and they fail to test the robustness of models to input that contains irrelevant or redundant information. In this paper, we present a new Question-Answering dataset called StepGame for ro- bust multi-hop spatial reasoning in texts. Our experiments demonstrate that state-of-the-art models on the bAbI dataset struggle on the StepGame dataset. Moreover, we propose a Tensor-Product based Memory-Augmented Neural Network (TP-MANN) specialized for spatial reasoning tasks. Experi- mental results on both datasets show that our model outper- forms all the baselines with superior generalization and ro- bustness performance.
| Type: | Proceedings paper |
|---|---|
| Title: | StepGame: A New Benchmark for Robust Multi-Hop Spatial Reasoning in Texts |
| Event: | 36th AAAI Conference on Artificial Intelligence |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1609/aaai.v36i10.21383 |
| Publisher version: | https://doi.org/10.1609/aaai.v36i10.21383 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher's terms and conditions. |
| Keywords: | Speech & Natural Language Processing (SNLP), Knowledge Representation And Reasoning (KRR), Machine Learning (ML), Humans And AI (HAI) |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Civil, Environ and Geomatic Eng |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10140700 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
