Krishna, A;
Riedel, S;
Vlachos, A;
(2022)
ProoFVer: Natural Logic Theorem Proving for Fact Verification.
Transactions of the Association for Computational Linguistics
, 10
pp. 1013-1030.
10.1162/tacl_a_00503.
Preview |
Text
tacl_a_00503.pdf - Published Version Download (1MB) | Preview |
Abstract
Fact verification systems typically rely on neural network classifiers for veracity prediction, which lack explainability. This paper proposes ProoFVer, which uses a seq2seq model to generate natural logic-based inferences as proofs. These proofs consist of lexical mutations between spans in the claim and the evidence retrieved, each marked with a natural logic operator. Claim veracity is determined solely based on the sequence of these operators. Hence, these proofs are faithful explanations, and this makes ProoFVer faithful by construction. Currently, ProoFVer has the highest label accuracy and the second best score in the FEVER leaderboard. Furthermore, it improves by 13.21% points over the next best model on a dataset with counterfactual instances, demonstrating its robustness. As explanations, the proofs show better overlap with human rationales than attention-based highlights and the proofs help humans predict model decisions correctly more often than using the evidence directly.
Type: | Article |
---|---|
Title: | ProoFVer: Natural Logic Theorem Proving for Fact Verification |
Open access status: | An open access version is available from UCL Discovery |
DOI: | 10.1162/tacl_a_00503 |
Publisher version: | https://doi.org/10.1162/tacl_a_00503 |
Language: | English |
Additional information: | © 2022 Association for Computational Linguistics. Distributed under a CC-BY 4.0 license (https://creativecommons.org/licenses/by/4.0/). |
UCL classification: | UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science UCL > Provost and Vice Provost Offices > UCL BEAMS UCL |
URI: | https://discovery.ucl.ac.uk/id/eprint/10157419 |
Archive Staff Only
![]() |
View Item |