Kocijan, Vid;
Camburu, Oana-Maria;
Lukasiewicz, Thomas;
(2021)
The Gap on GAP: Tackling the Problem of Differing Data Distributions in Bias-Measuring Datasets.
In:
Proceedings of the AAAI Conference on Artificial Intelligence, 35.
(pp. pp. 13180-13188).
AAAI
Preview |
PDF
Camburu_2011.01837.pdf - Accepted Version Download (428kB) | Preview |
Abstract
Diagnostic datasets that can detect biased models are an important prerequisite for bias reduction within natural language processing. However, undesired patterns in the collected data can make such tests incorrect. For example, if the feminine subset of a gender-bias-measuring coreference resolution dataset contains sentences with a longer average distance between the pronoun and the correct candidate, an RNN-based model may perform worse on this subset due to long-term dependencies. In this work, we introduce a theoretically grounded method for weighting test samples to cope with such patterns in the test data. We demonstrate the method on the GAP dataset for coreference resolution. We annotate GAP with spans of all personal names and show that examples in the female subset contain more personal names and a longer distance between pronouns and their referents, potentially affecting the bias score in an undesired way. Using our weighting method, we find the set of weights on the test instances that should be used for coping with these correlations, and we re-evaluate 16 recently released coreference models.
| Type: | Proceedings paper |
|---|---|
| Title: | The Gap on GAP: Tackling the Problem of Differing Data Distributions in Bias-Measuring Datasets |
| Event: | 35th AAAI Conference on Artificial Intelligence |
| Dates: | 2 Feb 2021 - 9 Feb 2021 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1609/aaai.v35i14.17557 |
| Publisher version: | http://dx.doi.org/10.1609/aaai.v35i14.17557 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10184408 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
