UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Neural architectures for fine-grained entity type classification

Shimaoka, S; Stenetorp, P; Inui, K; Riedel, S; (2017) Neural architectures for fine-grained entity type classification. In: Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers. (pp. pp. 1271-1280). Association for Computational Linguistics: Valencia, Spain. Green open access

[thumbnail of Riedel_1606.01341.pdf]
Preview
Text
Riedel_1606.01341.pdf - Accepted Version

Download (566kB) | Preview

Abstract

In this work, we investigate several neural network architectures for fine-grained entity type classification and make three key contributions. Despite being a natural comparison and addition, previous work on attentive neural architectures have not considered hand-crafted features and we combine these with learnt features and establish that they complement each other. Additionally, through quantitative analysis we establish that the attention mechanism learns to attend over syntactic heads and the phrase containing the mention, both of which are known to be strong hand-crafted features for our task. We introduce parameter sharing between labels through a hierarchical encoding method, that in lowdimensional projections show clear clusters for each type hierarchy. Lastly, despite using the same evaluation dataset, the literature frequently compare models trained using different data. We demonstrate that the choice of training data has a drastic impact on performance, which decreases by as much as 9.85% loose micro F1 score for a previously proposed method. Despite this discrepancy, our best model achieves state-of-the-art results with 75.36% loose micro F1 score on the well-established FIGER (GOLD) dataset and we report the best results for models trained using publicly available data for the OntoNotes dataset with 64.93% loose micro F1 score.

Type: Proceedings paper
Title: Neural architectures for fine-grained entity type classification
Event: 15th Conference of the European Chapter of the Association for Computational Linguistics
Open access status: An open access version is available from UCL Discovery
Publisher version: http://www.aclweb.org/anthology/E17-1119
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/1503051
Downloads since deposit
91Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item