Pandey, C;
Ibrahim, Z;
Wu, H;
Iqbal, E;
Dobson, R;
(2017)
Improving RNN with atention and embedding for adverse drug reactions.
In:
Proceedings of the 2017 International Conference on Digital Health: DH 17.
(pp. pp. 67-71).
ACM: London, United Kingdom.
Preview |
Text
Richard_DH17-KCL-camera-ready.pdf - Accepted Version Download (752kB) | Preview |
Abstract
Electronic Health Records (EHR) narratives are a rich source of information, embedding high-resolution information of value to secondary research use. However, because the EHRs are mostly in natural language free-text and highly ambiguity-ridden, many natural language processing algorithms have been devised around them to extract meaningful structured information about clinical entities. The performance of the algorithms however, largely varies depending on the training dataset as well as the effectiveness of the use of background knowledge to steer the learning process. In this paper we study the impact of initializing the training of a neural network natural language processing algorithm with pre-defined clinical word embeddings to improve feature extraction and relationship classification between entities. We add our embedding framework to a bi-directional long short-term memory (Bi-LSTM) neural network, and further study the effect of using attention weights in neural networks for sequence labelling tasks to extract knowledge of Adverse Drug Reactions (ADRs). We incorporate unsupervised word embeddings using Word2Vec and GloVe from widely available medical resources such as Multiparameter Intelligent Monitoring in Intensive Care (MIMIC) II corpora, Unified Medical Language System (UMLS) as well as embed pharmaco lexicon from available EHRs. Our algorithm, implemented using two datasets, shows that our architecture outperforms baseline Bi-LSTM or Bi-LSTM networks using linear chain and Skip-Chain conditional random fields (CRF).
| Type: | Proceedings paper |
|---|---|
| Title: | Improving RNN with atention and embedding for adverse drug reactions |
| Event: | 2017 International Conference on Digital Health |
| ISBN-13: | 9781450352499 |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1145/3079452.3079501 |
| Publisher version: | https://doi.org/10.1145/3079452.3079501 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Institute of Health Informatics UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Population Health Sciences > Institute of Health Informatics > Clinical Epidemiology |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10064392 |
Archive Staff Only
 |
View Item |
