Pinto, C; Pita, R; Barbosa, G; Araujo, B; Bertoldo, J; Sena, S; Reis, S; ... Denaxas, S; + view all Pinto, C; Pita, R; Barbosa, G; Araujo, B; Bertoldo, J; Sena, S; Reis, S; Fiaccone, R; Amorim, L; Ichihara, MY; Barreto, M; Barreto, M; Denaxas, S; - view fewer (2017) Probabilistic integration of large Brazilian socioeconomic and clinical databases. In: Bamidis, PD and Konstantinidis, ST and Rodrigues, PP, (eds.) Proceedings of the 30th IEEE International Symposium on Computer-Based Medical Systems (CBMS). (pp. pp. 515-520). IEEE: New York, USA.

Preview

Text CBMS2017_paper_204.pdf - Accepted Version Download (819kB) | Preview

Abstract

The integration of disparate large and heterogeneous socioeconomic and clinical databases is considered essential to capture and model longitudinal and social aspects of diseases. However, such integration is challenging: databases are stored in disparate locations, make use of different identifiers, have variable data quality, record information in bespoke purpose-specific formats and have different levels of metadata. Novel computational methods are required to integrate them and enable their statistical analyses for epidemiological research purposes. In this paper, we describe a probabilistic approach for constructing a very large population-based cohort comprised of 114 million individuals using linkages between clinical databases from the National Health System and administrative databases from governmental social programmes. We present our data integration model for creating data marts (epidemiological data) and discuss our evaluation results in controlled and uncontrolled scenarios, which demonstrate that our model and tools achieve high accuracy (minimum of 91%) in different probabilistic data integration scenarios.

Download activity - last month

Export as CSVXMLJSON

Download activity - last 12 months

Export as XMLCSVJSON

Downloads by country - last 12 months

Export as CSVXMLJSON

Archive Staff Only

View Item