Blumberg, SB; Palombo, M; Khoo, CS; Tax, CMW; Tanno, R; Alexander, DC; (2019) Multi-stage prediction networks for data harmonization. In: Shen, D and Liu, T and Peters, TM and Staib, LH and Essert, C and Zhou, S and Yap, P-T and Khan, A, (eds.) Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. (pp. pp. 411-419). Springer: Shenzhen, China.

Preview

Text MSP_MICCAI.pdf - Accepted Version Download (2MB) | Preview

Abstract

In this paper, we introduce multi-task learning (MTL) to data harmonization (DH); where we aim to harmonize images across different acquisition platforms and sites. This allows us to integrate information from multiple acquisitions and improve the predictive performance and learning efficiency of the harmonization model. Specifically, we introduce the Multi Stage Prediction (MSP) Network, a MTL framework that incorporates neural networks of potentially disparate architectures, trained for different individual acquisition platforms, into a larger architecture that is refined in unison. The MSP utilizes high-level features of single networks for individual tasks, as inputs of additional neural networks to inform the final prediction, therefore exploiting redundancy across tasks to make the most of limited training data. We validate our methods on a dMRI harmonization challenge dataset, where we predict three modern platform types, from one obtained from an old scanner. We show how MTL architectures, such as the MSP, produce around 20% improvement of patch-based mean-squared error over current state-of-the-art methods and that our MSP outperforms off-the-shelf MTL networks. Our code is available

Download activity - last month

Export as JSONCSVXML

Download activity - last 12 months

Export as JSONCSVXML

Downloads by country - last 12 months

Export as JSONCSVXML

Archive Staff Only

View Item