UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Inter-rater agreement in glioma segmentations on longitudinal MRI

Visser, M; Müller, DMJ; van Duijn, RJM; Smits, M; Verburg, N; Hendriks, EJ; Nabuurs, RJA; ... de Munck, JC; + view all (2019) Inter-rater agreement in glioma segmentations on longitudinal MRI. NeuroImage: Clinical , 22 , Article 101727. 10.1016/j.nicl.2019.101727. Green open access

[thumbnail of Inter-rater agreement in glioma segmentations on longitudinal MRI.pdf]
Preview
Text
Inter-rater agreement in glioma segmentations on longitudinal MRI.pdf - Published Version

Download (1MB) | Preview

Abstract

Background Tumor segmentation of glioma on MRI is a technique to monitor, quantify and report disease progression. Manual MRI segmentation is the gold standard but very labor intensive. At present the quality of this gold standard is not known for different stages of the disease, and prior work has mainly focused on treatment-naive glioblastoma. In this paper we studied the inter-rater agreement of manual MRI segmentation of glioblastoma and WHO grade II-III glioma for novices and experts at three stages of disease. We also studied the impact of inter-observer variation on extent of resection and growth rate. Methods In 20 patients with WHO grade IV glioblastoma and 20 patients with WHO grade II-III glioma (defined as non-glioblastoma) both the enhancing and non-enhancing tumor elements were segmented on MRI, using specialized software, by four novices and four experts before surgery, after surgery and at time of tumor progression. We used the generalized conformity index (GCI) and the intra-class correlation coefficient (ICC) of tumor volume as main outcome measures for inter-rater agreement. Results For glioblastoma, segmentations by experts and novices were comparable. The inter-rater agreement of enhancing tumor elements was excellent before surgery (GCI 0.79, ICC 0.99) poor after surgery (GCI 0.32, ICC 0.92), and good at progression (GCI 0.65, ICC 0.91). For non-glioblastoma, the inter-rater agreement was generally higher between experts than between novices. The inter-rater agreement was excellent between experts before surgery (GCI 0.77, ICC 0.92), was reasonable after surgery (GCI 0.48, ICC 0.84), and good at progression (GCI 0.60, ICC 0.80). The inter-rater agreement was good between novices before surgery (GCI 0.66, ICC 0.73), was poor after surgery (GCI 0.33, ICC 0.55), and poor at progression (GCI 0.36, ICC 0.73). Further analysis showed that the lower inter-rater agreement of segmentation on postoperative MRI could only partly be explained by the smaller volumes and fragmentation of residual tumor. The median interquartile range of extent of resection between raters was 8.3% and of growth rate was 0.22 mm/year. Conclusion Manual tumor segmentations on MRI have reasonable agreement for use in spatial and volumetric analysis. Agreement in spatial overlap is of concern with segmentation after surgery for glioblastoma and with segmentation of non-glioblastoma by non-experts.

Type: Article
Title: Inter-rater agreement in glioma segmentations on longitudinal MRI
Location: Netherlands
Open access status: An open access version is available from UCL Discovery
DOI: 10.1016/j.nicl.2019.101727
Publisher version: https://doi.org/10.1016/j.nicl.2019.101727
Language: English
Additional information: Published by Elsevier Inc. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/BY-NC-ND/4.0/).
Keywords: Inter-rater agreement, Manual segmentation, Glioma, Glioblastoma, Low-grade glioma, MRI
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology > Brain Repair and Rehabilitation
URI: https://discovery.ucl.ac.uk/id/eprint/10070880
Downloads since deposit
101Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item