UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

The CloudUPDRS smartphone software in Parkinson's study: cross-validation against blinded human raters

Jha, A; Menozzi, E; Oyekan, R; Latorre, A; Mulroy, E; Schreglmann, SR; Stamate, C; ... Bhatia, KP; + view all (2020) The CloudUPDRS smartphone software in Parkinson's study: cross-validation against blinded human raters. npj Parkinson's Disease , 6 (1) , Article 36. 10.1038/s41531-020-00135-w. Green open access

[thumbnail of s41531-020-00135-w.pdf]
Preview
Text
s41531-020-00135-w.pdf - Published Version

Download (1MB) | Preview

Abstract

Digital assessments of motor severity could improve the sensitivity of clinical trials and personalise treatment in Parkinson's disease (PD) but have yet to be widely adopted. Their ability to capture individual change across the heterogeneous motor presentations typical of PD remains inadequately tested against current clinical reference standards. We conducted a prospective, dual-site, crossover-randomised study to determine the ability of a 16-item smartphone-based assessment (the index test) to predict subitems from the Movement Disorder Society-Unified Parkinson's Disease Rating Scale part III (MDS-UPDRS III) as assessed by three blinded clinical raters (the reference-standard). We analysed data from 60 subjects (990 smartphone tests, 2628 blinded video MDS-UPDRS III subitem ratings). Subject-level predictive performance was quantified as the leave-one-subject-out cross-validation (LOSO-CV) accuracy. A pre-specified analysis classified 70.3% (SEM 5.9%) of subjects into a similar category to any of three blinded clinical raters and was better than random (36.7%; SEM 4.3%) classification. Post hoc optimisation of classifier and feature selection improved performance further (78.7%, SEM 5.1%), although individual subtests were variable (range 53.2-97.0%). Smartphone-based measures of motor severity have predictive value at the subject level. Future studies should similarly mitigate against subjective and feature selection biases and assess performance across a range of motor features as part of a broader strategy to avoid overly optimistic performance estimates.

Type: Article
Title: The CloudUPDRS smartphone software in Parkinson's study: cross-validation against blinded human raters
Location: United States
Open access status: An open access version is available from UCL Discovery
DOI: 10.1038/s41531-020-00135-w
Publisher version: http://dx.doi.org/10.1038/s41531-020-00135-w
Language: English
Additional information: Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
Keywords: Parkinson's disease, Predictive markers
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology > Brain Repair and Rehabilitation
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology > Clinical and Movement Neurosciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > UCL Queen Square Institute of Neurology > Clinical Neuroscience
URI: https://discovery.ucl.ac.uk/id/eprint/10117716
Downloads since deposit
70Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item