UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Equivariance For Deep Learning And Retinal Imaging

Worrall, Daniel Ernest; (2019) Equivariance For Deep Learning And Retinal Imaging. Doctoral thesis (Ph.D), UCL (University College London). Green open access

[thumbnail of Worrell_thesis_no statement.pdf]
Preview
Text
Worrell_thesis_no statement.pdf

Download (20MB) | Preview

Abstract

Analysing and generalizing from small datasets is still a difficult challenge. However, the de facto model in computer vision, the convolutional neural network (CNN), is known to be data hungry and poorly interpretable. We investigate a new design principle called equivariance, which we demonstrate can both improve data efficiency and interpretability in CNNs. Intermediate layers of an equivariant CNN preserve information about local and global transformations of the input image. Moreover, we build specific equivariances into a CNN, such that they need not be learned from data. As a result, less data is needed, improving the network generalization. In this thesis, we explore three techniques to demonstrate the usefulness of equivariance. We start by considering equivariance to 3D right-angle rotations in the context of voxelized data. We show that this improves classification performance on the ModelNet10 dataset, among non-ensembled models. We then introduce Harmonic Networks, which are equivariant to continuous rotations in 2D. These exploit the fact that the Fourier transform naturally disentangles transformation and magnitude information. To the best of our knowledge, this is the first CNN architecture exhibiting equivariance to a continuous transformation. Lastly we consider learning equivariance from data, to model equivariances, which may not be tractably designed into a network. To validate our work, we harness a real-world case study by applying some of our developments to the difficult challenge of Retinopathy of Prematurity (ROP) detection. ROP is a sight-threatening disease, affecting 60% of premature babies below 32 weeks post-menstrual age and 1500g in weight. ROP is difficult to detect, its symptomatology is not fully understood, and doctors all over the world are increasingly burdened with screening, as the number of at-risk neonates sharply increases. To the best of our knowledge, we are the first to develop a deep learning solution to ROP detection.

Type: Thesis (Doctoral)
Qualification: Ph.D
Title: Equivariance For Deep Learning And Retinal Imaging
Event: UCL (University College London)
Open access status: An open access version is available from UCL Discovery
Language: English
Additional information: Copyright © The Author 2019. Original content in this thesis is licensed under the terms of the Creative Commons Attribution 4.0 International (CC BY 4.0) Licence (https://creativecommons.org/licenses/by/4.0/). Any third-party copyright material present remains the property of its respective owner(s) and is licensed under its existing terms.
UCL classification: UCL
UCL > Provost and Vice Provost Offices
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10078529
Downloads since deposit
365Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item