UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

DIPO: Differentiable Parallel Operation Blocks for Surgical Neural Architecture Search

Lee, Matthew; Sanchez-Matilla, Ricardo; Stoyanov, Danail; Luengo, Imanol; (2024) DIPO: Differentiable Parallel Operation Blocks for Surgical Neural Architecture Search. IEEE Journal of Biomedical and Health Informatics pp. 1-13. 10.1109/JBHI.2024.3406065. (In press). Green open access

[thumbnail of Stoyanov_DIPO_at_JBHI_Final-2.pdf]
Preview
Text
Stoyanov_DIPO_at_JBHI_Final-2.pdf

Download (10MB) | Preview

Abstract

Deep learning has been used across a large number of computer vision tasks, however designing the network architectures for each task is time consuming. Neural Architecture Search (NAS) promises to automatically build neural networks, optimised for the given task and dataset. However, most NAS methods are constrained to a specific macro-architecture design which makes it hard to apply to different tasks (classification, detection, segmentation). Following the work in Differentiable NAS (DNAS), we present a simple and efficient NAS method, Differentiable Parallel Operation (DIPO), that constructs a local search space in the form of a DIPO block, and can easily be applied to any convolutional network by injecting it in-place of the convolutions. The DIPO block's internal architecture and parameters are automatically optimised end-to-end for each task. We demonstrate the flexibility of our approach by applying DIPO to 4 model architectures (U-Net, HRNET, KAPAO and YOLOX) across different surgical tasks (surgical scene segmentation, surgical instrument detection, and surgical instrument pose estimation) and evaluated across 5 datasets. Results show significant improvements in surgical scene segmentation (+10.5% in CholecSeg8K, +13.2% in CaDIS), instrument detection (+1.5% in ROBUST-MIS, +5.3% in RoboKP), and instrument pose estimation (+9.8% in RoboKP).

Type: Article
Title: DIPO: Differentiable Parallel Operation Blocks for Surgical Neural Architecture Search
Location: United States
Open access status: An open access version is available from UCL Discovery
DOI: 10.1109/JBHI.2024.3406065
Publisher version: http://dx.doi.org/10.1109/jbhi.2024.3406065
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Neural Architecture Search, Surgical Image Segmentation, Surgical Keypoint Detection, Surgical Instrument Detection
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery.ucl.ac.uk/id/eprint/10193741
Downloads since deposit
28Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item