Du, X;
Allan, M;
Bodenstedt, S;
Maier-Hein, L;
Speidel, S;
Dore, A;
Stoyanov, D;
(2019)
Patch-based adaptive weighting with segmentation and scale (PAWSS) for visual tracking in surgical video.
Medical Image Analysis
, 57
pp. 120-135.
10.1016/j.media.2019.07.002.
Preview |
Text
Stoyanov 1-s2.0-S1361841519300593-main.pdf - Published Version Download (7MB) | Preview |
Abstract
Vision-based tracking in an important component for building computer assisted interventions in minimally invasive surgery as it facilitates estimation of motion for instruments and anatomical targets. Tracking-by-detection algorithms are widely used for visual tracking, where the problem is treated as a classification task and a tracking target appearance model is updated over time using online learning. In challenging conditions, like surgical scenes, where tracking targets deform and vary in scale, the update step is prone to include background information in model appearance or to lack the ability to estimate change of scale, which degrades the performance of classifier. In this paper, we propose a Patch-based Adaptive Weighting with Segmentation and Scale (PAWSS) tracking framework that tackles both scale and background problems. A simple but effective colour-based segmentation model is used to suppress background information and multi-scale samples are extracted to enrich the training pool, which allows the tracker to handle both incremental and abrupt scale variations between frames. Experimentally, we evaluate our approach on Online Tracking Benchmark (OTB) dataset and Visual Object Tracking (VOT) challenge datasets, showing that our approach outperforms recent state-of-the-art trackers, and it especially improves successful rate score on OTB dataset, while on VOT datasets, PAWSS ranks among the top trackers while operating at real-time frame rates. Focusing on the application of PAWSS to surgical scenes, we evaluate on MICCAI 2015 challenge instrument tracking challenge and in vivo datasets, showing that our approach performs the best among all submitted methods and also has promising performance on in vivo surgical instrument tracking.
| Type: | Article |
|---|---|
| Title: | Patch-based adaptive weighting with segmentation and scale (PAWSS) for visual tracking in surgical video |
| Location: | Netherlands |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1016/j.media.2019.07.002 |
| Publisher version: | https://doi.org/10.1016/j.media.2019.07.002 |
| Language: | English |
| Additional information: | This is an open access article under the CC BY license. (http://creativecommons.org/licenses/by/4.0/) |
| Keywords: | Visual object tracking, Tracking-by-detection, Computer assisted interventions, Surgical instrument tracking |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/1570683 |
Archive Staff Only
 |
View Item |
