Youssef, Ali; Vasconcelos, Francisco; (2025) NeRF-Supervised Feature Point Detection and Description. In: Canton, C and DelBue, A and Pont-Tuset, J and Tommasi, T, (eds.) Computer Vision – ECCV 2024 Workshops PT XXIII. (pp. pp. 103-119). Springer: Cham, Switzerland.

Text 2403.08156v3.pdf - Accepted Version Access restricted to UCL open access staff until 13 May 2026. Download (1MB)

Abstract

Feature point detection and description is the backbone for various computer vision applications, such as Structure-from-Motion, visual SLAM, and visual place recognition. While learning-based methods have surpassed traditional handcrafted techniques, their training often relies on simplistic homography-based simulations of multi-view perspectives, limiting model generalisability. This paper presents a novel approach leveraging Neural Radiance Fields (NeRFs) to generate a diverse and realistic dataset consisting of indoor and outdoor scenes. Our proposed methodology adapts state-of-the-art feature detectors and descriptors for training on multi-view NeRF-synthesised data, with supervision achieved through perspective projective geometry. Experiments demonstrate that the proposed methodology achieves competitive or superior performance on standard benchmarks for relative pose estimation, point cloud registration, and homography estimation while requiring significantly less training data and time compared to existing approaches.

Download activity - last month

Export as CSVXMLJSON

Download activity - last 12 months

Export as CSVXMLJSON

Downloads by country - last 12 months

Export as CSVJSONXML

Archive Staff Only

View Item