Asadi, Mahboubeh; Zareinia, Kourosh; Saeedi, Sajad; (2024) Di-NeRF: Distributed NeRF for Collaborative Learning With Relative Pose Refinement. IEEE Robotics and Automation Letters , 9 (11) pp. 10527-10534. 10.1109/LRA.2024.3474551.

Preview

Text Asadi2024DINERF.pdf - Accepted Version Download (7MB) | Preview

Abstract

Collaborative mapping of unknown environments can be done faster and more robustly than a single robot. However, a collaborative approach requires a distributed paradigm to be scalable and deal with communication issues. This work presents a fully distributed algorithm enabling a group of robots to collectively optimize the parameters of a Neural Radiance Field (NeRF). The algorithm involves the communication of each robot's trained NeRF parameters over a mesh network, where each robot trains its NeRF and has access to its own visual data only. Additionally, the relative poses of all robots are jointly optimized alongside the model parameters, enabling mapping with less accurate relative camera poses. We show that multi-robot systems can benefit from differentiable and robust 3D reconstruction optimized from multiple NeRFs. Experiments on real-world and synthetic data demonstrate the efficiency of the proposed algorithm.

Download activity - last month

Export as CSVXMLJSON

Download activity - last 12 months

Export as CSVXMLJSON

Downloads by country - last 12 months

Export as CSVXMLJSON

Archive Staff Only

View Item