Deng, J; Chan, G; Zhong, H; Lu, CX; (2024) Robust 3D Object Detection from LiDAR-Radar Point Clouds via Cross-Modal Feature Augmentation. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) 2024. (pp. pp. 6585-6591). Institute of Electrical and Electronics Engineers (IEEE)

Preview

Text 2309.17336v3.pdf - Accepted Version Download (2MB) | Preview

Abstract

This paper presents a novel framework for robust 3D object detection from point clouds via cross-modal hallucination. Our proposed approach is agnostic to either hallucination direction between LiDAR and 4D radar. We introduce multiple alignments on both spatial and feature levels to achieve simultaneous backbone refinement and hallucination generation. Specifically, spatial alignment is proposed to deal with the geometry discrepancy for better instance matching between LiDAR and radar. The feature alignment step further bridges the intrinsic attribute gap between the sensing modalities and stabilizes the training. The trained object detection models can deal with difficult detection cases better, even though only single-modal data is used as the input during the inference stage. Extensive experiments on the View-of-Delft (VoD) dataset show that our proposed method outperforms the state-of-the-art (SOTA) methods for both radar and LiDAR object detection while maintaining competitive efficiency in runtime.

Downloads since deposit

Loading...

21Downloads

Download activity - last month

Export as JSONCSVXML

Loading...

Download activity - last 12 months

Export as CSVXMLJSON

Loading...

Downloads by country - last 12 months

Export as CSVXMLJSON

Loading...

Archive Staff Only

View Item