Zhang, Shuyang;
He, Jinhao;
Yang, Bowen;
Zhu, Yilong;
Wu, Jin;
Jiao, Jianhao;
Yuan, Jie;
(2024)
VirCap: Virtual Camera Exposure Control Based on Image Photometric Synthesis for Visual SLAM Application.
IEEE/ASME Transactions on Mechatronics
10.1109/TMECH.2024.3454075.
Preview |
Text
VirCap_Virtual_Camera_Exposure_Control_Based_on_Image_Photometric_Synthesis_for_Visual_SLAM_Application.pdf - Accepted Version Download (3MB) | Preview |
Abstract
Mobile robots, such as quadrupedal and vehicular robots, are known for their high-speed movement and operation in environments with wide dynamic ranges. This property challenges the existing camera capture methods for visual applications, especially the visual simultaneous localization and mapping (SLAM) task, which requires a strong temporal continuity. Due to the limitations imposed by the camera hardware's control frequency and delay, camera exposure control methods cannot rapidly and stably publish high-quality images preventing oversaturation, background noise, and motion blur. In this article, we propose a novel image acquisition framework called VirCap, introducing image bracketing capture patterns to preserve more dynamic range information than a single image capture. By leveraging image photometric synthetic technology, VirCap enables a virtual camera exposure control (exposure time and analog gain), effectively decoupling the camera interaction from the control loop and facilitating more frequent exposure updates than traditional camera control methods. An exposure allocation strategy is also developed to balance motion blur and background noise, allowing VirCap to synthesize images of optimal quality that consider the robot's self-motion. Extensive experiments are conducted to demonstrate the efficiency and resilience of VirCap under extreme operating conditions for different visual SLAM systems.
| Type: | Article |
|---|---|
| Title: | VirCap: Virtual Camera Exposure Control Based on Image Photometric Synthesis for Visual SLAM Application |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/TMECH.2024.3454075 |
| Publisher version: | https://doi.org/10.1109/TMECH.2024.3454075 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Camera exposure control, photometric image synthesis, robotic perception, visual simultaneous localization and mapping (SLAM) |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10198000 |
Archive Staff Only
 |
View Item |
