Ben Miled, Meriem; Liu, Yuanchang; Liu, Wenwen; (2024) Adaptive and Unsupervised Learning-based 3D Spatio-temporal Filter for Event-driven Cameras. Research , 7 , Article 0330. 10.34133/research.0330.

Preview

Text research.0330.pdf Download (7MB) | Preview

Abstract

In the evolving landscape of robotics and visual navigation, event cameras have gained significant traction, notably for their exceptional dynamic range, efficient power consumption and low latency. Despite these advantages, conventional processing methods oversimplify the data into two dimensions, neglecting critical temporal information. To overcome this limitation, we propose a novel method that treats events as 3D time-discrete signals. Drawing inspiration from the intricate biological filtering systems inherent to the human visual apparatus, we’ve developed a 3D spatio-temporal filter based on unsupervised machine learning algorithm. This filter effectively reduces noise levels and performs data size reduction, with its parameters being dynamically adjusted based on Population Activity. This ensures adaptability and precision under various conditions, like changes in motion velocity and ambient lighting. In our novel validation approach, we first identify the noise type and determine its power spectral density in the event stream. We then apply a one-dimensional discrete Fast Fourier Transform to assess the filtered event data within the frequency domain, ensuring the targeted noise frequencies are adequately reduced. Our research also delved into the impact of indoor lighting on event stream noise. Remarkably, our method led to a 37% decrease in the data point cloud, improving data quality in diverse outdoor settings.

Download activity - last month

Export as XMLJSONCSV

Download activity - last 12 months

Export as XMLJSONCSV

Downloads by country - last 12 months

Export as CSVJSONXML

Archive Staff Only

View Item