Challenges and Perspectives in Neuromorphic-based Visual IoT Systems and Networks

Advanced search
Browse by:

Department | Year

UCL Theses | Latest

Deposit your research

Challenges and Perspectives in Neuromorphic-based Visual IoT Systems and Networks

Martini, M; Khan, N; Bi, Y; Andreopoulos, Y; Saki, H; Shikh-Bahaei, M; (2020) Challenges and Perspectives in Neuromorphic-based Visual IoT Systems and Networks. In: Proceedings of ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). (pp. pp. 8539-8543). IEEE: Barcelona, Spain. Green open access

[thumbnail of IEEE_ICASSP_2020_IOSIRE_review.pdf]

Preview

Text
IEEE_ICASSP_2020_IOSIRE_review.pdf - Accepted Version
Download (547kB) | Preview

Abstract

Neuromorphic sensors, a.k.a. dynamic vision sensors (DVS) or silicon retinas, do not capture full images (frames) at a fixed rate, but asynchronously capture spikes indicating changes of brightness in the scene, following the principles of biological vision and perception in mammals. DVS sensing and processing produces a data representation where the scene can be represented with a very high time resolution with a limited number of bits (an inherent data compression is performed at the time of acquisition). Such representation can be used locally to derive actionable responses and selected parts can be transmitted and then processed in another network location. Due to these features, such sensors represent an excellent choice as visual sensing technology for next-generation Internet-of-Things, e.g. in surveillance, drone technology, and robotics. It is in fact becoming evident that in this framework acquiring, processing, and transmitting frame-based video is inefficient in terms of energy consumption and reaction times, in particular in some scenarios. Hence, we explore here the feasibility of advanced Machine to Machine (M2M) communications systems that directly capture, compress and transmit spike-based visual information to cloud computing services in order to produce content classification or retrieval results with extremely low power and low latency.

Type:	Proceedings paper
Title:	Challenges and Perspectives in Neuromorphic-based Visual IoT Systems and Networks
Event:	ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
ISBN-13:	9781509066315
Open access status:	An open access version is available from UCL Discovery
DOI:	10.1109/ICASSP40776.2020.9054303
Publisher version:	https://doi.org/10.1109/ICASSP40776.2020.9054303
Language:	English
Additional information:	This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
UCL classification:	UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng
URI:	https://discovery.ucl.ac.uk/id/eprint/10110789