Event-Based Visual Flow

被引:269
|
作者
Benosman, Ryad [1 ,2 ]
Clercq, Charles [3 ]
Lagorce, Xavier [1 ]
Ieng, Sio-Hoi [1 ]
Bartolozzi, Chiara [3 ]
机构
[1] Univ Paris 06, Inst Vis, F-75252 Paris 05, France
[2] Univ Genoa, DIST, I-16121 Genoa, Italy
[3] Ist Italiano Tecnol, Dept Robot, I-16163 Genoa, Italy
关键词
Event-based vision; event-based visual motion flow; neuromorphic sensors; real time; OPTICAL-FLOW; DRIVEN;
D O I
10.1109/TNNLS.2013.2273537
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper introduces a new methodology to compute dense visual flow using the precise timings of spikes from an asynchronous event-based retina. Biological retinas, and their artificial counterparts, are totally asynchronous and data-driven and rely on a paradigm of light acquisition radically different from most of the currently used frame-grabber technologies. This paper introduces a framework to estimate visual flow from the local properties of events' spatiotemporal space. We will show that precise visual flow orientation and amplitude can be estimated using a local differential approach on the surface defined by coactive events. Experimental results are presented; they show the method adequacy with high data sparseness and temporal resolution of event-based acquisition that allows the computation of motion flow with microsecond accuracy and at very low computational cost.
引用
收藏
页码:407 / 417
页数:11
相关论文
共 50 条
  • [1] Event-based Visual Inertial Odometry
    Zhu, Alex Zihao
    Atanasov, Nikolay
    Daniilidis, Kostas
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5816 - 5824
  • [2] Event-Based Stereo Visual Odometry
    Zhou, Yi
    Gallego, Guillermo
    Shen, Shaojie
    IEEE TRANSACTIONS ON ROBOTICS, 2021, 37 (05) : 1433 - 1450
  • [3] Event-Based Text Visual Analytics
    Wang, Ji
    Bradel, Lauren
    North, Chris
    2014 IEEE CONFERENCE ON VISUAL ANALYTICS SCIENCE AND TECHNOLOGY (VAST), 2014, : 333 - 334
  • [4] Embedded Event-based Visual Odometry
    Bertrand, Johan
    Yigit, Arda
    Durand, Sylvain
    2020 6TH INTERNATIONAL CONFERENCE ON EVENT-BASED CONTROL, COMMUNICATION, AND SIGNAL PROCESSING (EBCCSP), 2020,
  • [5] On event-based optical flow detection
    Brosch, Tobias
    Tschechne, Stephan
    Neumann, Heiko
    FRONTIERS IN NEUROSCIENCE, 2015, 9
  • [6] Secrets of Event-Based Optical Flow
    Shiba, Shintaro
    Aoki, Yoshimitsu
    Gallego, Guillermo
    COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 : 628 - 645
  • [7] Asynchronous Optimisation for Event-based Visual Odometry
    Liu, Daqi
    Parra, Alvaro
    Latif, Yasir
    Chen, Bo
    Chin, Tat-Jun
    Reid, Ian
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2022, 2022, : 9432 - 9438
  • [8] Event-Based Visual Tracking in Dynamic Environments
    Perez-Salesa, Irene
    Aldana-Lopez, Rodrigo
    Sagues, Carlos
    ROBOT2022: FIFTH IBERIAN ROBOTICS CONFERENCE: ADVANCES IN ROBOTICS, VOL 1, 2023, 589 : 175 - 186
  • [9] Spatiotemporal Registration for Event-based Visual Odometry
    Liu, Daqi
    Parra, Alvaro
    Chin, Tat-Jun
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 4935 - 4944
  • [10] Asynchronous frameless event-based optical flow
    Benosman, Ryad
    Ieng, Sio-Hoi
    Clercq, Charles
    Bartolozzi, Chiara
    Srinivasan, Mandyam
    NEURAL NETWORKS, 2012, 27 : 32 - 37