Event-Based Visual Flow

被引:269
|
作者
Benosman, Ryad [1 ,2 ]
Clercq, Charles [3 ]
Lagorce, Xavier [1 ]
Ieng, Sio-Hoi [1 ]
Bartolozzi, Chiara [3 ]
机构
[1] Univ Paris 06, Inst Vis, F-75252 Paris 05, France
[2] Univ Genoa, DIST, I-16121 Genoa, Italy
[3] Ist Italiano Tecnol, Dept Robot, I-16163 Genoa, Italy
关键词
Event-based vision; event-based visual motion flow; neuromorphic sensors; real time; OPTICAL-FLOW; DRIVEN;
D O I
10.1109/TNNLS.2013.2273537
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper introduces a new methodology to compute dense visual flow using the precise timings of spikes from an asynchronous event-based retina. Biological retinas, and their artificial counterparts, are totally asynchronous and data-driven and rely on a paradigm of light acquisition radically different from most of the currently used frame-grabber technologies. This paper introduces a framework to estimate visual flow from the local properties of events' spatiotemporal space. We will show that precise visual flow orientation and amplitude can be estimated using a local differential approach on the surface defined by coactive events. Experimental results are presented; they show the method adequacy with high data sparseness and temporal resolution of event-based acquisition that allows the computation of motion flow with microsecond accuracy and at very low computational cost.
引用
收藏
页码:407 / 417
页数:11
相关论文
共 50 条
  • [41] TMA: Temporal Motion Aggregation for Event-based Optical Flow
    Liu, Haotian
    Chen, Guang
    Qu, Sanqing
    Zhang, Yanping
    Li, Zhijun
    Knoll, Alois
    Jiang, Changjun
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 9651 - 9660
  • [42] Unsupervised Event-Based Optical Flow Using Motion Compensation
    Zhu, Alex Zihao
    Yuan, Liangzhe
    Chaney, Kenneth
    Daniilidis, Kostas
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT VI, 2019, 11134 : 711 - 714
  • [43] An Event-Based Optical Flow Algorithm for Dynamic Vision Sensors
    Ridwan, Iffatur
    Cheng, Howard
    IMAGE ANALYSIS AND RECOGNITION, ICIAR 2017, 2017, 10317 : 182 - 189
  • [44] Event-Based Architectures
    Faison, Ted
    DR DOBBS JOURNAL, 2008, 33 (07): : 22 - +
  • [45] Event-based encoding of biological motion and location in visual working memory
    Gu, Quan
    Wan, Xueyi
    Ma, Hong
    Lu, Xiqian
    Guo, Yang
    Shen, Mowei
    Gao, Zaifeng
    QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2020, 73 (08): : 1261 - 1277
  • [46] Learned Event-based Visual Perception for Improved Space Object Detection
    Salvatore, Nikolaus
    Fletcher, Justin
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 3301 - 3310
  • [47] Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotion
    Zhu, Alex Zihao
    Yuan, Liangzhe
    Chaney, Kenneth
    Daniilidis, Kostas
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 989 - 997
  • [48] Fast Event-Based Optical Flow Estimation by Triplet Matching
    Shiba, Shintaro
    Aoki, Yoshimitsu
    Gallego, Guillermo
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 2712 - 2716
  • [49] Event-based Real-time Optical Flow Estimation
    Lee, Alex Junho
    Kim, Ayoung
    2017 17TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), 2017, : 787 - 791
  • [50] Rapid identification of boiling crisis with event-based visual streaming analysis
    Lu, Dale
    Suh, Youngjoon
    Won, Yoonjin
    APPLIED THERMAL ENGINEERING, 2024, 239