A Motion-Based Feature for Event-Based Pattern Recognition

被引:37
|
作者
Clady, Xavier [1 ]
Maro, Jean-Matthieu [1 ]
Barre, Sebastien [1 ]
Benosman, Ryad B. [1 ]
机构
[1] UPMC Univ Paris 06, CNRS, INSERM, Inst Vis,Sorbonne Univ, Paris, France
基金
欧盟地平线“2020”;
关键词
neuromorphic sensor; event-driven vision; pattern recognition; motion-based feature; speed-tuned integration time; histogram of oriented optical flow; corner detection; gesture recognition; INTEREST POINT DETECTORS; IMAGE CORNER DETECTION; FUNCTIONAL ARCHITECTURE; PERFORMANCE EVALUATION; COMPACT APPROXIMATION; 3D RECONSTRUCTION; SELECTIVE NEURONS; RECEPTIVE-FIELDS; DRIVEN; DESCRIPTORS;
D O I
10.3389/fnins.2016.00594
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
This paper introduces an event-based luminance-free feature from the output of asynchronous event-based neuromorphic retinas. The feature consists in mapping the distribution of the optical flow along the contours of the moving objects in the visual scene into a matrix. Asynchronous event-based neuromorphic retinas are composed of autonomouspixels, each of them asynchronously generating "spiking" events that encode relative changes in pixels' illumination at high temporal resolutions. The optical flow is computed at each event, and is integrated locally or globally in a speed and direction coordinate frame based grid, using speed-tuned temporal kernels. The latter ensures that the resulting feature equitably represents the distribution of the normal motion along the current moving edges, whatever their respective dynamics. The usefulness and the generality of the proposed feature are demonstrated in pattern recognition applications: local corner detection and global gesture recognition.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Temporal Binary Representation for Event-Based Action Recognition
    Innocenti, Simone Undri
    Becattini, Federico
    Pernici, Federico
    Del Bimbo, Alberto
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 10426 - 10432
  • [42] Attention Mechanisms for Object Recognition with Event-Based Cameras
    Cannici, Marco
    Ciccone, Marco
    Romanoni, Andrea
    Matteucci, Matteo
    2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 1127 - 1136
  • [43] Event-Based Recognition of Lived Experiences in User Reviews
    Hassan, Ehab
    Buscaldi, Davide
    Gangemi, Aldo
    KNOWLEDGE ENGINEERING AND KNOWLEDGE MANAGEMENT, EKAW 2016, 2016, 10024 : 320 - 336
  • [44] Visual Event-Based Egocentric Human Action Recognition
    Moreno-Rodriguez, Francisco J.
    Javier Traver, V
    Barranco, Francisco
    Dimiccoli, Mariella
    Pla, Filiberto
    PATTERN RECOGNITION AND IMAGE ANALYSIS (IBPRIA 2022), 2022, 13256 : 402 - 414
  • [45] Recognition memory effects in event-based prospective memory
    Tiller, SJ
    Humphreys, MS
    Neal, AF
    AUSTRALIAN JOURNAL OF PSYCHOLOGY, 2004, 56 : 228 - 229
  • [46] Global Motion Pattern Based Event Recognition in Multi-person Videos
    Wu, Lifang
    He, Jiaoyu
    Jian, Meng
    Liu, Siyuan
    Xu, Yaowen
    COMPUTER VISION, PT III, 2017, 773 : 667 - 676
  • [47] Event-based Driver Distraction Detection and Action Recognition
    Yang, Chu
    Liu, Peigen
    Chen, Guang
    Liu, Zhengfa
    Wu, Ya
    Knoll, Alois
    2022 IEEE INTERNATIONAL CONFERENCE ON MULTISENSOR FUSION AND INTEGRATION FOR INTELLIGENT SYSTEMS (MFI), 2022,
  • [48] Fast Classification and Action Recognition With Event-Based Imaging
    Liu, Chang
    Qi, Xiaojuan
    Lam, Edmund Y.
    Wong, Ngai
    IEEE ACCESS, 2022, 10 : 55638 - 55649
  • [49] Point process models for event-based speech recognition
    Jansen, Aren
    Niyogi, Partha
    SPEECH COMMUNICATION, 2009, 51 (12) : 1155 - 1168
  • [50] Diffusive Memristors with Uniform and Tunable Relaxation Time for Spike Generation in Event-Based Pattern Recognition
    Ye, Fan
    Kiani, Fatemeh
    Huang, Yi
    Xia, Qiangfei
    ADVANCED MATERIALS, 2023, 35 (37)