Compact real-time 2-D gradient-based analog VLSI motion sensor

被引:3
|
作者
Deutschmann, RA [1 ]
Koch, C [1 ]
机构
[1] Tech Univ Munich, Walter Schottky Inst, D-85748 Garching, Germany
关键词
analog VLSI; motion sensor; smart vision sensor; parallel image processing; real-time computation; optical flow; machine vision; robot vision; focus of expansion; axis of rotation;
D O I
10.1117/12.324003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work we present the first working focal plane analog VLSI sensor for the spatially resolved computation of the 2-D motion field based on temporal and spatial derivatives. Using an adaptive CMOS photoreceptor the temporal derivative and a function of the spatial derivative of the local light intensity are computed. By multiplying these values separately for both spatial dimensions a vector is obtained, which points in the direction of the normal optical flow and whose magnitude for a given stimulus is proportional to its velocity. The circuit consists of only 31 MOSFETs and three capacitors per pixel. We present measurement data from fully functional prototype 2-D pixel arrays for natural stimuli of varying velocity, orientation, contrast and spatial frequency. High direction selectivity even for very low contrast input is demonstrated. As application it is shown how the pixel-parallel architecture of the sensor can favourably be used for real-time computation of the focus of expansion and the axis of rotation. Because of its compactness, its robust operation and its uncritical handling the sensor might be favourably applied in industrial applications.
引用
收藏
页码:98 / 108
页数:11
相关论文
共 50 条
  • [1] Neuromorphic analog VLSI sensors for 2-D direction of motion
    Deutschmann, RA
    Higgins, CM
    Koch, C
    PROCEEDINGS OF THE 4TH JOINT SYMPOSIUM ON NEURAL COMPUTATION, VOL 7, 1997, : 76 - 81
  • [2] Gradient-Based Real-Time Spectrum Sensing at Low SNR
    Koley, Santasri
    Mirza, Vishal
    Islam, Saif
    Mitra, Debjani
    IEEE COMMUNICATIONS LETTERS, 2015, 19 (03) : 391 - 394
  • [3] 2-D ANALOG FILTERS FOR REAL-TIME VIDEO SIGNAL-PROCESSING
    KAUFMAN, HJ
    SIDAHMED, MA
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 1990, 36 (02) : 137 - 141
  • [4] Low-cost real-time 2-D motion detection based on reconfigurable computing
    Papadimitriou, Kyprianos
    Dollas, Apostolos
    Sotiropoulos, Stamatios N.
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2006, 55 (06) : 2234 - 2243
  • [5] Analog VLSI cellular circuits for real-time 2D optical signal processing
    Wang, CY
    Devos, F
    ICSP '98: 1998 FOURTH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, PROCEEDINGS, VOLS I AND II, 1998, : 521 - 524
  • [6] Real-Time 2-D Lidar Odometry Based on ICP
    Li, Fuxing
    Liu, Shenglan
    Zhao, Xuedong
    Zhang, Liyan
    SENSORS, 2021, 21 (21)
  • [7] COMPUTING 2-D MOTION FIELD WITH MULTIRESOLUTION IMAGES AND COOPERATION OF GRADIENT-BASED AND MATCHING-BASED SCHEMES
    TAGAWA, N
    MORIYA, T
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 1995, E78A (06) : 685 - 692
  • [8] VLSI implementation of 2-D discrete wavelet transform for real-time video signal processing
    Yu, C
    Chen, SJ
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 1997, 43 (04) : 1270 - 1279
  • [9] Gradient-Based Real-Time Radar Pulse detection at Low SNR
    Abinaya, R.
    Varsha, V.
    Velmurugan, P. G. . S.
    PROCEEDINGS OF THE 2016 IEEE INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, SIGNAL PROCESSING AND NETWORKING (WISPNET), 2016, : 2156 - 2159
  • [10] Quantization analysis and enhancement of a VLSI gradient-based motion estimation architecture
    Botella, Guillermo
    Meyer-Baese, Uwe
    Garcia, Antonio
    Rodriguez, Manuel
    DIGITAL SIGNAL PROCESSING, 2012, 22 (06) : 1174 - 1187