Compact real-time 2-D gradient-based analog VLSI motion sensor

被引:3
|
作者
Deutschmann, RA [1 ]
Koch, C [1 ]
机构
[1] Tech Univ Munich, Walter Schottky Inst, D-85748 Garching, Germany
关键词
analog VLSI; motion sensor; smart vision sensor; parallel image processing; real-time computation; optical flow; machine vision; robot vision; focus of expansion; axis of rotation;
D O I
10.1117/12.324003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work we present the first working focal plane analog VLSI sensor for the spatially resolved computation of the 2-D motion field based on temporal and spatial derivatives. Using an adaptive CMOS photoreceptor the temporal derivative and a function of the spatial derivative of the local light intensity are computed. By multiplying these values separately for both spatial dimensions a vector is obtained, which points in the direction of the normal optical flow and whose magnitude for a given stimulus is proportional to its velocity. The circuit consists of only 31 MOSFETs and three capacitors per pixel. We present measurement data from fully functional prototype 2-D pixel arrays for natural stimuli of varying velocity, orientation, contrast and spatial frequency. High direction selectivity even for very low contrast input is demonstrated. As application it is shown how the pixel-parallel architecture of the sensor can favourably be used for real-time computation of the focus of expansion and the axis of rotation. Because of its compactness, its robust operation and its uncritical handling the sensor might be favourably applied in industrial applications.
引用
收藏
页码:98 / 108
页数:11
相关论文
共 50 条
  • [41] Gradient-based Interpolation and Sampling for Real-time Rendering of Inhomogeneous, Single-scattering Media
    Ren, Zhong
    Zhou, Kun
    Lin, Stephen
    Guo, Baining
    COMPUTER GRAPHICS FORUM, 2008, 27 (07) : 1945 - 1953
  • [42] Analog VLSI implementation for stereo correspondence between 2-D images
    Erten, G
    Goodman, RM
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1996, 7 (02): : 266 - 277
  • [43] REAL-TIME MOTION ESTIMATION BASED ON EVENT-BASED VISION SENSOR
    Lee, Jun Haeng
    Lee, Kyoobin
    Ryu, Hyunsurk
    Park, Paul K. J.
    Shin, Chang-Woo
    Woo, Jooyeon
    Kim, Jun-Seok
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 204 - 208
  • [44] Real-time Projected Gradient-based Nonlinear Model Predictive Control with an Application to Anesthesia Control
    Hall, Sophie
    Ortmann, Lukas
    Picallo, Miguel
    Doerfler, Florian
    2022 IEEE 61ST CONFERENCE ON DECISION AND CONTROL (CDC), 2022, : 6193 - 6198
  • [45] Real-time Accurate Optical Flow-based Motion Sensor
    Wei, Zhaoyi
    Lee, Dah-Jye
    Nelson, Brent E.
    Archibald, James K.
    19TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOLS 1-6, 2008, : 2966 - 2969
  • [46] Real-time sensor-based motion planning for robot manipulators
    Fu, YL
    Jin, B
    Wang, SG
    Cao, ZC
    2005 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), VOLS 1-4, 2005, : 3108 - 3113
  • [47] Analog Integrated 2-D Optical Flow Sensor
    Alan A. Stocker
    Analog Integrated Circuits and Signal Processing, 2006, 46 : 121 - 138
  • [48] Analog integrated 2-D optical flow sensor
    Stocker, AA
    ANALOG INTEGRATED CIRCUITS AND SIGNAL PROCESSING, 2006, 46 (02) : 121 - 138
  • [49] An Analog Optical-Comparator-Based VLSI Velocity and Direction Motion Sensor
    Chiang, Cheng-Ta
    Wang, Tzu-Sheng
    Tseng, Ching-Tai
    2014 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE, ELECTRONICS AND ELECTRICAL ENGINEERING (ISEEE), VOLS 1-3, 2014, : 5 - 9
  • [50] FM2:: a real-time fast marching sensor-based motion planner
    Garrido, Santiago
    Moreno, Luis
    Blanco, Dolores
    Martin, Fernando
    2007 IEEE/ASME INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS, VOLS 1-3, 2007, : 595 - 600