Compact real-time 2-D gradient-based analog VLSI motion sensor

被引:3
|
作者
Deutschmann, RA [1 ]
Koch, C [1 ]
机构
[1] Tech Univ Munich, Walter Schottky Inst, D-85748 Garching, Germany
关键词
analog VLSI; motion sensor; smart vision sensor; parallel image processing; real-time computation; optical flow; machine vision; robot vision; focus of expansion; axis of rotation;
D O I
10.1117/12.324003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work we present the first working focal plane analog VLSI sensor for the spatially resolved computation of the 2-D motion field based on temporal and spatial derivatives. Using an adaptive CMOS photoreceptor the temporal derivative and a function of the spatial derivative of the local light intensity are computed. By multiplying these values separately for both spatial dimensions a vector is obtained, which points in the direction of the normal optical flow and whose magnitude for a given stimulus is proportional to its velocity. The circuit consists of only 31 MOSFETs and three capacitors per pixel. We present measurement data from fully functional prototype 2-D pixel arrays for natural stimuli of varying velocity, orientation, contrast and spatial frequency. High direction selectivity even for very low contrast input is demonstrated. As application it is shown how the pixel-parallel architecture of the sensor can favourably be used for real-time computation of the focus of expansion and the axis of rotation. Because of its compactness, its robust operation and its uncritical handling the sensor might be favourably applied in industrial applications.
引用
收藏
页码:98 / 108
页数:11
相关论文
共 50 条
  • [21] 2-D Motion based Real Time Wireless Interaction System for Disabled Patients
    Dipta, Shahriyar Safat
    Ghosh, Arnob
    Kundu, Arnob
    Saha, Arnob
    2019 INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, SIGNAL PROCESSING AND NETWORKING (WISPNET 2019): ADVANCING WIRELESS AND MOBILE COMMUNICATIONS TECHNOLOGIES FOR 2020 INFORMATION SOCIETY, 2019, : 331 - 334
  • [22] An Unsupervised Gradient-Based Approach for Real-Time Log Analysis From Distributed Systems
    Wang, Minquan
    Lu, Siyang
    Xiao, Sizhe
    Wang, Dong Dong
    Wei, Xiang
    Han, Ningning
    Wang, Liqiang
    INTERNATIONAL JOURNAL OF COOPERATIVE INFORMATION SYSTEMS, 2024, 33 (02)
  • [23] A Real-Time Motion-Feature-Extraction VLSI Employing Digital-Pixel-Sensor-Based Parallel Architecture
    Zhu, Hongbo
    Shibata, Tadashi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2014, 24 (10) : 1787 - 1799
  • [24] A compact VLSI neural computer integrated with active pixel sensor for real-time machine vision applications
    Fang, WC
    Udomkesmalee, S
    Alkalai, L
    APPLICATIONS AND SCIENCE OF ARTIFICIAL NEURAL NETWORKS III, 1997, 3077 : 266 - 275
  • [25] A robust analog VLSI motion sensor based on the visual system of the fly
    Harrison, RR
    Koch, C
    AUTONOMOUS ROBOTS, 1999, 7 (03) : 211 - 224
  • [26] A Robust Analog VLSI Motion Sensor Based on the Visual System of the Fly
    Reid R. Harrison
    Christof Koch
    Autonomous Robots, 1999, 7 : 211 - 224
  • [27] Employing reprogrammable analog VLSI in real-time analysis of transient stability
    Karady, George G.
    Gu, Jun
    ELECTRIC POWER SYSTEMS RESEARCH, 2007, 77 (08) : 980 - 988
  • [28] Real-time 2-D fluid simulation with a GPU acceleration
    School of Mechactronics Engineering, Harbin Institute of Technology, Harbin 150001, China
    Harbin Gongcheng Daxue Xuebao, 2008, 3 (278-284): : 278 - 284
  • [29] Real-time 2-D feature detection on a reconfigurable computer
    Benedetti, A
    Perona, P
    1998 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1998, : 586 - 593
  • [30] Real-Time 2-D Temperature Imaging Using Ultrasound
    Liu, Dalong
    Ebbini, Emad S.
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2010, 57 (01) : 12 - 16