Compact real-time 2-D gradient-based analog VLSI motion sensor

被引:3
|
作者
Deutschmann, RA [1 ]
Koch, C [1 ]
机构
[1] Tech Univ Munich, Walter Schottky Inst, D-85748 Garching, Germany
关键词
analog VLSI; motion sensor; smart vision sensor; parallel image processing; real-time computation; optical flow; machine vision; robot vision; focus of expansion; axis of rotation;
D O I
10.1117/12.324003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work we present the first working focal plane analog VLSI sensor for the spatially resolved computation of the 2-D motion field based on temporal and spatial derivatives. Using an adaptive CMOS photoreceptor the temporal derivative and a function of the spatial derivative of the local light intensity are computed. By multiplying these values separately for both spatial dimensions a vector is obtained, which points in the direction of the normal optical flow and whose magnitude for a given stimulus is proportional to its velocity. The circuit consists of only 31 MOSFETs and three capacitors per pixel. We present measurement data from fully functional prototype 2-D pixel arrays for natural stimuli of varying velocity, orientation, contrast and spatial frequency. High direction selectivity even for very low contrast input is demonstrated. As application it is shown how the pixel-parallel architecture of the sensor can favourably be used for real-time computation of the focus of expansion and the axis of rotation. Because of its compactness, its robust operation and its uncritical handling the sensor might be favourably applied in industrial applications.
引用
收藏
页码:98 / 108
页数:11
相关论文
共 50 条
  • [31] Real-time analysis of transient stability using reconfigurable analog VLSI
    Gu, J
    Karady, GG
    Farmer, R
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2003, 18 (03) : 1207 - 1209
  • [32] Researchers map real-time 2-D terahertz images
    Anderson, SG
    LASER FOCUS WORLD, 1996, 32 (07): : 30 - 31
  • [33] Real-time visualization of salt crystallization in 2-D microchannels
    Shao, Jiaxin
    You, Lijun
    Jia, Na
    Kang, Yili
    Zhang, Kaiqiang
    GEOENERGY SCIENCE AND ENGINEERING, 2025, 246
  • [34] Real time ego-motion estimation with neuromorphic analog VLSI sensors
    Born, C
    Deutschmann, R
    Koch, C
    PROCEEDINGS OF THE 4TH JOINT SYMPOSIUM ON NEURAL COMPUTATION, VOL 7, 1997, : 29 - 34
  • [35] A real-time multi-scale 2-D Gaussian filter based on FPGA
    Luo, Haibo
    Gai, Xingqin
    Chang, Zheng
    Hui, Bin
    INTERNATIONAL SYMPOSIUM ON OPTOELECTRONIC TECHNOLOGY AND APPLICATION 2014: IMAGE PROCESSING AND PATTERN RECOGNITION, 2014, 9301
  • [36] Real-time hardware implementation of 2-D convolution-based image interpolation
    Zhang, Hui
    Hu, Guangshu
    Qinghua Daxue Xuebao/Journal of Tsinghua University, 2007, 47 (06): : 885 - 888
  • [37] 2-D Indoor Passive Real-Time Location System Based on Ultrawideband Technology
    Zhang, Jianing
    Wang, Wei
    She, Xiaotian
    Li, Xin
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [38] Reconfigurable VLSI Architecture for Real-Time 2D-to-3D Conversion
    Xu, Weizhi
    Yin, Shouyi
    Zhang, Zhen
    Dong, Hao
    Shi, Rui
    Liu, Leibo
    Wei, Shaojun
    IEEE ACCESS, 2017, 5 : 26604 - 26613
  • [39] A time-domain gradient-detection architecture for VLSI analog motion sensors
    Ito, Kiyoto
    Shibata, Tadashi
    2006 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-11, PROCEEDINGS, 2006, : 201 - +
  • [40] Robust Real-time UAV Replanning Using Guided Gradient-based Optimization and Topological Paths
    Zhou, Boyu
    Gao, Fei
    Pan, Jie
    Shen, Shaojie
    2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 1208 - 1214