Event-Based Target Tracking Control for a Snake Robot Using a Dynamic Vision Sensor

被引:2
|
作者
Jiang, Zhuangyi [1 ]
Bing, Zhenshan [1 ]
Huang, Kai [2 ]
Chen, Guang [1 ]
Cheng, Long [1 ]
Knoll, Alois [1 ]
机构
[1] Tech Univ Munich, Dept Informat, Boltzmannstr 3, D-85748 Munich, Germany
[2] Sun Yat Sen Univ, Sch Data & Comp Sci, Guangzhou, Peoples R China
关键词
Target tracking; Spiking Neural Network; Dynamic Vision Sensor; Neuromorphic snake robot; Hough transform;
D O I
10.1007/978-3-319-70136-3_12
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Dynamic Vision Sensor (DVS) is a promising neuromorphic vision sensor for autonomous locomotion control of mobile robots, as the DVS acquires visual information by mimicking retina to sense and encode the world as neural signals. In this paper, we present an autonomous target detecting and tracking control approach for a snake-like robot with a monocular DVS. By using Hough transform based on the Spiking Neural Network (SNN), the target pole is detected as two parallel lines from the event-based visual input. Then a depth estimation method based on the pose and motion of the robot is proposed. Furthermore, by combining the periodic motion feature of the snake-like robot, an adaptive tracking method based on the estimated depth information is introduced. Experiments are conducted on a snake-like robot to demonstrate the practicality and accuracy of our proposed method to track a target pole dynamically with a monocular DVS.
引用
收藏
页码:111 / 121
页数:11
相关论文
共 50 条
  • [31] Event-Based Wireless Tracking Control for a Wheeled Mobile Robot Against Reactive Jamming Attacks
    Xu, Hao
    Zhang, Jinhui
    Sun, Zhongqi
    Yang, Hongjiu
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2023, 10 (04): : 1925 - 1936
  • [32] Event-Based Fuzzy Tracking Control for Nonlinear Networked Systems Subject to Dynamic Quantization
    Li, Zhi-Min
    Chang, Xiao-Heng
    Xiong, Jun
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2023, 31 (03) : 941 - 954
  • [33] Mobile robot guidance using adaptive event-based pose estimation and camera sensor
    Martinez-Rey, Miguel
    Espinosa, Felipe
    Gardel, Alfredo
    Santos, Carlos
    Santiso, Enrique
    2016 2ND INTERNATIONAL CONFERENCE ON EVENT-BASED CONTROL, COMMUNICATION, AND SIGNAL PROCESSING (EBCCSP), 2016,
  • [34] Event-based tracking control for nonholonomic mobile robots
    Xie, Chen
    Fan, Yuan
    Qiu, Jianbin
    NONLINEAR ANALYSIS-HYBRID SYSTEMS, 2020, 38
  • [35] Dynamic event-based output feedback tracking control of nonlinear CPSs with cyber attacks
    Li, Hengqian
    Zhan, Xisheng
    Wu, Bo
    Wu, Jie
    Yan, Huaicheng
    COMMUNICATIONS IN NONLINEAR SCIENCE AND NUMERICAL SIMULATION, 2024, 130
  • [36] An Event-Based Optical Flow Algorithm for Dynamic Vision Sensors
    Ridwan, Iffatur
    Cheng, Howard
    IMAGE ANALYSIS AND RECOGNITION, ICIAR 2017, 2017, 10317 : 182 - 189
  • [37] Event-Based Vision: A Survey
    Gallego, Guillermo
    Delbruck, Tobi
    Orchard, Garrick Michael
    Bartolozzi, Chiara
    Taba, Brian
    Censi, Andrea
    Leutenegger, Stefan
    Davison, Andrew
    Conradt, Jorg
    Daniilidis, Kostas
    Scaramuzza, Davide
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (01) : 154 - 180
  • [38] Robot Target Recognition and Tracking Based on Panoramic Vision
    Liang Yan-hua
    Cai Cheng-tao
    2017 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (ICMA), 2017, : 131 - 135
  • [39] Dynamic resource allocation for target tracking in sensor and robot networks
    Shan, XN
    Tan, JD
    SENSORS, AND COMMAND, CONTROL, COMMUNICATIONS, AND INTELLIGENCE (C31) TECHNOLOGIES FOR HOMELAND SECURITY AND HOMELAND DEFENSE IV, PTS 1 AND 2, 2005, 5778 : 412 - 421
  • [40] REAL-TIME MOTION ESTIMATION BASED ON EVENT-BASED VISION SENSOR
    Lee, Jun Haeng
    Lee, Kyoobin
    Ryu, Hyunsurk
    Park, Paul K. J.
    Shin, Chang-Woo
    Woo, Jooyeon
    Kim, Jun-Seok
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 204 - 208