Collision Avoidance in Human-Robot Interaction Using Kinect Vision System Combined With Robot's Model and Data

被引:21
|
作者
Nascimento, Hugo [1 ,2 ]
Mujica, Martin [2 ]
Benoussaad, Mourad [2 ]
机构
[1] Univ Pernambuco, Polytech Sch, Automat & Control Dept, R Benf 455, BR-50720001 Recife, PE, Brazil
[2] Univ Toulouse, LGP ENIT, Tarbes, France
关键词
D O I
10.1109/IROS45743.2020.9341248
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Human-Robot Interaction (HRI) is a largely addressed subject today. Collision avoidance is one of main strategies that allow space sharing and interaction without contact between human and robot. It is thus usual to use a 3D depth camera sensor which may involves issues related to occluded robot in camera view. While several works overcame this issue by applying infinite depth principle or increasing the number of cameras, we developed in the current work a new and an original approach based on the combination of a 3D depth sensor (Microsoft (R) Kinect V2) and the proprioceptive robot position sensors. This method uses a principle of limited safety contour around the obstacle to dynamically estimate the robot-obstacle distance, and then generate the repulsive force that controls the robot. For validation, our approach is applied in real time to avoid collision between dynamical obstacles (humans or objects) and the end-effector of a real 7-dof Kuka LBR iiwa collaborative robot. Several strategies based on distancing and its combination with dodging were tested. Results have shown a reactive and efficient collision avoidance, by ensuring a minimum obstaclerobot distance (of approximate to 240mm), even when the robot is in an occluded zone in the Kinect camera view.
引用
收藏
页码:10293 / 10298
页数:6
相关论文
共 50 条
  • [1] Collision Avoidance Interaction Between Human and a Hidden Robot Based on Kinect and Robot Data Fusion
    Nascimento, Hugo
    Mujica, Martin
    Benoussaad, Mourad
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (01) : 88 - 94
  • [2] Visual Control of a Multi-Robot Coupled System: Application to Collision Avoidance in Human-Robot Interaction
    Pomares, Jorge
    Garcia, Gabriel J.
    Perea, Ivan
    Corrales, Juan A.
    Jara, Carlos A.
    Torres, Fernando
    2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCV WORKSHOPS), 2011,
  • [3] Active collision avoidance for human-robot collaboration driven by vision sensors
    Mohammed, Abdullah
    Schmidt, Bernard
    Wang, Lihui
    INTERNATIONAL JOURNAL OF COMPUTER INTEGRATED MANUFACTURING, 2017, 30 (09) : 970 - 980
  • [4] A Panoramic Vision System for Human-Robot Interaction
    Martinez, Ester
    del Pobil, Angel P.
    PROCEEDINGS OF THE 5TH ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION (HRI 2010), 2010, : 171 - 172
  • [5] A Hybrid Collision Avoidance System for Indoor Mobile Robots based on Human-Robot Interaction
    Ghandour, Mazen
    Liu, Hui
    Stoll, Norbert
    Thurow, Kerstin
    PROCEEDINGS OF THE 2016 17TH INTERNATIONAL CONFERENCE ON MECHATRONICS - MECHATRONIKA (ME) 2016, 2016, : 66 - 72
  • [6] Developing a gesture based remote human-robot interaction system using kinect
    Qian, K. (kqian@seu.edu.cn), 1600, Science and Engineering Research Support Society, 20 Virginia Court, Sandy Bay, Tasmania, Australia (07):
  • [7] Interactive Collision Avoidance System for Indoor Mobile Robots based on Human-Robot Interaction
    Ghandour, Mazen
    Liu, Hui
    Stoll, Norbert
    Thurow, Kerstin
    2016 9TH INTERNATIONAL CONFERENCE ON HUMAN SYSTEM INTERACTIONS (HSI), 2016, : 209 - 215
  • [8] Control and Obstacle Collision Avoidance Method applied to Human-Robot Interaction
    Leite, Antonio C.
    Almeida-Antonio, Thiago B.
    From, Pal J.
    Lizarralde, Fernando
    Hsu, Liu
    2015 IEEE INTERNATIONAL WORKSHOP ON ADVANCED ROBOTICS AND ITS SOCIAL IMPACTS (ARSO), 2015,
  • [9] Vision System of Facial Robot SHFR-III for Human-robot Interaction
    Ke, Xianxin
    Zhu, Yujiao
    Yang, Yang
    Xing, Jizhong
    Luo, Zhitong
    ICINCO: PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS, VOL 2, 2016, : 472 - 478
  • [10] Using Haptic and Vision sensing for Human-Robot Interaction
    Lioulemes, Alexandros
    2014 IEEE INTERNATIONAL SYMPOSIUM ON HAPTIC, AUDIO AND VISUAL ENVIRONMENTS AND GAMES (HAVE), 2014,