An AR-assisted Deep Reinforcement Learning-based approach towards mutual-cognitive safe human-robot interaction

被引:51
|
作者
Li, Chengxi [1 ,2 ]
Zheng, Pai [1 ,2 ]
Yin, Yue [1 ]
Pang, Yat Ming [1 ,2 ]
Huo, Shengzeng [1 ,3 ]
机构
[1] Hong Kong Polytech Univ, Dept Ind & Syst Engn, Hong Kong, Peoples R China
[2] Hong Kong Sci Pk, Lab Artificial Intelligence Design, Hong Kong, Peoples R China
[3] Hong Kong Polytech Univ, Dept Mech Engn, Hong Kong, Peoples R China
关键词
Smart manufacturing; Human robot interaction; Augmented reality; Deep reinforcement learning; Manufacturing safety;
D O I
10.1016/j.rcim.2022.102471
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
With the emergence of Industry 5.0, the human-centric manufacturing paradigm requires manufacturing equipment (robots, etc.) interactively assist human workers to deal with dynamic and complex production tasks. To achieve symbiotic human-robot interaction (HRI), the safety issue serves as a prerequisite foundation. Regarding the growing individualized demand of manufacturing tasks, the conventional rule-based safe HRI measures could not well address the safety requirements due to inflexibility and lacking synergy. To fill the gap, this work proposes a mutual-cognitive safe HRI approach including worker visual augmentation, robot velocity control, Digital Twin-enabled motion preview and collision detection, and Deep Reinforcement Learning-based robot collision avoidance motion planning in the Augmented Reality-assisted manner. Finally, the feasibility of the system design and the performance of the proposed approach are validated by establishing and executing the prototype HRI system in a practical scene.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] A visual reasoning-based approach for mutual-cognitive human-robot collaboration
    Zheng, Pai
    Li, Shufei
    Xia, Liqiao
    Wang, Lihui
    Nassehi, Aydin
    CIRP ANNALS-MANUFACTURING TECHNOLOGY, 2022, 71 (01) : 377 - 380
  • [2] An AR-assisted Human-Robot Interaction System for Improving LLM-based Robot Control
    Zhao, Ziyue
    Tan, Runjia
    Lou, Shanhe
    In, Chen
    2024 IEEE INTERNATIONAL CONFERENCE ON CYBERNETICS AND INTELLIGENT SYSTEMS, CIS AND IEEE INTERNATIONAL CONFERENCE ON ROBOTICS, AUTOMATION AND MECHATRONICS, RAM, CIS-RAM 2024, 2024, : 144 - 149
  • [3] Towards Safe Human-Robot Collaboration Using Deep Reinforcement Learning
    El-Shamouty, Mohamed
    Wu, Xinyang
    Yang, Shanqi
    Albus, Marcel
    Huber, Marco F.
    2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 4899 - 4905
  • [4] Deep reinforcement learning-based safe interaction for industrial human-robot collaboration using intrinsic reward function
    Liu, Quan
    Liu, Zhihao
    Xiong, Bo
    Xu, Wenjun
    Liu, Yang
    ADVANCED ENGINEERING INFORMATICS, 2021, 49
  • [5] An AR-Assisted Deep Learning-Based Approach for Automatic Inspection of Aviation Connectors
    Li, Shufei
    Zheng, Pai
    Zheng, Lianyu
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (03) : 1721 - 1731
  • [6] Unleashing mixed-reality capability in Deep Reinforcement Learning-based robot motion generation towards safe human-robot collaboration
    Li, Chengxi
    Zheng, Pai
    Zhou, Peng
    Yin, Yue
    Lee, Carman K. M.
    Wang, Lihui
    JOURNAL OF MANUFACTURING SYSTEMS, 2024, 74 : 411 - 421
  • [7] Learning-based control strategy for safe human-robot interaction exploiting task and robot redundancies
    Calinon, Sylvain
    Sardellitti, Irene
    Caldwell, Darwin G.
    IEEE/RSJ 2010 INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2010), 2010, : 249 - 254
  • [8] Machine learning-based human-robot interaction in ITS
    Wang, Jingyao
    Pradhan, Manas Ranjan
    Gunasekaran, Nallappan
    INFORMATION PROCESSING & MANAGEMENT, 2022, 59 (01)
  • [9] Deep reinforcement learning based proactive dynamic obstacle avoidance for safe human-robot collaboration
    Xia, Wanqing
    Lu, Yuqian
    Xu, Weiliang
    Xu, Xun
    MANUFACTURING LETTERS, 2024, 41 : 1246 - 1256
  • [10] Toward an Attentive Robotic Architecture: Learning-Based Mutual Gaze Estimation in Human-Robot Interaction
    Lombardi, Maria
    Maiettini, Elisa
    De Tommaso, Davide
    Wykowska, Agnieszka
    Natale, Lorenzo
    FRONTIERS IN ROBOTICS AND AI, 2022, 9