An AR-assisted Deep Reinforcement Learning-based approach towards mutual-cognitive safe human-robot interaction

被引:51
|
作者
Li, Chengxi [1 ,2 ]
Zheng, Pai [1 ,2 ]
Yin, Yue [1 ]
Pang, Yat Ming [1 ,2 ]
Huo, Shengzeng [1 ,3 ]
机构
[1] Hong Kong Polytech Univ, Dept Ind & Syst Engn, Hong Kong, Peoples R China
[2] Hong Kong Sci Pk, Lab Artificial Intelligence Design, Hong Kong, Peoples R China
[3] Hong Kong Polytech Univ, Dept Mech Engn, Hong Kong, Peoples R China
关键词
Smart manufacturing; Human robot interaction; Augmented reality; Deep reinforcement learning; Manufacturing safety;
D O I
10.1016/j.rcim.2022.102471
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
With the emergence of Industry 5.0, the human-centric manufacturing paradigm requires manufacturing equipment (robots, etc.) interactively assist human workers to deal with dynamic and complex production tasks. To achieve symbiotic human-robot interaction (HRI), the safety issue serves as a prerequisite foundation. Regarding the growing individualized demand of manufacturing tasks, the conventional rule-based safe HRI measures could not well address the safety requirements due to inflexibility and lacking synergy. To fill the gap, this work proposes a mutual-cognitive safe HRI approach including worker visual augmentation, robot velocity control, Digital Twin-enabled motion preview and collision detection, and Deep Reinforcement Learning-based robot collision avoidance motion planning in the Augmented Reality-assisted manner. Finally, the feasibility of the system design and the performance of the proposed approach are validated by establishing and executing the prototype HRI system in a practical scene.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Deep transfer learning in human-robot interaction for cognitive and physical rehabilitation purposes
    Ilyas, Chaudhary Muhammad Aqdus
    Rehm, Matthias
    Nasrollahi, Kamal
    Madadi, Yeganeh
    Moeslund, Thomas B.
    Seydi, Vahid
    PATTERN ANALYSIS AND APPLICATIONS, 2022, 25 (03) : 653 - 677
  • [22] Human-Robot Collaborative Manufacturing Cell with Learning-Based Interaction Abilities
    Baptista, Joel
    Castro, Afonso
    Gomes, Manuel
    Amaral, Pedro
    Santos, Vitor
    Silva, Filipe
    Oliveira, Miguel
    ROBOTICS, 2024, 13 (07)
  • [23] Towards safe human-robot interaction in robotic cells: an approach based on visual tracking and intention estimation
    Bascetta, Luca
    Ferretti, Gianni
    Rocco, Paolo
    Ardo, Hakan
    Bruyninckx, Herman
    Demeester, Eric
    Di Lello, Enrico
    2011 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, 2011, : 2971 - 2978
  • [24] Gesture Learning Based on A Topological Approach for Human-Robot Interaction
    Obo, Takenori
    Takizawa, Kazuma
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [25] Sample-efficient Deep Reinforcement Learning with Imaginary Rollouts for Human-Robot Interaction
    Thabet, Mohammad
    Patacchiola, Massimiliano
    Cangelosi, Angelo
    2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : 5079 - 5085
  • [26] AI-computing, deep reinforcement learning-based predictive human-robot neuromechanical simulation for wearable robots
    Wang, Mingyi
    Luo, Shuzhen
    APPLIED INTELLIGENCE, 2025, 55 (06)
  • [27] A Fast Real-time Facial Expression Classifier Deep Learning-based for Human-robot Interaction
    Putro, Muhamad Dwisnanto
    Nguyen, Duy-Linh
    Jo, Kang-Hyun
    2021 21ST INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2021), 2021, : 988 - 993
  • [28] DL-DARE: Deep learning-based different activity recognition for the human-robot interaction environment
    Kansal, Sachin
    Jha, Sagar
    Samal, Prathamesh
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (16): : 12029 - 12037
  • [29] Assembly task allocation of human-robot collaboration based on deep reinforcement learning
    Xiong Z.
    Chen H.
    Wang C.
    Yue M.
    Hou W.
    Xu B.
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2023, 29 (03): : 789 - 800
  • [30] Hierarchical Human-robot Cooperative Control Based on GPR and Deep Reinforcement Learning
    Jin Z.-H.
    Liu A.-D.
    Yu L.
    Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (09): : 2352 - 2360