An AR-assisted Deep Reinforcement Learning-based approach towards mutual-cognitive safe human-robot interaction

被引:51
|
作者
Li, Chengxi [1 ,2 ]
Zheng, Pai [1 ,2 ]
Yin, Yue [1 ]
Pang, Yat Ming [1 ,2 ]
Huo, Shengzeng [1 ,3 ]
机构
[1] Hong Kong Polytech Univ, Dept Ind & Syst Engn, Hong Kong, Peoples R China
[2] Hong Kong Sci Pk, Lab Artificial Intelligence Design, Hong Kong, Peoples R China
[3] Hong Kong Polytech Univ, Dept Mech Engn, Hong Kong, Peoples R China
关键词
Smart manufacturing; Human robot interaction; Augmented reality; Deep reinforcement learning; Manufacturing safety;
D O I
10.1016/j.rcim.2022.102471
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
With the emergence of Industry 5.0, the human-centric manufacturing paradigm requires manufacturing equipment (robots, etc.) interactively assist human workers to deal with dynamic and complex production tasks. To achieve symbiotic human-robot interaction (HRI), the safety issue serves as a prerequisite foundation. Regarding the growing individualized demand of manufacturing tasks, the conventional rule-based safe HRI measures could not well address the safety requirements due to inflexibility and lacking synergy. To fill the gap, this work proposes a mutual-cognitive safe HRI approach including worker visual augmentation, robot velocity control, Digital Twin-enabled motion preview and collision detection, and Deep Reinforcement Learning-based robot collision avoidance motion planning in the Augmented Reality-assisted manner. Finally, the feasibility of the system design and the performance of the proposed approach are validated by establishing and executing the prototype HRI system in a practical scene.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Towards Skill Transfer via Learning-Based Guidance in Human-Robot Interaction: An Application to Orthopaedic Surgical Drilling Skill
    Zahedi, Ehsan
    Khosravian, Fariba
    Wang, Weiqi
    Armand, Mehran
    Dargahi, Javad
    Zadeh, Mehrdad
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2020, 98 (3-4) : 667 - 678
  • [42] Towards Skill Transfer via Learning-Based Guidance in Human-Robot Interaction: An Application to Orthopaedic Surgical Drilling Skill
    Ehsan Zahedi
    Fariba Khosravian
    Weiqi Wang
    Mehran Armand
    Javad Dargahi
    Mehrdad Zadeh
    Journal of Intelligent & Robotic Systems, 2020, 98 : 667 - 678
  • [43] Sparse Bayesian Learning-Based Adaptive Impedance Control in Physical Human-Robot Interaction
    Li, Kelin
    Zhao, Huan
    Nuchkrua, Thanana
    Yuan, Ye
    Ding, Han
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2018, : 2379 - 2385
  • [44] Deep Imitation Learning of Nonlinear Model Predictive Control Laws for a Safe Physical Human-Robot Interaction
    Nurbayeva, Aigerim
    Shintemirov, Almas
    Rubagotti, Matteo
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (07) : 8384 - 8395
  • [45] Efficiency analysis of deep learning-based object detection for safe human robot collaboration
    Dudek, Adam
    Patalas-Maliszewska, Justyna
    Rokosz, Krzysztof
    IFAC PAPERSONLINE, 2024, 58 (19): : 1024 - 1029
  • [46] Human-robot collaborative assembly task planning for mobile cobots based on deep reinforcement learning
    Hou, Wenbin
    Xiong, Zhihua
    Yue, Ming
    Chen, Hao
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART C-JOURNAL OF MECHANICAL ENGINEERING SCIENCE, 2024, 238 (23) : 11097 - 11114
  • [47] Model-based safety system for the human-robot collaboration - A novel approach towards safe automated assembly within the human-robot collaboration
    Reinhart, G.
    Shen, Y.
    Spillner, R.
    Schilp, J.
    WT Werkstattstechnik, 2012, 102 (06): : 425 - 430
  • [48] Deep Learning-based Human Motion Prediction considering Context Awareness for Human-Robot Collaboration in Manufacturing
    Liu, Zitong
    Liu, Quan
    Xu, Wenjun
    Liu, Zhihao
    Zhou, Zude
    Chen, Jie
    11TH CIRP CONFERENCE ON INDUSTRIAL PRODUCT-SERVICE SYSTEMS, 2019, 83 : 272 - 278
  • [49] Multi-Task Deep Learning-Based Human Intention Prediction for Human-Robot Collaborative Assembly
    Cai, Jiannan
    Liang, Xiaoyun
    Wibranek, Bastian
    Guo, Yuanxiong
    COMPUTING IN CIVIL ENGINEERING 2023-DATA, SENSING, AND ANALYTICS, 2024, : 579 - 587
  • [50] Deep learning-based human motion recognition for predictive context-aware human-robot collaboration
    Wang, Peng
    Liu, Hongyi
    Wang, Lihui
    Gao, Robert X.
    CIRP ANNALS-MANUFACTURING TECHNOLOGY, 2018, 67 (01) : 17 - 20