An AR-assisted Deep Reinforcement Learning-based approach towards mutual-cognitive safe human-robot interaction

被引:51
|
作者
Li, Chengxi [1 ,2 ]
Zheng, Pai [1 ,2 ]
Yin, Yue [1 ]
Pang, Yat Ming [1 ,2 ]
Huo, Shengzeng [1 ,3 ]
机构
[1] Hong Kong Polytech Univ, Dept Ind & Syst Engn, Hong Kong, Peoples R China
[2] Hong Kong Sci Pk, Lab Artificial Intelligence Design, Hong Kong, Peoples R China
[3] Hong Kong Polytech Univ, Dept Mech Engn, Hong Kong, Peoples R China
关键词
Smart manufacturing; Human robot interaction; Augmented reality; Deep reinforcement learning; Manufacturing safety;
D O I
10.1016/j.rcim.2022.102471
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
With the emergence of Industry 5.0, the human-centric manufacturing paradigm requires manufacturing equipment (robots, etc.) interactively assist human workers to deal with dynamic and complex production tasks. To achieve symbiotic human-robot interaction (HRI), the safety issue serves as a prerequisite foundation. Regarding the growing individualized demand of manufacturing tasks, the conventional rule-based safe HRI measures could not well address the safety requirements due to inflexibility and lacking synergy. To fill the gap, this work proposes a mutual-cognitive safe HRI approach including worker visual augmentation, robot velocity control, Digital Twin-enabled motion preview and collision detection, and Deep Reinforcement Learning-based robot collision avoidance motion planning in the Augmented Reality-assisted manner. Finally, the feasibility of the system design and the performance of the proposed approach are validated by establishing and executing the prototype HRI system in a practical scene.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Prediction-Based Path Planning for Safe and Efficient Human-Robot Collaboration in Construction via Deep Reinforcement Learning
    Cai, Jiannan
    Du, Ao
    Liang, Xiaoyun
    Li, Shuai
    JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2023, 37 (01)
  • [32] Machine Learning-Based Cognitive Position and Force Controls for Power-Assisted Human-Robot Collaborative Manipulation
    Rahman, S. M. Mizanoor
    MACHINES, 2021, 9 (02) : 1 - 20
  • [33] Iterative Learning-Based Robotic Controller With Prescribed Human-Robot Interaction Force
    Xing, Xueyan
    Maqsood, Kamran
    Huang, Deqing
    Yang, Chenguang
    Li, Yanan
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2022, 19 (04) : 3395 - 3408
  • [34] Demonstration-Guided Deep Reinforcement Learning of Control Policies for Dexterous Human-Robot Interaction
    Christen, Sammy
    Stevsic, Stefan
    Hilliges, Otmar
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 2161 - 2167
  • [35] Adaptive Admittance Control for Physical Human-Robot Interaction based on Imitation and Reinforcement Learning
    Guo, Mou
    Yao, Bitao
    Ji, Zhenrui
    Xu, Wenjun
    Zhou, Zude
    2023 29TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE, M2VIP 2023, 2023,
  • [36] Human-Robot Interaction Based on Facial Expression Recognition Using Deep Learning
    Maeda, Yoichiro
    Sakai, Tensei
    Kamei, Katsuari
    Cooper, Eric W.
    2020 JOINT 11TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS AND 21ST INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (SCIS-ISIS), 2020, : 211 - 216
  • [37] Task Decoupling in Preference-based Reinforcement Learning for Personalized Human-Robot Interaction
    Liu, Mingjiang
    Chen, Chunlin
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 848 - 855
  • [38] Deep Reinforcement Learning-Based Optimization for IRS-Assisted Cognitive Radio Systems
    Zhong, Canwei
    Cui, Miao
    Zhang, Guangchi
    Wu, Qingqing
    Guan, Xinrong
    Chu, Xiaoli
    Poor, H. Vincent
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2022, 70 (06) : 3849 - 3864
  • [39] Intention and Engagement Recognition for Personalized Human-Robot Interaction, an integrated and Deep Learning approach
    Pattar, Suraj Prakash
    Coronado, Enrique
    Ardila, Liz Rincon
    Venture, Gentiane
    2019 IEEE 4TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2019), 2019, : 93 - 98
  • [40] An adaptive reinforcement learning-based multimodal data fusion framework for human-robot confrontation gaming
    Qi, Wen
    Fan, Haoyu
    Karimi, Hamid Reza
    Su, Hang
    NEURAL NETWORKS, 2023, 164 : 489 - 496