Integrating Uncertainty-Aware Human Motion Prediction Into Graph-Based Manipulator Motion Planning

被引:0
|
作者
Liu, Wansong [1 ]
Eltouny, Kareem [2 ]
Tian, Sibo [3 ]
Liang, Xiao [4 ]
Zheng, Minghui [3 ]
机构
[1] Univ Buffalo, Mech & Aerosp Engn Dept, Buffalo, NY 14260 USA
[2] Univ Buffalo, Civil Struct & Environm Engn Dept, Buffalo, NY 14260 USA
[3] Texas A&M Univ, J Mike Walker Dept Mech Engn 66, College Stn, TX 77840 USA
[4] Texas A&M Univ, Zachry Dept Civil & Environm Engn, College Stn, TX 77840 USA
基金
美国国家科学基金会;
关键词
Planning; Predictive models; Robots; Uncertainty; Trajectory; Manipulators; Robot motion; Graph neural network; human motion prediction; motion planning; SAFETY; MODEL;
D O I
10.1109/TMECH.2024.3402682
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
There has been a growing utilization of industrial robots as complementary collaborators for human workers in remanufacturing sites. Such a human-robot collaboration (HRC) aims to assist human workers in improving the flexibility and efficiency of labor-intensive tasks. In this article, we propose a human-aware motion planning framework for HRC to effectively compute collision-free motions for manipulators when conducting collaborative tasks with humans. We employ a neural human motion prediction model to enable proactive planning for manipulators. Particularly, rather than blindly trusting and utilizing predicted human trajectories in the manipulator planning, we quantify uncertainties of the neural prediction model to further ensure human safety. Moreover, we integrate the uncertainty-aware prediction into a graph that captures key workspace elements and illustrates their interconnections. Then, a graph neural network (GNN) is leveraged to operate on the constructed graph. Consequently, robot motion planning considers both the dependencies among all the elements in the workspace and the potential influence of future movements of human workers. We experimentally validate the proposed planning framework using a 6-degree-of-freedom manipulator in a shared workspace where a human is performing disassembling tasks. The results demonstrate the benefits of our approach in terms of improving the smoothness and safety of HRC. A brief video introduction of this work is available as the supplemental materials.
引用
收藏
页码:3128 / 3136
页数:9
相关论文
共 50 条
  • [41] An Uncertainty-Aware Hybrid Approach for Sea State Estimation Using Ship Motion Responses
    Han, Peihua
    Li, Guoyuan
    Cheng, Xu
    Skjong, Stian
    Zhang, Houxiang
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (02) : 891 - 900
  • [42] Motion Model for Positioning with Graph-Based Indoor Map
    Nurminen, Henri
    Koivisto, Mike
    Ali-Loytty, Simo
    Piche, Robert
    2014 INTERNATIONAL CONFERENCE ON INDOOR POSITIONING AND INDOOR NAVIGATION (IPIN), 2014, : 646 - 655
  • [43] Human-Aware Motion Planning Based On Search And Sampling Approach
    Luo, Ren C.
    Huang, Charly
    2016 IEEE WORKSHOP ON ADVANCED ROBOTICS AND ITS SOCIAL IMPACTS (ARSO), 2016, : 226 - 231
  • [44] Context-aware Human Motion Prediction
    Corona, Enric
    Pumarola, Albert
    Alenya, Guillem
    Moreno-Noguer, Francesc
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6990 - 6999
  • [45] Adaptive Motion Planning for a Collaborative Robot Based on Prediction Uncertainty to Enhance Human Safety and Work Efficiency
    Kanazawa, Akira
    Kinugawa, Jun
    Kosuge, Kazuhiro
    IEEE TRANSACTIONS ON ROBOTICS, 2019, 35 (04) : 817 - 832
  • [46] Behavior and Interaction-aware Motion Planning for Autonomous Driving Vehicles based on Hierarchical Intention and Motion Prediction
    Li, Dachuan
    Wu, Yunjiang
    Bai, Bing
    Hao, Qi
    2020 IEEE 23RD INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2020,
  • [47] A Human-Following Motion Planning and Control Scheme for Collaborative Robots Based on Human Motion Prediction
    Khawaja, Fahad Iqbal
    Kanazawa, Akira
    Kinugawa, Jun
    Kosuge, Kazuhiro
    SENSORS, 2021, 21 (24)
  • [48] Novel Planning-based Algorithms for Human Motion Prediction
    Vasquez, Dizan
    2016 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2016, : 3317 - 3322
  • [49] Design of a Low-complexity Graph-Based Motion-Planning Algorithm for Autonomous Vehicles
    Hegedus, Tamas
    Nemeth, Balazs
    Gaspar, Peter
    APPLIED SCIENCES-BASEL, 2020, 10 (21): : 1 - 21
  • [50] Motion planning in dynamic environments using context-aware human trajectory prediction
    Finean, Mark Nicholas
    Petrovic, Luka
    Merkt, Wolfgang
    Markovic, Ivan
    Havoutis, Ioannis
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2023, 166