Reinforcement learning with prior policy guidance for motion planning of dual-arm free-floating space robot

被引:17
|
作者
Cao, Yuxue [1 ]
Wang, Shengjie [2 ]
Zheng, Xiang [3 ]
Ma, Wenke [4 ]
Xie, Xinru [1 ]
Liu, Lei [1 ]
机构
[1] Beijing Inst Control Engn, Beijing, Peoples R China
[2] Tsinghua Univ, Dept Automat, Beijing, Peoples R China
[3] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[4] Qian Xuesen Lab Space Technol, Beijing, Peoples R China
关键词
Compendex;
D O I
10.1016/j.ast.2022.108098
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
Reinforcement learning methods as a promising technique have achieved superior results in the motion planning of free-floating space robots. However, due to the increase in planning dimension and the intensification of system dynamics coupling, the motion planning of dual-arm free-floating space robots remains an open challenge. In particular, the current study cannot handle the task of capturing a noncooperative object due to the lack of the pose constraint of the end-effectors. To address the problem, we propose a novel algorithm, EfficientLPT, to facilitate RL-based methods to improve planning accuracy efficiently. Our core contributions are constructing a mixed policy with prior knowledge guidance and introducing II center dot Iloo to build a more reasonable reward function. Furthermore, our method successfully captures a rotating object with different spinning speeds.(c) 2023 Elsevier Masson SAS. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] A New Motion Planning Algoritm for Free-Floating Space Robot
    Zhang, Hongwen
    Wang, Zheng
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 3275 - 3280
  • [22] A New Motion Planning Algoritm for Free-Floating Space Robot
    Zhang, Hongwen
    Wang, Zheng
    Proceedings of the 35th Chinese Control and Decision Conference, CCDC 2023, 2023, : 3275 - 3280
  • [23] Dynamic control of a free-floating flexible dual-arm space robotic system
    College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China
    Jixie Gongcheng Xuebao, 2007, 10 (196-200):
  • [24] Constrained motion planning of free-float dual-arm space manipulator via deep reinforcement learning
    Li, Yinkang
    Hao, Xiaolong
    She, Yuchen
    Li, Shuang
    Yu, Meng
    AEROSPACE SCIENCE AND TECHNOLOGY, 2021, 109
  • [25] Modelling and Control of Dual-Arm Free-Floating Space Robot Using Virtual Decomposition Control for Capturing Target
    Wang, Xuectian
    Xia, Bo
    Li, Gang
    Liu, Houde
    Liang, Bin
    2017 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE ROBIO 2017), 2017, : 2021 - 2026
  • [26] The coordinated motion planning of a dual-arm space robot for target capturing
    Xu, Wenfu
    Liu, Yu
    Xu, Yangsheng
    ROBOTICA, 2012, 30 : 755 - 771
  • [27] PLANNING MOTIONS OF A DUAL-ARM FREE-FLOATING MANIPULATOR KEEPING AND BASE INERTIALLY FIXED
    AGRAWAL, SK
    SHIRUMALLA, S
    MECHANISM AND MACHINE THEORY, 1995, 30 (01) : 59 - 70
  • [28] Dynamic Modeling and Control Optimization of Free-Floating Dual-Arm Space Robots in Task Space
    Rodrigues, Gabriel S.
    Pazelli, Tatiana F. P. A. T.
    2021 LATIN AMERICAN ROBOTICS SYMPOSIUM / 2021 BRAZILIAN SYMPOSIUM ON ROBOTICS / 2021 WORKSHOP OF ROBOTICS IN EDUCATION (LARS-SBR-WRE 2021), 2021, : 168 - 173
  • [29] Collision-free motion planning of dual-Arm robot based on C-space
    Ding, F.Q.
    Han, W.J.
    Zhao, X.F.
    Shanghai Jiaotong Daxue Xuebao/Journal of Shanghai Jiaotong University, 2001, 35 (01): : 54 - 58
  • [30] Motion Planning of a Dual-Arm Mobile Robot in the Configuration-Time Space
    Tsai, Yi-Chih
    Huang, Han-Pang
    2009 IEEE-RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, 2009, : 2458 - 2463