Reinforcement learning with prior policy guidance for motion planning of dual-arm free-floating space robot

被引:17
|
作者
Cao, Yuxue [1 ]
Wang, Shengjie [2 ]
Zheng, Xiang [3 ]
Ma, Wenke [4 ]
Xie, Xinru [1 ]
Liu, Lei [1 ]
机构
[1] Beijing Inst Control Engn, Beijing, Peoples R China
[2] Tsinghua Univ, Dept Automat, Beijing, Peoples R China
[3] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[4] Qian Xuesen Lab Space Technol, Beijing, Peoples R China
关键词
Compendex;
D O I
10.1016/j.ast.2022.108098
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
Reinforcement learning methods as a promising technique have achieved superior results in the motion planning of free-floating space robots. However, due to the increase in planning dimension and the intensification of system dynamics coupling, the motion planning of dual-arm free-floating space robots remains an open challenge. In particular, the current study cannot handle the task of capturing a noncooperative object due to the lack of the pose constraint of the end-effectors. To address the problem, we propose a novel algorithm, EfficientLPT, to facilitate RL-based methods to improve planning accuracy efficiently. Our core contributions are constructing a mixed policy with prior knowledge guidance and introducing II center dot Iloo to build a more reasonable reward function. Furthermore, our method successfully captures a rotating object with different spinning speeds.(c) 2023 Elsevier Masson SAS. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Motion Optimization of Redundant Free-floating Space Robot in Cartesian Space
    Xie, Zongwu
    Lu, Jiayuan
    Gu, Yikun
    Yang, Haitao
    Zhao, Xiaoyu
    Jin, Minghe
    2017 IEEE INTERNATIONAL CONFERENCE ON REAL-TIME COMPUTING AND ROBOTICS (RCAR), 2017, : 709 - 714
  • [42] Study of path planning of free-floating space robot in cartesin space
    Xu, WF
    Liang, B
    Li, C
    Qiang, WY
    Huang, PF
    Xu, YS
    PROCEEDINGS OF THE SIXTH IASTED INTERNATIONAL CONFERENCE ON ROBOTICS AND APPLICATIONS, 2005, : 52 - 57
  • [43] MRDDPG Algorithms for Path Planning of Free-floating Space Robot
    Hu, Xiaodong
    Huang, Xuexiang
    Hu, Tianjian
    Shi, Zhong
    Hui, Jianjiang
    PROCEEDINGS OF 2018 IEEE 9TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS), 2018, : 1079 - 1082
  • [44] A Multi-Target Trajectory Planning of a 6-DoF Free-Floating Space Robot via Reinforcement Learning
    Wang, Shengjie
    Zheng, Xiang
    Cao, Yuxue
    Zhang, Tao
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 3724 - 3730
  • [45] Collision-free path planning of dual-arm robot
    Chen, Feng
    Ding, Fu-Qiang
    Zhao, Xi-Fang
    Jiqiren/Robot, 2002, 24 (02):
  • [46] Dual-Arm Robot Trajectory Planning Based on Deep Reinforcement Learning under Complex Environment
    Tang, Wanxing
    Cheng, Chuang
    Ai, Haiping
    Chen, Li
    MICROMACHINES, 2022, 13 (04)
  • [47] Coordinated control of free-floating dual-arm space robots based on hybrid task-priority approach
    Hong, Mengqing
    Zhou, Hui
    Liu, Liaoxue
    Guo, Yu
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART G-JOURNAL OF AEROSPACE ENGINEERING, 2022, 236 (11) : 2206 - 2217
  • [48] Non-inverse kinematics of free-floating space robot based on motion planning of sampling
    Zhang H.
    Zhu Z.
    Yuan J.
    Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University, 2021, 39 (05): : 1005 - 1011
  • [49] Sampling-Based Motion Planning for Free-Floating Space Robot without Inverse Kinematics
    Zhang, Hongwen
    Zhu, Zhanxia
    APPLIED SCIENCES-BASEL, 2020, 10 (24): : 1 - 21
  • [50] Motion Planning of Free-Floating Space Robot Based on Gauss pseudo-spectral method
    Liu Haitao
    Yang Leping
    Zhang Qingbin
    Zhu Yanwei
    Ren Xianhai
    PROCEEDINGS OF THE 31ST CHINESE CONTROL CONFERENCE, 2012, : 4825 - 4829