Reinforcement learning with prior policy guidance for motion planning of dual-arm free-floating space robot

被引:17
|
作者
Cao, Yuxue [1 ]
Wang, Shengjie [2 ]
Zheng, Xiang [3 ]
Ma, Wenke [4 ]
Xie, Xinru [1 ]
Liu, Lei [1 ]
机构
[1] Beijing Inst Control Engn, Beijing, Peoples R China
[2] Tsinghua Univ, Dept Automat, Beijing, Peoples R China
[3] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[4] Qian Xuesen Lab Space Technol, Beijing, Peoples R China
关键词
Compendex;
D O I
10.1016/j.ast.2022.108098
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
Reinforcement learning methods as a promising technique have achieved superior results in the motion planning of free-floating space robots. However, due to the increase in planning dimension and the intensification of system dynamics coupling, the motion planning of dual-arm free-floating space robots remains an open challenge. In particular, the current study cannot handle the task of capturing a noncooperative object due to the lack of the pose constraint of the end-effectors. To address the problem, we propose a novel algorithm, EfficientLPT, to facilitate RL-based methods to improve planning accuracy efficiently. Our core contributions are constructing a mixed policy with prior knowledge guidance and introducing II center dot Iloo to build a more reasonable reward function. Furthermore, our method successfully captures a rotating object with different spinning speeds.(c) 2023 Elsevier Masson SAS. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Spline-RRT*: Coordinated Motion Planning of Dual-Arm Space Robot
    Yu, Min
    Luo, Jianjin
    Wang, Mingming
    Gao, Dengwei
    IFAC PAPERSONLINE, 2020, 53 (02): : 9820 - 9825
  • [32] Trajectory planning and low-chattering fixed-time nonsingular terminal sliding mode control for a dual-arm free-floating space robot
    Yan, Wen
    Liu, Yicheng
    Lan, Qijie
    Zhang, Tao
    Tu, Haiyan
    ROBOTICA, 2022, 40 (03) : 625 - 645
  • [33] Deep reinforcement learning with hindsight experience replay for dual-arm robot trajectory planning
    Li, Shoutao
    Chu, Zhanggen
    Hu, Zhidong
    Liu, Zhenze
    INTERNATIONAL JOURNAL OF INTELLIGENT ROBOTICS AND APPLICATIONS, 2025,
  • [34] Repetitive Motion Planning of Free-Floating Space Manipulators
    Chen, Gang
    Zhang, Long
    Jia, Qingxuan
    Chu, Ming
    Sun, Hanxu
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2013, 10
  • [35] Dual-Arm Robot Motion Planning Based on Cooperative Coevolution
    Curkovic, Petar
    Jerbic, Bojan
    EMERGING TRENDS IN TECHNOLOGICAL INNOVATION, 2010, 314 : 169 - 178
  • [36] Motion Planning with End-Effector Attitude Constraints for Free-Floating Space Robot
    Tang, Yongxing
    Zhu, Zhanxia
    Zhang, Hongwen
    Proceedings of the International Astronautical Congress, IAC, 2021, A6
  • [37] Trajectory Tracking for a Dual-Arm Free-Floating Space Robot With a Class of General Nonsingular Predefined-Time Terminal Sliding Mode
    Liu, Yicheng
    Yan, Wen
    Zhang, Tao
    Yu, Chunxiao
    Tu, Haiyan
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (05): : 3273 - 3286
  • [38] Trajectory Planning of Free-Floating Space Robot Based on Dual-Mode Switching
    Zhu, Zhanxia
    Wu, Tianyi
    Zhang, Guanghui
    Yu, Sigang
    Wang, Mingming
    Yuan, Jianping
    JOURNAL OF AEROSPACE ENGINEERING, 2022, 35 (03)
  • [39] Hybrid simulation of a dual-arm space robot colliding with a floating object
    Takahashi, Ryohei
    Ise, Hiroto
    Konno, Atsushi
    Uchiyama, Masaru
    Sato, Daisuke
    2008 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-9, 2008, : 1201 - +
  • [40] Trajectory Planning with Pose Feedback for a Dual-Arm Space Robot
    Liu, Yicheng
    Xie, Kedi
    Zhang, Tao
    Cai, Ning
    JOURNAL OF CONTROL SCIENCE AND ENGINEERING, 2016, 2016