Motion Profile Optimization in Industrial Robots using Reinforcement Learning

被引:1
|
作者
Wen, Yunshi [1 ]
He, Honglu [1 ]
Julius, Agung [1 ]
Wen, John T. [1 ]
机构
[1] Rensselaer Polytech Inst, Elect Comp & Syst Engn Dept, Troy, NY 12180 USA
关键词
Reinforcement Learning; Industrial Robot; Motion Primitive; Trajectory Optimization; Trajectory Tracking;
D O I
10.1109/AIM46323.2023.10196247
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Path tracking problems are challenging with the absence of dynamic models and information about robot controllers. This paper presents a method of optimizing a motion profile constructed using a set of pre-defined motion primitives and a speed command to track a spatial trajectory with high accuracy, speed, and uniform motion using industrial robots. We use a bi-level optimization approach that optimizes execution accuracy using reinforcement learning and execution speed using bi-section search. We train and evaluate the reinforcement learning policy in simulation for an ABB robot. Experiment results demonstrate that the learned policy reduces the optimization cost to achieve the desired specifications. Additionally, the trained policy can generalize to trajectories not included in the training set.
引用
收藏
页码:1309 / 1316
页数:8
相关论文
共 50 条
  • [1] Motion Planning for Industrial Robots using Reinforcement Learning
    Meyes, Richard
    Tercan, Hasan
    Roggendorf, Simon
    Thiele, Thomas
    Buescher, Christian
    Obdenbusch, Markus
    Brecher, Christian
    Jeschke, Sabina
    Meisen, Tobias
    MANUFACTURING SYSTEMS 4.0, 2017, 63 : 107 - 112
  • [2] Calculation and Optimization of Industrial Robots Motion
    Ivanov, Sergei
    Ivanova, Lubov
    Meleshkova, Zoia
    PROCEEDINGS OF THE 26TH CONFERENCE OF OPEN INNOVATIONS ASSOCIATION FRUCT, 2020, : 115 - 123
  • [3] Transferring Human Manipulation Knowledge to Industrial Robots Using Reinforcement Learning
    Arana-Arexolaleiba, N.
    Urrestilla-Anguiozar, N.
    Chrysostomou, D.
    Bogh, S.
    29TH INTERNATIONAL CONFERENCE ON FLEXIBLE AUTOMATION AND INTELLIGENT MANUFACTURING (FAIM 2019): BEYOND INDUSTRY 4.0: INDUSTRIAL ADVANCES, ENGINEERING EDUCATION AND INTELLIGENT MANUFACTURING, 2019, 38 : 1508 - 1515
  • [4] Human Motion Control of Quadrupedal Robots using Deep Reinforcement Learning
    Kim, Sunwoo
    Sorokin, Maks
    Lee, Jehee
    Ha, Sehoon
    ROBOTICS: SCIENCE AND SYSTEM XVIII, 2022,
  • [5] Reinforcement learning for motion control of humanoid robots
    Iida, S. (iida@ics.nitech.ac.jp), 2004, Institute of Electrical and Electronics Engineers, IEEE; Robotics Society of Japan, RSJ (Institute of Electrical and Electronics Engineers Inc.):
  • [6] Continuous Motion Planning for Mobile Robots Using Fuzzy Deep Reinforcement Learning
    Wu, Fenghua
    Tang, Wenbing
    Zhou, Yuan
    Lin, Shang-Wei
    Liu, Yang
    Ding, Zuohua
    2024 WRC SYMPOSIUM ON ADVANCED ROBOTICS AND AUTOMATION, WRC SARA, 2024, : 15 - 21
  • [7] Deep reinforcement learning for motion planning of mobile robots
    Sun H.-H.
    Hu C.-H.
    Zhang J.-G.
    Kongzhi yu Juece/Control and Decision, 2021, 36 (06): : 1281 - 1292
  • [8] Hierarchical Free Gait Motion Planning for Hexapod Robots Using Deep Reinforcement Learning
    Wang, Xinpeng
    Fu, Huiqiao
    Deng, Guizhou
    Liu, Canghai
    Tang, Kaiqiang
    Chen, Chunlin
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (11) : 10901 - 10912
  • [9] Motion Planning for 2-DOF Transformable Wheel Robots Using Reinforcement Learning
    Park, Inha
    Ryu, Sijun
    Won, Jeeho
    Yoon, Hyeungyu
    Kim, SangGyun
    Kim, Hwa Soo
    Seo, TaeWon
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (11): : 10193 - 10200
  • [10] Motion Coordination of Multiple Robots Based on Deep Reinforcement Learning
    Hao, Xiuzhao
    Wu, Zhihao
    Zhou, Haiguang
    Bai, Xiangpeng
    Lin, Youfang
    Han, Sheng
    2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 955 - 962