Bipedal Walking Robot Control Using PMTG Architecture

被引:0
|
作者
Danilov, Vladimir [1 ,3 ]
Klimov, Konstantin [2 ,3 ]
Kapytov, Dmitrii [2 ,3 ]
Diane, Sekou [1 ]
机构
[1] Russian Acad Sci, Inst Control Problems, Moscow, Russia
[2] Moscow MV Lomonosov State Univ, Robot Lab, Inst Mech Lomonosov, Michurinsky Prosp 1, Moscow 119192, Russia
[3] Voltbro LCC, Moscow, Russia
关键词
Reinforcement learning; Locomotion; CPG; Walking robot; LOCOMOTION;
D O I
10.1007/978-3-031-47272-5_8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Reinforcement learning based methods can achieve excellent results for robot locomotion control. However, their serious disadvantage is the long agent training time and large number of parameters defining its behavior. In this paper, we propose a method that significantly reduces training time. It is based on the Policy Modulating Trajectory Generator (PMTG) architecture, which uses Central Pattern Generators (CPG) as a gait generator. We tested this approach on an OpenAI BipedalWalker-v3 environment. The paper presents the results of this algorithm, showing its effectiveness in solving a locomotion problem over challenging terrain.
引用
收藏
页码:89 / 100
页数:12
相关论文
共 50 条
  • [21] Analysis and construction of a bipedal walking robot
    2017, Institute of Electrical and Electronics Engineers Inc., United States (2018-January):
  • [22] Bipedal Walking Robot - A Developmental Design
    Warnakulasooriya, Sujan
    Bagheri, Amin
    Sherburn, Nathan
    Shanmugavel, Madhavan
    INTERNATIONAL SYMPOSIUM ON ROBOTICS AND INTELLIGENT SENSORS 2012 (IRIS 2012), 2012, 41 : 1016 - 1021
  • [23] DERIVATION OF OPTIMAL WALKING MOTIONS FOR A BIPEDAL WALKING ROBOT
    CHANNON, PH
    HOPKINS, SH
    PHAM, DT
    ROBOTICA, 1992, 10 : 165 - 172
  • [24] Stable adaptive control of a bipedal walking robot with CMAC neural networks
    Hu, Jianjuen
    Pratt, Jerry
    Pratt, Gill
    Proceedings - IEEE International Conference on Robotics and Automation, 1999, 2 : 1050 - 1056
  • [25] Stable adaptive control of a bipedal walking robot with CMAC neural networks
    Hu, JJ
    Pratt, J
    Pratt, G
    ICRA '99: IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-4, PROCEEDINGS, 1999, : 1050 - 1056
  • [26] Feedback Control of a Cassie Bipedal Robot: Walking, Standing, and Riding a Segway
    Gong, Yukai
    Hartley, Ross
    Da, Xingye
    Hereid, Ayonga
    Harib, Omar
    Huang, Jiunn-Kai
    Grizzle, Jessy
    2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 4559 - 4566
  • [27] Impedance and Force Compliant Control for Bipedal Robot Walking on Uneven Terrain
    Luo, Ren C.
    Lin, Siang Jiang
    2015 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2015): BIG DATA ANALYTICS FOR HUMAN-CENTRIC SYSTEMS, 2015, : 228 - 233
  • [28] Dynamic control of a bipedal walking robot actuated with pneumatic artificial muscles
    Vanderborght, B
    Verrelst, B
    Van Ham, R
    Vermeulen, J
    Lefeber, D
    2005 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), VOLS 1-4, 2005, : 1 - 6
  • [29] Bipedal Robot Locomotion Using Multivariable Control
    Aclan, Meinard C.
    Ramos, Manuel C., Jr.
    TENCON 2009 - 2009 IEEE REGION 10 CONFERENCE, VOLS 1-4, 2009, : 152 - 157
  • [30] Bipedal walking on rough terrain using manifold control
    Erez, Tom
    Smart, William D.
    2007 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-9, 2007, : 1545 - 1550