Bipedal Walking Robot Control Using PMTG Architecture

被引:0
|
作者
Danilov, Vladimir [1 ,3 ]
Klimov, Konstantin [2 ,3 ]
Kapytov, Dmitrii [2 ,3 ]
Diane, Sekou [1 ]
机构
[1] Russian Acad Sci, Inst Control Problems, Moscow, Russia
[2] Moscow MV Lomonosov State Univ, Robot Lab, Inst Mech Lomonosov, Michurinsky Prosp 1, Moscow 119192, Russia
[3] Voltbro LCC, Moscow, Russia
关键词
Reinforcement learning; Locomotion; CPG; Walking robot; LOCOMOTION;
D O I
10.1007/978-3-031-47272-5_8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Reinforcement learning based methods can achieve excellent results for robot locomotion control. However, their serious disadvantage is the long agent training time and large number of parameters defining its behavior. In this paper, we propose a method that significantly reduces training time. It is based on the Policy Modulating Trajectory Generator (PMTG) architecture, which uses Central Pattern Generators (CPG) as a gait generator. We tested this approach on an OpenAI BipedalWalker-v3 environment. The paper presents the results of this algorithm, showing its effectiveness in solving a locomotion problem over challenging terrain.
引用
收藏
页码:89 / 100
页数:12
相关论文
共 50 条
  • [31] Controller Design for a Bipedal Walking Robot using Variable Stiffness Actuators
    Ketelaar, J. G.
    Visser, L. C.
    Stramigioli, S.
    Carloni, R.
    2013 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2013, : 5642 - 5647
  • [32] A Review of Computational Model for Bipedal Robot Walking Using Gait Analysis
    Kumar, Manoj
    Gautam, Pratiksha
    Semwal, Vijay Bhaskar
    2020 INTERNATIONAL CONFERENCE ON EMERGING SMART COMPUTING AND INFORMATICS (ESCI), 2020, : 289 - 292
  • [33] Rough Terrain Walking for Bipedal Robot by Using ZMP Criteria Map
    Takubo, Tomohito
    Imada, Yoshinori
    Ohara, Kenichi
    Mae, Yasushi
    Arai, Tatsuo
    ICRA: 2009 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-7, 2009, : 3715 - 3720
  • [34] Push Recovery Controller for Bipedal Robot Walking
    Adiwahono, Albertus Hendrawan
    Chew, Chee-Meng
    Huang, Weiwei
    Zheng, Yu
    2009 IEEE/ASME INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS, VOLS 1-3, 2009, : 162 - 167
  • [35] Bipedal Walking Robot Driven by Elastic Cables
    Kljuno, Elvedin
    Williams, Robert L., III
    Zhu, Jim
    PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE 2012, VOL 4, PTS A AND B, 2012, : 1365 - +
  • [36] Study of the Characteristics of Bipedal Walking Robot Actuators
    Malchikov, A.
    Yatsun, A.
    Yatsun, S.
    Savin, S.
    2018 INTERNATIONAL CONFERENCE ON INDUSTRIAL ENGINEERING, APPLICATIONS AND MANUFACTURING (ICIEAM), 2018,
  • [37] Bipedal robot walking control on inclined planes by fuzzy reference trajectory modification
    Seven, Utku
    Akbas, Tunc
    Fidan, Kaan Can
    Erbatur, Kemalettin
    SOFT COMPUTING, 2012, 16 (11) : 1959 - 1976
  • [38] Experimental research of control moment gyroscope effect on bipedal robot walking trajectory
    Eray Yılmazlar
    Hilmi Kuşçu
    Journal of the Brazilian Society of Mechanical Sciences and Engineering, 2025, 47 (4)
  • [39] FLoW bipedal robot : Walking Pattern Generation
    Khomariah, Nuril Esti
    Pramadihanto, Dadet
    Dewanto, Raden Sanggar
    2015 INTERNATIONAL ELECTRONICS SYMPOSIUM (IES), 2015, : 73 - 78
  • [40] Dynamic Walking with Compliance on a Cassie Bipedal Robot
    Reher, Jacob
    Ma, Wen-Loong
    Ames, Aaron D.
    2019 18TH EUROPEAN CONTROL CONFERENCE (ECC), 2019, : 2589 - 2595