Bipedal Walking Robot Control Using PMTG Architecture

被引:0
|
作者
Danilov, Vladimir [1 ,3 ]
Klimov, Konstantin [2 ,3 ]
Kapytov, Dmitrii [2 ,3 ]
Diane, Sekou [1 ]
机构
[1] Russian Acad Sci, Inst Control Problems, Moscow, Russia
[2] Moscow MV Lomonosov State Univ, Robot Lab, Inst Mech Lomonosov, Michurinsky Prosp 1, Moscow 119192, Russia
[3] Voltbro LCC, Moscow, Russia
关键词
Reinforcement learning; Locomotion; CPG; Walking robot; LOCOMOTION;
D O I
10.1007/978-3-031-47272-5_8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Reinforcement learning based methods can achieve excellent results for robot locomotion control. However, their serious disadvantage is the long agent training time and large number of parameters defining its behavior. In this paper, we propose a method that significantly reduces training time. It is based on the Policy Modulating Trajectory Generator (PMTG) architecture, which uses Central Pattern Generators (CPG) as a gait generator. We tested this approach on an OpenAI BipedalWalker-v3 environment. The paper presents the results of this algorithm, showing its effectiveness in solving a locomotion problem over challenging terrain.
引用
收藏
页码:89 / 100
页数:12
相关论文
共 50 条
  • [41] On the interaction between the human and the robot in bipedal walking
    Azevedo, C
    CLIMBING AND WALKING ROBOTS, 2001, : 33 - 38
  • [42] Bipedal robot walking control on inclined planes by fuzzy reference trajectory modification
    Utku Seven
    Tunc Akbas
    Kaan Can Fidan
    Kemalettin Erbatur
    Soft Computing, 2012, 16 : 1959 - 1976
  • [43] Linear viscoelastic actuator-based control system of a bipedal walking robot
    Berbyuk, V
    Peterson, B
    Nishchenko, N
    MECHATRONICS '98, 1998, : 379 - 384
  • [44] Control of Bipedal Walking Robot through Direct Regulation of the Zero Moment Point
    Yazdekhasti, Setareh
    Shahgholian, Ghazanfar
    SECOND INTERNATIONAL CONFERENCE ON COMPUTER AND ELECTRICAL ENGINEERING, VOL 1, PROCEEDINGS, 2009, : 40 - 44
  • [45] Integrated motion control for walking, jumping and running on a small bipedal entertainment robot
    Nagasaka, K
    Kuroki, Y
    Suzuki, S
    Itoh, Y
    Yamaguchi, J
    2004 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1- 5, PROCEEDINGS, 2004, : 3189 - 3194
  • [46] Walking Control of Bipedal Robot on Soft Ground Considering Ground Reaction Force
    Komuta, Masahiro
    Abe, Yoshitaka
    Katsura, Seiichiro
    2017 IEEE/SICE INTERNATIONAL SYMPOSIUM ON SYSTEM INTEGRATION (SII), 2017, : 318 - 323
  • [47] Quasi real-time walking control of a bipedal humanoid robot - Based on walking pattern synthesis
    Setiawan, SA
    Hyon, SH
    Yamaguchi, J
    Takanishi, A
    EXPERIMENTAL ROBOTICS VI, 2000, 250 : 309 - 318
  • [48] Control architecture and walking strategy for a pneumatic biped robot
    Spampinato, G.
    Muscato, G.
    CLIMBING AND WALKING ROBOTS, 2006, : 269 - 276
  • [49] Postural Control in a Bipedal Robot using Sensory Reweighting
    Klein, Theresa J.
    Lewis, M. Anthony
    Jeka, John
    Kiemel, Tim
    2011 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2011, : 2053 - 2058
  • [50] Using parallel joint compliance to reduce the cost of walking in a planar bipedal robot
    Yang, T.
    Westervelt, E. R.
    Schmiedeler, J. P.
    PROCEEDINGS OF THE ASME INTERNATIONAL MECHANICAL ENGINERING CONGRESS AND EXPOSITION 2007, VOL 9, PTS A-C: MECHANICAL SYSTEMS AND CONTROL, 2008, : 1225 - 1231