Quadruped Robot Locomotion in Unknown Terrain Using Deep Reinforcement

被引:0
|
作者
Pei, Muleilan [1 ]
Wu, Dongping [1 ]
Wang, Changhong [1 ]
机构
[1] Harbin Inst Technol, Harbin, Peoples R China
关键词
Deep reinliffcement learning; deep deterministic policy gradient; quadruped robot locomotion; unknown terrain;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper is concerned with locomotion problems for the quadruped robot in unknown and unstructured terrains, utilizing the emerging deep reinforcement learning technique. The state-of-the-art deep deterministic policy gradient (DDPG) algorithm is leveraged to acquire the gait policy by learning from interactions with the environment. The framework of learning system is presented based on the actor-critic architecture, and the additional domain-specific knowledge is exploited for shaping the reward function to enhance the learning efficiency during training. Moreover, a simulation study is implemented to validate the performance of the proposed DDPG-based controller.
引用
收藏
页码:517 / 522
页数:6
相关论文
共 50 条
  • [31] Contact detection with multi-information fusion for quadruped robot locomotion under unstructured terrain
    Han, Yangyang
    Lu, Zhenyu
    Liu, Guoping
    Zong, Huaizhi
    Zhong, Feifei
    Zhou, Shengyun
    Chen, Zekang
    FRONTIERS OF MECHANICAL ENGINEERING, 2023, 18 (03)
  • [32] Terrain Adaption Controller for a Walking Excavator Robot using Deep Reinforcement Learning
    Babu, Ajish
    Kirchner, Frank
    2021 20TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS (ICAR), 2021, : 64 - 70
  • [33] Fast, Robust Quadruped Locomotion over Challenging Terrain
    Kalakrishnan, Mrinal
    Buchli, Jonas
    Pastor, Peter
    Mistry, Michael
    Schaal, Stefan
    2010 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2010, : 2665 - 2670
  • [34] Rolling based locomotion on rough terrain for a wheeled quadruped using centroidal dynamics
    Du, Wenqian
    Fnadi, Mohamed
    Benamar, Faiz
    MECHANISM AND MACHINE THEORY, 2020, 153 (153)
  • [35] A control architecture for quadruped locomotion over rough terrain
    Kolter, J. Zico
    Rodgers, Mike R.
    Ng, Andrew Y.
    2008 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-9, 2008, : 811 - 818
  • [36] Blind Hexapod Locomotion in Complex Terrain with Gait Adaptation Using Deep Reinforcement Learning and Classification
    Teymur Azayev
    Karel Zimmerman
    Journal of Intelligent & Robotic Systems, 2020, 99 : 659 - 671
  • [37] Controlling the Solo12 quadruped robot with deep reinforcement learning
    Aractingi, Michel
    Leziart, Pierre-Alexandre
    Flayols, Thomas
    Perez, Julien
    Silander, Tomi
    Soueres, Philippe
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [38] Controlling the Solo12 quadruped robot with deep reinforcement learning
    Michel Aractingi
    Pierre-Alexandre Léziart
    Thomas Flayols
    Julien Perez
    Tomi Silander
    Philippe Souères
    Scientific Reports, 13
  • [39] Blind Hexapod Locomotion in Complex Terrain with Gait Adaptation Using Deep Reinforcement Learning and Classification
    Azayev, Teymur
    Zimmerman, Karel
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2020, 99 (3-4) : 659 - 671
  • [40] Motion control of a quadruped robot in unknown rough terrain using 3D spring damper leg model
    Duc Trong Tran
    Ig Mo Koo
    Yoon Haeng Lee
    Hyungpil Moon
    Jachoon Koo
    Sangdeok Park
    Hyouk Ryeol Choi
    International Journal of Control, Automation and Systems, 2014, 12 : 372 - 382