Quadruped Robot Locomotion in Unknown Terrain Using Deep Reinforcement

被引:0
|
作者
Pei, Muleilan [1 ]
Wu, Dongping [1 ]
Wang, Changhong [1 ]
机构
[1] Harbin Inst Technol, Harbin, Peoples R China
关键词
Deep reinliffcement learning; deep deterministic policy gradient; quadruped robot locomotion; unknown terrain;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper is concerned with locomotion problems for the quadruped robot in unknown and unstructured terrains, utilizing the emerging deep reinforcement learning technique. The state-of-the-art deep deterministic policy gradient (DDPG) algorithm is leveraged to acquire the gait policy by learning from interactions with the environment. The framework of learning system is presented based on the actor-critic architecture, and the additional domain-specific knowledge is exploited for shaping the reward function to enhance the learning efficiency during training. Moreover, a simulation study is implemented to validate the performance of the proposed DDPG-based controller.
引用
收藏
页码:517 / 522
页数:6
相关论文
共 50 条
  • [41] Motion Control of a Quadruped Robot in Unknown Rough Terrain using 3D Spring Damper Leg Model
    Duc Trong Tran
    Koo, Ig Mo
    Lee, Yoon Haeng
    Moon, Hyungpil
    Koo, Jachoon
    Park, Sangdeok
    Choi, Hyouk Ryeol
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2014, 12 (02) : 372 - 382
  • [42] Enhancing Biped Locomotion on Unknown Terrain Using Tactile Feedback
    Guadarrama-Olvera, J. Rogelio
    Bergner, Florian
    Dean, Emmanuel
    Cheng, Gordon
    2018 IEEE-RAS 18TH INTERNATIONAL CONFERENCE ON HUMANOID ROBOTS (HUMANOIDS), 2018, : 47 - 52
  • [43] Dual-Layer Reinforcement Learning for Quadruped Robot Locomotion and Speed Control in Complex Environments
    Zhang, Yilin
    Zeng, Jiayu
    Sun, Huimin
    Sun, Honglin
    Hashimoto, Kenji
    APPLIED SCIENCES-BASEL, 2024, 14 (19):
  • [44] Research Article Design and Dynamic Locomotion Control of Quadruped Robot with Perception-Less Terrain Adaptation
    Wang, Lei
    Meng, Libo
    Kang, Ru
    Liu, Botao
    Gu, Sai
    Zhang, Zhihao
    Meng, Fei
    Ming, Aiguo
    CYBORG AND BIONIC SYSTEMS, 2022, 2022
  • [45] Fast Foothold Planning for Quadruped Robot Locomotion Using Topological Perception
    Saputra, Azhar Aulia
    Shoji, Masaya
    Ardilla, Fernando
    Kubota, Naoyuki
    2024 INTERNATIONAL ELECTRONICS SYMPOSIUM, IES 2024, 2024, : 257 - 263
  • [46] Dynamic walking control of quadruped locomotion robot using neural network
    Koyama, Kakutaro
    Nonami, Kenzo
    Nippon Kikai Gakkai Ronbunshu, C Hen/Transactions of the Japan Society of Mechanical Engineers, Part C, 1996, 62 (596): : 1519 - 1526
  • [47] CPG Driven Locomotion Control of Quadruped Robot
    Liu, Chengju
    Chen, Yifei
    Zhang, Jiaqi
    Chen, Qijun
    2009 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC 2009), VOLS 1-9, 2009, : 2368 - 2373
  • [48] FEEDBACK CONTROL OF THE LOCOMOTION OF A TAILED QUADRUPED ROBOT
    Liu, Yujiong
    Ben-Tzvi, Pinhas
    PROCEEDINGS OF ASME 2021 INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, IDETC-CIE2021, VOL 8B, 2021,
  • [49] The Quadruped Robot Locomotion Based on Force Control
    Zhang, Xianpeng
    Lang, Lin
    Wang, Jian
    Ma, Hongxu
    2015 27TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2015, : 5440 - 5445
  • [50] Deep Reinforcement Learning Framework for Underwater Locomotion of Soft Robot
    Li, Guanda
    Shintake, Jun
    Hayashibe, Mitsuhiro
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 12033 - 12039