Hybrid dynamic control algorithm for humanoid robots based on reinforcement learning

被引:14
|
作者
Katic, Dusko M. [1 ]
Rodic, Aleksandar D. [1 ]
Vukobratovic, Miomir K. [1 ]
机构
[1] Mihailo Pupin Inst, Robot Dept, Belgrade 11060, Serbia
关键词
humanoid robots; biped locomotion; integrated dynamic control; reinforcement learning; actor-critic method;
D O I
10.1007/s10846-007-9174-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, hybrid integrated dynamic control algorithm for humanoid locomotion mechanism is presented. The proposed structure of controller involves two feedback loops: model-based dynamic controller including impart-force controller and reinforcement learning feedback controller around zero-moment point. The proposed new reinforcement learning algorithm is based on modified version of actor-critic architecture for dynamic reactive compensation. Simulation experiments were carried out in order to validate the proposed control approach.The obtained simulation results served as the basis for a critical evaluation of the controller performance.
引用
收藏
页码:3 / 30
页数:28
相关论文
共 50 条
  • [31] Motion control for humanoid robots based on the motion phase decision tree learning
    Kuwayama, K
    Kato, H
    Kunitachi, T
    Itoh, H
    PROCEEDINGS OF THE 2004 INTERNATIONAL SYMPOSIUM ON MICRO-NANOMECHATRONICS AND HUMAN SCIENCE, 2004, : 157 - 162
  • [32] Research on Control Strategy of Hybrid Superconducting Energy Storage Based on Reinforcement Learning Algorithm
    Liu, Yang
    Han, Xingfan
    Xing, Zuoxia
    Li, Pengtao
    Liu, Hengyu
    Jiang, Zhanpeng
    IEEE TRANSACTIONS ON APPLIED SUPERCONDUCTIVITY, 2024, 34 (08) : 1 - 4
  • [33] Computational Design of Modular Robots Based on Genetic Algorithm and Reinforcement Learning
    Park, Jai Hoon
    Lee, Kang Hoon
    SYMMETRY-BASEL, 2021, 13 (03):
  • [34] Locomotion Control Method for Humanoid Robot Based on United Hierarchical Reinforcement Learning
    Liu, Boying
    Ma, Lu
    Liu, Chenju
    Xu, BinChen
    2020 IEEE 16TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION (ICCA), 2020, : 1161 - 1166
  • [35] A dynamic simulator for humanoid robots
    Reichenbach, Tomislav
    ARTIFICIAL LIFE AND ROBOTICS, 2009, 13 (02) : 561 - 565
  • [36] DDPG Reinforcement Learning Experiment for Improving the Stability of Bipedal Walking of Humanoid Robots
    Chun, Yeonghun
    Choi, Junghun
    Min, Injoon
    Ahn, Minsung
    Han, Jeakweon
    2023 IEEE/SICE INTERNATIONAL SYMPOSIUM ON SYSTEM INTEGRATION, SII, 2023,
  • [37] A Deep Reinforcement Learning Approach for Dynamically Stable Inverse Kinematics of Humanoid Robots
    Phanitej, A. S.
    Dewangan, Parijat
    Guhan, Pooja
    Sarkar, Abhishek
    Krishna, K. Madhava
    2017 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE ROBIO 2017), 2017, : 1818 - 1823
  • [38] Hybrid Sensor Fusion Mixed with Reinforcement Learning in Autonomous Dual-Arm Lifting Tasks Performed by Humanoid Robots
    Hernandez-Vicen, Juan
    Lukawski, Bartek
    Martinez, Santiago
    Tsagarakis, Nikos
    Balaguer, Carlos
    ROBOTICS, 2024, 13 (08)
  • [39] A novel adaptive control algorithm based on reinforcement learning
    Qian Zheng
    Sun Liang
    Ruan Xiaogang
    Proceedings of the 24th Chinese Control Conference, Vols 1 and 2, 2005, : 651 - 654
  • [40] A Heuristics-Based Reinforcement Learning Method to Control Bipedal Robots
    Qin, Daoling
    Zhang, Guoteng
    Zhu, Zhengguo
    Chen, Teng
    Zhu, Weiliang
    Rong, Xuewen
    Xie, Anhuan
    Li, Yibin
    INTERNATIONAL JOURNAL OF HUMANOID ROBOTICS, 2024, 21 (03)