Hybrid dynamic control algorithm for humanoid robots based on reinforcement learning

被引:14
|
作者
Katic, Dusko M. [1 ]
Rodic, Aleksandar D. [1 ]
Vukobratovic, Miomir K. [1 ]
机构
[1] Mihailo Pupin Inst, Robot Dept, Belgrade 11060, Serbia
关键词
humanoid robots; biped locomotion; integrated dynamic control; reinforcement learning; actor-critic method;
D O I
10.1007/s10846-007-9174-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, hybrid integrated dynamic control algorithm for humanoid locomotion mechanism is presented. The proposed structure of controller involves two feedback loops: model-based dynamic controller including impart-force controller and reinforcement learning feedback controller around zero-moment point. The proposed new reinforcement learning algorithm is based on modified version of actor-critic architecture for dynamic reactive compensation. Simulation experiments were carried out in order to validate the proposed control approach.The obtained simulation results served as the basis for a critical evaluation of the controller performance.
引用
收藏
页码:3 / 30
页数:28
相关论文
共 50 条
  • [41] Optimization Control of Attitude Stability for Hexapod Robots Based on Reinforcement Learning
    Ji, Shujie
    Wei, Wu
    Liu, Xiongding
    Wu, Junqi
    IEEE ACCESS, 2024, 12 : 156363 - 156377
  • [42] Hybrid algorithm based on reinforcement learning for smart inventory management
    Cuartas, Carlos
    Aguilar, Jose
    JOURNAL OF INTELLIGENT MANUFACTURING, 2023, 34 (01) : 123 - 149
  • [43] The Vector Control Scheme for Amphibious Spherical Robots Based on Reinforcement Learning
    Yin, He
    Guo, Shuxiang
    Shi, Liwei
    Zhou, Mugen
    Hou, Xihuan
    Li, Zan
    Xia, Debin
    2021 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (IEEE ICMA 2021), 2021, : 594 - 599
  • [44] Hybrid algorithm based on reinforcement learning for smart inventory management
    Carlos Cuartas
    Jose Aguilar
    Journal of Intelligent Manufacturing, 2023, 34 : 123 - 149
  • [45] A hybrid transfer algorithm for reinforcement learning based on spectral method
    Zhu, M.-Q. (zhumeiqiang@cumt.edu.cn), 1765, Science Press (38):
  • [46] Self-learning control of cooperative motion for humanoid robots
    School of Mechatronics, Changwon National University, 9 Sarimdong, Changwon 641-773, Korea, Republic of
    不详
    Int. J. Control Autom. Syst., 2006, 6 (725-735):
  • [47] Intelligent Fuzzy Q-Learning control of humanoid robots
    Er, MJ
    Zhou, Y
    ADVANCES IN NEURAL NETWORKS - ISNN 2005, PT 3, PROCEEDINGS, 2005, 3498 : 216 - 221
  • [48] Self-learning control of cooperative motion for humanoid robots
    Hwang, Yoon-Kwon
    Choi, Kook-An
    Hong, Dae-Sun
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2006, 4 (06) : 725 - 735
  • [49] Manipulation Learning on Humanoid Robots
    Andrej Gams
    Tadej Petrič
    Bojan Nemec
    Aleš Ude
    Current Robotics Reports, 2022, 3 (3): : 97 - 109
  • [50] Statistical learning for humanoid robots
    Vijayakumar, S
    D'souza, A
    Shibata, T
    Conradt, J
    Schaal, S
    AUTONOMOUS ROBOTS, 2002, 12 (01) : 55 - 69