Hybrid dynamic control algorithm for humanoid robots based on reinforcement learning

被引:14
|
作者
Katic, Dusko M. [1 ]
Rodic, Aleksandar D. [1 ]
Vukobratovic, Miomir K. [1 ]
机构
[1] Mihailo Pupin Inst, Robot Dept, Belgrade 11060, Serbia
关键词
humanoid robots; biped locomotion; integrated dynamic control; reinforcement learning; actor-critic method;
D O I
10.1007/s10846-007-9174-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, hybrid integrated dynamic control algorithm for humanoid locomotion mechanism is presented. The proposed structure of controller involves two feedback loops: model-based dynamic controller including impart-force controller and reinforcement learning feedback controller around zero-moment point. The proposed new reinforcement learning algorithm is based on modified version of actor-critic architecture for dynamic reactive compensation. Simulation experiments were carried out in order to validate the proposed control approach.The obtained simulation results served as the basis for a critical evaluation of the controller performance.
引用
收藏
页码:3 / 30
页数:28
相关论文
共 50 条
  • [21] Dynamic Fall Recovery Control for Legged Robots via Reinforcement Learning
    Li, Sicen
    Pang, Yiming
    Bai, Panju
    Hu, Shihao
    Wang, Liquan
    Wang, Gang
    BIOMIMETICS, 2024, 9 (04)
  • [22] Dynamic fuzzy q-learning control of humanoid robots for automatic gait synthesis
    Zhou, Yi
    Er, Meng Joo
    International Journal of Fuzzy Systems, 2006, 8 (04) : 190 - 199
  • [23] Analysis of Cost Functions for Reinforcement Learning of Reaching Tasks in Humanoid Robots
    Savevska, Kristina
    Ude, Ales
    APPLIED SCIENCES-BASEL, 2024, 14 (01):
  • [24] Predictive Control for Dynamic Locomotion of Real Humanoid Robots
    Piperakis, Stylianos
    Orfanoudakis, Emmanouil
    Lagoudakis, Michail G.
    2014 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2014), 2014, : 4036 - 4043
  • [25] Dynamic Balance Force Control for Compliant Humanoid Robots
    Stephens, Benjamin J.
    Atkeson, Christopher G.
    IEEE/RSJ 2010 INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2010), 2010, : 1248 - 1255
  • [26] Gaze Control-Based Navigation Architecture for Humanoid Robots in a Dynamic Environment
    Yoo, Jeong-Ki
    Kim, Jong-Hwan
    INTELLIGENT AUTONOMOUS SYSTEMS 12, VOL 1, 2013, 193 : 765 - 774
  • [27] Visual Navigation for Biped Humanoid Robots Using Deep Reinforcement Learning
    Lobos-Tsunekawa, Kenzo
    Leiva, Francisco
    Ruiz-del-Solar, Javier
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (04): : 3247 - 3254
  • [28] Deep-reinforcement-learning-based gait pattern controller on an uneven terrain for humanoid robots
    Kuo, Ping-Huan
    Pao, Chieh-Hsiu
    Chang, En-Yi
    Yau, Her-Terng
    INTERNATIONAL JOURNAL OF OPTOMECHATRONICS, 2023, 17 (01)
  • [29] A deep reinforcement learning algorithm to control a two-wheeled scooter with a humanoid robot
    Baltes, Jacky
    Christmann, Guilherme
    Saeedvand, Saeed
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 126
  • [30] A reinforcement learning based dynamic walking control
    Mao, Yong
    Wang, Jiaxin
    Ha, Peifa
    Li, Shi
    Qiu, Zhen
    Zhang, Le
    Han, Zhuo
    PROCEEDINGS OF THE 2007 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-10, 2007, : 3609 - +