Embodied imitation-enhanced reinforcement learning in multi-agent systems

被引:12
|
作者
Erbas, Mehmet D. [1 ]
Winfield, Alan F. T. [2 ]
Bull, Larry [2 ]
机构
[1] Istanbul Kemerburgaz Univ, Fac Engn & Architecture, TR-34217 Istanbul, Turkey
[2] Univ W England, Fac Environm & Technol, Bristol BS16 1QY, Avon, England
基金
英国工程与自然科学研究理事会;
关键词
Embodied imitation; multi-agent systems; reinforcement Q-learning; social learning;
D O I
10.1177/1059712313500503
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Imitation is an example of social learning in which an individual observes and copies another's actions. This paper presents a new method for using imitation as a way of enhancing the learning speed of individual agents that employ a well-known reinforcement learning algorithm, namely Q-learning. Compared with other research that uses imitation with reinforcement learning, our method uses imitation of purely observed behaviours to enhance learning, with no internal state access or sharing of experiences between agents. The paper evaluates our imitation-enhanced reinforcement learning approach in both simulation and with real robots in continuous space. Both simulation and real robot experimental results show that the learning speed of the group is improved. © The Author(s) 2013.
引用
收藏
页码:31 / 50
页数:20
相关论文
共 50 条
  • [1] PRIMAL: Pathfinding via Reinforcement and Imitation Multi-Agent Learning
    Sartoretti, Guillaume
    Kerr, Justin
    Shi, YunFei
    Wagner, Glenn
    Kumar, T. K. Satish
    Koenig, Sven
    Choset, Howie
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2019, 4 (03): : 2378 - 2385
  • [2] Imitation-Enhanced Reinforcement Learning With Privileged Smooth Transition for Hexapod Locomotion
    Zhang, Zhelin
    Liu, Tie
    Ding, Liang
    Wang, Haoyu
    Xu, Peng
    Yang, Huaiguang
    Gao, Haibo
    Deng, Zongquan
    Pajarinen, Joni
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (01): : 350 - 357
  • [3] Developing multi-agent adversarial environment using reinforcement learning and imitation learning
    Han, Ziyao
    Liang, Yupeng
    Ohkura, Kazuhiro
    ARTIFICIAL LIFE AND ROBOTICS, 2023, 28 (04) : 703 - 709
  • [4] Developing multi-agent adversarial environment using reinforcement learning and imitation learning
    Ziyao Han
    Yupeng Liang
    Kazuhiro Ohkura
    Artificial Life and Robotics, 2023, 28 : 703 - 709
  • [5] Coordinated Multi-Agent Imitation Learning
    Le, Hoang M.
    Yue, Yisong
    Carr, Peter
    Lucey, Patrick
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [6] Multi-agent Imitation Learning with Copulas
    Wang, Hongwei
    Yu, Lantao
    Cao, Zhangjie
    Ermon, Stefano
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, 2021, 12975 : 139 - 156
  • [7] On the Mechanisms of Imitation in Multi-Agent Systems
    Erbas, Mehmet D.
    PROCEEDINGS OF 2016 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2016,
  • [8] Cooperative Learning of Multi-Agent Systems Via Reinforcement Learning
    Wang, Xin
    Zhao, Chen
    Huang, Tingwen
    Chakrabarti, Prasun
    Kurths, Juergen
    IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2023, 9 : 13 - 23
  • [9] Towards reinforcement learning for holonic multi-agent systems
    Abdoos, Monireh
    Mozayani, Nasser
    Bazzan, Ana L. C.
    INTELLIGENT DATA ANALYSIS, 2015, 19 (02) : 211 - 232
  • [10] Distributed reinforcement learning in multi-agent decision systems
    Giráldez, JI
    Borrajo, D
    PROGRESS IN ARTIFICIAL INTELLIGENCE-IBERAMIA 98, 1998, 1484 : 148 - 159