Cooperative Action Acquisition Based on Intention Estimation in a Multi-Agent Reinforcement Learning System

被引:1
|
作者
Tsubakimoto, Tatsuya [1 ]
Kobayashi, Kunikazu [1 ]
机构
[1] Aichi Prefectural Univ, Sch Informat Sci & Technol, Nagakute, Aichi, Japan
关键词
multi-agent; reinforcement learning; Q-learning; cooperation; intention estimation;
D O I
10.1002/ecj.11821
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we propose a method to acquire a series of cooperative actions to reach an appropriate goal without the designer controlling the reward. To accomplish this, we introduce a new concept of "reward interpretation." This is the idea that an agent can increase or decrease the reward given by the environment through the reward interpretation on its won. We applied this idea to the Q-learning method. The simulation results show that the proposed method is superior to a standard Q-learning method and a Q-learning method with cooperation in terms of the number of successful instances of cooperation. (C) 2017 Wiley Periodicals, Inc.
引用
收藏
页码:3 / 10
页数:8
相关论文
共 50 条
  • [1] Cooperative Action Acquisition Based on Intention Estimation Method in a Multi-agent Reinforcement Learning System
    Tsubakimoto, Tatsuya
    Kobayashi, Kunikazu
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON ARTIFICIAL LIFE AND ROBOTICS (ICAROB 2014), 2014, : 122 - 125
  • [2] Fast reinforcement learning approach to cooperative behavior acquisition in multi-agent system
    Piao, S
    Hong, B
    2002 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-3, PROCEEDINGS, 2002, : 871 - 875
  • [3] Closely Cooperative Multi-Agent Reinforcement Learning Based on Intention Sharing and Credit Assignment
    Fu, Hao
    You, Mingyu
    Zhou, Hongjun
    He, Bin
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (12): : 11770 - 11777
  • [4] The Cooperative Reinforcement Learning in a Multi-Agent Design System
    Liu, Hong
    Wang, Jihua
    PROCEEDINGS OF THE 2013 IEEE 17TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN (CSCWD), 2013, : 139 - 144
  • [5] Cooperative Multi-Agent Reinforcement Learning in Express System
    Li, Yexin
    Zheng, Yu
    Yang, Qiang
    CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 805 - 814
  • [6] Action Prediction for Cooperative Exploration in Multi-agent Reinforcement Learning
    Zhang, Yanqiang
    Feng, Dawei
    Ding, Bo
    NEURAL INFORMATION PROCESSING, ICONIP 2023, PT II, 2024, 14448 : 358 - 372
  • [7] Cooperative Behavior Acquisition in Multi-agent Reinforcement Learning System Using Attention Degree
    Kobayashi, Kunikazu
    Kurano, Tadashi
    Kuremoto, Takashi
    Obayashi, Masanao
    NEURAL INFORMATION PROCESSING, ICONIP 2012, PT III, 2012, 7665 : 537 - 544
  • [8] Multi-agent Cooperative Search based on Reinforcement Learning
    Sun, Yinjiang
    Zhang, Rui
    Liang, Wenbao
    Xu, Cheng
    PROCEEDINGS OF 2020 3RD INTERNATIONAL CONFERENCE ON UNMANNED SYSTEMS (ICUS), 2020, : 891 - 896
  • [9] Cooperative multi-agent game based on reinforcement learning
    Liu, Hongbo
    HIGH-CONFIDENCE COMPUTING, 2024, 4 (01):
  • [10] Multi-agent cooperative learning research based on reinforcement learning
    Liu, Fei
    Zeng, Guangzhou
    2006 10TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, PROCEEDINGS, VOLS 1 AND 2, 2006, : 1408 - 1413