A Timestamp-Based Inertial Best-Response Dynamics for Distributed Nash Equilibrium Seeking in Weakly Acyclic Games

被引:7
|
作者
Tan, Shaolin [1 ]
Fang, Zhihong [1 ]
Wang, Yaonan [1 ]
Lu, Jinhu [2 ]
机构
[1] Hunan Univ, Coll Elect & Informat Engn, Changsha 410082, Peoples R China
[2] Beihang Univ, Beijing Adv Innovat Ctr Big Data & Brain Machine, Sch Automat Sci & Elect Engn, State Key Lab Software Dev Environm, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Games; Nash equilibrium; Heuristic algorithms; Convergence; Communication networks; Protocols; Learning systems; Best-response dynamics; distributed Nash equilibrium seeking; finite games; game-theoretic learning; CONVERGENCE; CONSENSUS; PLAY;
D O I
10.1109/TNNLS.2022.3183250
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this article, we consider the problem of distributed game-theoretic learning in games with finite action sets. A timestamp-based inertial best-response dynamics is proposed for Nash equilibrium seeking by players over a communication network. We prove that if all players adhere to the dynamics, then the states of players will almost surely reach consensus and the joint action profile of players will be absorbed into a Nash equilibrium of the game. This convergence result is proven under the condition of weakly acyclic games and strongly connected networks. Furthermore, to encounter more general circumstances, such as games with graphical action sets, state-based games, and switching communication networks, several variants of the proposed dynamics and its convergent results are also developed. To demonstrate the validity and applicability, we apply the proposed timestamp-based learning dynamics to design distributed algorithms for solving some typical finite games, including the coordination games and congestion games.
引用
收藏
页码:1330 / 1340
页数:11
相关论文
共 22 条
  • [1] A timestamp-based projected gradient play for distributed Nash equilibrium seeking in monotone games☆
    Tan, Shaolin
    AUTOMATICA, 2024, 160
  • [2] Utility Decoupling for Distributed Nash Equilibrium Seeking in Weakly Acyclic Games
    Tan, Shaolin
    Yang, Guang
    Gu, Haibo
    Liu, Kexin
    Lu, Jinhu
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (07): : 4031 - 4041
  • [3] Distributed best response dynamics for Nash equilibrium seeking in potential games
    Shijie Huang
    Peng Yi
    Control Theory and Technology, 2020, 18 : 324 - 332
  • [4] Distributed best response dynamics for Nash equilibrium seeking in potential games
    Huang, Shijie
    Yi, Peng
    CONTROL THEORY AND TECHNOLOGY, 2020, 18 (03) : 324 - 332
  • [5] A timestamp-based Nesterov's accelerated projected gradient method for distributed Nash equilibrium seeking in monotone games
    Liu, Nian
    Tan, Shaolin
    Tao, Ye
    Lue, Jinhu
    SYSTEMS & CONTROL LETTERS, 2024, 194
  • [6] Distributed Inertial Best-Response Dynamics
    Swenson, Brian
    Eksin, Ceyhun
    Kar, Soummya
    Ribeiro, Alejandro
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (12) : 4294 - 4300
  • [7] Nash Equilibrium in Iterated Multiplayer Games Under Asynchronous Best-Response Dynamics
    Zhu, Yuying
    Xia, Chengyi
    Chen, Zengqiang
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (09) : 5798 - 5805
  • [8] Pure Nash Equilibria and Best-Response Dynamics in Random Games
    Amiet, Ben
    Collevecchio, Andrea
    Scarsini, Marco
    Zhong, Ziwen
    MATHEMATICS OF OPERATIONS RESEARCH, 2021, 46 (04) : 1552 - 1572
  • [9] Best-response dynamics, playing sequences, and convergence to equilibrium in random games
    Torsten Heinrich
    Yoojin Jang
    Luca Mungo
    Marco Pangallo
    Alex Scott
    Bassel Tarbush
    Samuel Wiese
    International Journal of Game Theory, 2023, 52 : 703 - 735
  • [10] Best-response dynamics, playing sequences, and convergence to equilibrium in random games
    Heinrich, Torsten
    Jang, Yoojin
    Mungo, Luca
    Pangallo, Marco
    Scott, Alex
    Tarbush, Bassel
    Wiese, Samuel
    INTERNATIONAL JOURNAL OF GAME THEORY, 2023, 52 (03) : 703 - 735