Learning to signal: Analysis of a micro-level reinforcement model

被引:46
|
作者
Argiento, Raffaele [2 ]
Pemantle, Robin [1 ]
Skyrms, Brian [3 ]
Volkov, Stanislav [4 ]
机构
[1] Univ Penn, Dept Math, Philadelphia, PA 19104 USA
[2] CNR, IMATI, I-20133 Milan, Italy
[3] Univ Calif Irvine, Sch Social Sci, Irvine, CA 92607 USA
[4] Univ Bristol, Dept Math, Bristol BS8 1TW, Avon, England
基金
美国国家科学基金会;
关键词
Urn model; Stochastic approximation; Evolution; game; Probability; Stable; Unstable; Two-player game;
D O I
10.1016/j.spa.2008.02.014
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We consider the following signaling game. Nature plays first from the set {1, 2}. Player 1 (the Sender) sees this and plays From the set {A, B}. Player 2 (the Receiver) sees only Player 1's play and plays from the set {1, 2}. Both players win if Player 2's play equals Nature's play and lose otherwise. Players are told whether they have won or lost, and the game is repeated. An urn scheme for learning coordination in this game is as follows. Each node of the decision tree for Players I and 2 contains an urn with balls of two colors for the two possible decisions. Players make decisions by drawing from the appropriate Urns. After a win, each ball that was drawn is reinforced by adding another of the same color to the urn. A number of equilibria are possible for this game other than the optimal ones. However, we show that the urn scheme achieves asymptotically optimal coordination. (C) 2009 Elsevier B.V. All rights reserved.
引用
收藏
页码:373 / 390
页数:18
相关论文
共 50 条
  • [1] Macro- and micro-level perspectives of learning
    Breen, Judith
    Pedler, Mike
    Edmonstone, John
    Milsom, Brian
    ACTION LEARNING, 2016, 13 (01): : 79 - 80
  • [2] The Analysis of Conflict: A Micro-Level Perspective
    Verwimp, Philip
    Justino, Patricia
    Brueck, Tilman
    JOURNAL OF PEACE RESEARCH, 2009, 46 (03) : 307 - 314
  • [3] Micro-level model explanation and counterfactual constraint
    Schindler, Samuel
    EUROPEAN JOURNAL FOR PHILOSOPHY OF SCIENCE, 2022, 12 (02)
  • [4] Micro-level model explanation and counterfactual constraint
    Samuel Schindler
    European Journal for Philosophy of Science, 2022, 12
  • [5] Do Micro-Level Tutorial Decisions Matter: Applying Reinforcement Learning to Induce Pedagogical Tutorial Tactics
    Chi, Min
    VanLehn, Kurt
    Litman, Diane
    INTELLIGENT TUTORING SYSTEMS, PT 1, PROCEEDINGS, 2010, 6094 : 224 - +
  • [6] Analysis of textile reinforced concrete at the micro-level
    Kang, Bong-Gu
    EKC2008: PROCEEDINGS OF THE EU-KOREA CONFERENCE ON SCIENCE AND TECHNOLOGY, 2008, 124 : 179 - 189
  • [7] Environmental pollution in Moscow: A micro-level analysis
    Bityukova, VR
    Argenbright, R
    EURASIAN GEOGRAPHY AND ECONOMICS, 2002, 43 (03) : 197 - 215
  • [8] Civil War and Democratization: A Micro-Level Analysis
    Gurses, Mehmet
    Celik, Ayse Betul
    Balta, Evren
    SOCIAL SCIENCE QUARTERLY, 2020, 101 (02) : 776 - 791
  • [9] Micro-level disruption
    Darran Yates
    Nature Reviews Neuroscience, 2015, 16 : 373 - 373
  • [10] A censored copula model for micro-level claim reserving
    Lopez, Olivier
    INSURANCE MATHEMATICS & ECONOMICS, 2019, 87 : 1 - 14