Analysis of an information-theoretic model for communication

被引:10
|
作者
Dickman, Ronald [1 ,2 ]
Moloney, Nicholas R. [1 ,2 ]
Altmann, Eduardo G. [3 ]
机构
[1] Univ Fed Minas Gerais, Dept Phys, Belo Horizonte, MG, Brazil
[2] Natl Inst Sci & Technol Complex Syst, BR-30161970 Belo Horizonte, MG, Brazil
[3] Max Planck Inst Phys Komplexer Syst, D-01187 Dresden, Germany
关键词
exact results; critical phenomena of socio-economic systems; scaling in socio-economic systems;
D O I
10.1088/1742-5468/2012/12/P12022
中图分类号
O3 [力学];
学科分类号
08 ; 0801 ;
摘要
We study the cost-minimization problem posed by Ferrer i Cancho and Sole in their model of communication that aimed at explaining the origin of Zipf's law (2003 Proc. Nat. Acad. Sci. 100 788). Direct analysis shows that the minimum cost is min{lambda, 1 - lambda}, where lambda determines the relative weights of speaker's and hearer's costs in the total, as shown in several previous works using different approaches. The nature and multiplicity of the minimizing solution change discontinuously at lambda = 1/2, being qualitatively different for lambda < 1/2, lambda > 1/2, and lambda = 1/2. Zipf's law is found only in a vanishing fraction of the minimum-cost solutions at lambda = 1/2 and therefore is not explained by this model. Imposing the further condition of equal costs yields distributions substantially closer to Zipf's law ones, but significant differences persist. We also investigate the solutions reached with the previously used minimization algorithm and find that they correctly recover global minimum states at the transition.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Information-Theoretic Analysis of Neural Coding
    Don H. Johnson
    Charlotte M. Gruner
    Keith Baggerly
    Chandran Seshagiri
    Journal of Computational Neuroscience, 2001, 10 : 47 - 69
  • [22] Information-Theoretic Analysis of Haplotype Assembly
    Si, Hongbo
    Vikalo, Haris
    Vishwanath, Sriram
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2017, 63 (06) : 3468 - 3479
  • [23] Information-Theoretic Analysis of Spherical Fingerprinting
    Moulin, Pierre
    Wang, Ying
    2009 INFORMATION THEORY AND APPLICATIONS WORKSHOP, 2009, : 226 - +
  • [24] Information-theoretic analysis of neural coding
    Johnson, DH
    Gruner, CM
    Baggerly, K
    Seshagiri, C
    JOURNAL OF COMPUTATIONAL NEUROSCIENCE, 2001, 10 (01) : 47 - 69
  • [25] An Information-Theoretic Analysis of Thompson Sampling
    Russo, Daniel
    Van Roy, Benjamin
    JOURNAL OF MACHINE LEARNING RESEARCH, 2016, 17
  • [26] Information-theoretic analysis for transfer learning
    Wu, Xuetong
    Manton, Jonathan H.
    Aickelin, Uwe
    Zhu, Jingge
    2020 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2020, : 2819 - 2824
  • [27] INFORMATION-THEORETIC ANALYSIS OF CLINICAL REFRACTION
    CROSSMAN, ER
    NAGARVALA, PJ
    MARG, E
    AMERICAN JOURNAL OF OPTOMETRY AND ARCHIVES OF AMERICAN ACADEMY OF OPTOMETRY, 1971, 48 (05): : 391 - +
  • [28] Information-theoretic Analysis of MAXCUT Algorithms
    Bian, Yatao
    Gronskiy, Alexey
    Buhmann, Joachim M.
    2016 INFORMATION THEORY AND APPLICATIONS WORKSHOP (ITA), 2016,
  • [29] Information-Theoretic Approach to Strategic Communication as a Hierarchical Game
    Akyol, Emrah
    Langbort, Cedric
    Basar, Tamer
    PROCEEDINGS OF THE IEEE, 2017, 105 (02) : 205 - 218
  • [30] INFORMATION-THEORETIC SENSOR SCHEDULING UNDER COMMUNICATION CONSTRAINTS
    Tuggle, Kirsten
    Akella, Maruthi
    ASTRODYNAMICS 2018, PTS I-IV, 2019, 167 : 3307 - 3317