Information Entropy As a Basic Building Block of Complexity Theory

被引：54
|
作者：
Gao, Jianbo [1 ,2 ,3 ]
Liu, Feiyan [4 ]
Zhang, Jianfang [4 ]
Hu, Jing [1 ,2 ,3 ]
Cao, Yinhe [3 ]
机构：
[1] Guangxi Univ, Sch Mech Engn, Nanning 530005, Peoples R China
[2] Guangxi Univ, China Asean Res Inst, Nanning 530005, Peoples R China
[3] PMB Intelligence LLC, Sunnyvale, CA 94087 USA
[4] Univ Chinese Acad Sci, Sch Management, Beijing 100190, Peoples R China
来源：
ENTROPY | 2013年 / 15卷 / 09期
关键词：
information entropy; thermodynamic entropy; emergence; chaos; fractal; complexity theory; multiscale analysis; LEMPEL-ZIV COMPLEXITY; NOISE; SYSTEMS; CHAOS;
D O I：
10.3390/e15093396
中图分类号：
O4 [物理学];
学科分类号：
0702 ;
摘要：
What is information? What role does information entropy play in this information exploding age, especially in understanding emergent behaviors of complex systems? To answer these questions, we discuss the origin of information entropy, the difference between information entropy and thermodynamic entropy, the role of information entropy in complexity theories, including chaos theory and fractal theory, and speculate new fields in which information entropy may play important roles.
引用
收藏
页码：3396 / 3418
页数：23
相关论文
共 50 条
  • [1] Entropy and algorithmic complexity in quantum information theory
    Benatti F.
    Natural Computing, 2007, 6 (2) : 133 - 150
  • [2] SOME BASIC INFORMATION ON INFORMATION-BASED COMPLEXITY THEORY
    PARLETT, BN
    BULLETIN OF THE AMERICAN MATHEMATICAL SOCIETY, 1992, 26 (01) : 3 - 27
  • [3] GENERALIZED TREE CIRCUIT - BASIC BUILDING BLOCK OF AN EXTENDED DECOMPOSITON THEORY
    CURTIS, HA
    JOURNAL OF THE ACM, 1963, 10 (04) : 562 - &
  • [4] CrystIT: Complexity and configurational entropy of crystal structures via information theory
    Kaubler, Clemens
    Kieslich, Gregor
    Journal of Applied Crystallography, 2021, 54 : 306 - 316
  • [5] crystIT: complexity and configurational entropy of crystal structures via information theory
    Kaussler, Clemens
    Kieslich, Gregor
    JOURNAL OF APPLIED CRYSTALLOGRAPHY, 2021, 54 : 306 - 316
  • [6] Entropy, complexity, and spatial information
    Michael Batty
    Robin Morphet
    Paolo Masucci
    Kiril Stanilov
    Journal of Geographical Systems, 2014, 16 : 363 - 385
  • [7] Entropy, complexity, and spatial information
    Batty, Michael
    Morphet, Robin
    Masucci, Paolo
    Stanilov, Kiril
    JOURNAL OF GEOGRAPHICAL SYSTEMS, 2014, 16 (04) : 363 - 385
  • [8] Design theory for dynamic complexity in information infrastructures: the case of building internet
    Hanseth, Ole
    Lyytinen, Kalle
    JOURNAL OF INFORMATION TECHNOLOGY, 2010, 25 (01) : 1 - 19
  • [9] Information entropy, information distances, and complexity in atoms
    Chatzisavvas, KC
    Moustakidis, CC
    Panos, CP
    JOURNAL OF CHEMICAL PHYSICS, 2005, 123 (17):
  • [10] Efficient block entropy coding with low complexity
    Said, A
    Pearlman, WA
    Islam, A
    1998 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY - PROCEEDINGS, 1998, : 139 - 139
12345