Information Entropy As a Basic Building Block of Complexity Theory

被引:54
|
作者
Gao, Jianbo [1 ,2 ,3 ]
Liu, Feiyan [4 ]
Zhang, Jianfang [4 ]
Hu, Jing [1 ,2 ,3 ]
Cao, Yinhe [3 ]
机构
[1] Guangxi Univ, Sch Mech Engn, Nanning 530005, Peoples R China
[2] Guangxi Univ, China Asean Res Inst, Nanning 530005, Peoples R China
[3] PMB Intelligence LLC, Sunnyvale, CA 94087 USA
[4] Univ Chinese Acad Sci, Sch Management, Beijing 100190, Peoples R China
关键词
information entropy; thermodynamic entropy; emergence; chaos; fractal; complexity theory; multiscale analysis; LEMPEL-ZIV COMPLEXITY; NOISE; SYSTEMS; CHAOS;
D O I
10.3390/e15093396
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
What is information? What role does information entropy play in this information exploding age, especially in understanding emergent behaviors of complex systems? To answer these questions, we discuss the origin of information entropy, the difference between information entropy and thermodynamic entropy, the role of information entropy in complexity theories, including chaos theory and fractal theory, and speculate new fields in which information entropy may play important roles.
引用
收藏
页码:3396 / 3418
页数:23
相关论文
共 50 条
  • [21] Information granules and entropy theory in information systems
    JiYe Liang
    YuHua Qian
    Science in China Series F: Information Sciences, 2008, 51 : 1427 - 1444
  • [22] Information granules and entropy theory in information systems
    Liang JiYe
    Qian YuHua
    SCIENCE IN CHINA SERIES F-INFORMATION SCIENCES, 2008, 51 (10): : 1427 - 1444
  • [23] Information granules and entropy theory in information systems
    LIANG JiYe & QIAN YuHua Key Laboratory of Computational Intelligence and Chinese Information Processing
    School of Computer & Information Technology
    Science in China(Series F:Information Sciences), 2008, (10) : 1427 - 1444
  • [25] THE BASIC THEOREMS OF INFORMATION THEORY
    MCMILLAN, B
    ANNALS OF MATHEMATICAL STATISTICS, 1953, 24 (02): : 196 - 219
  • [26] Entropy descriptors of the chemical bond in information theory. I. Basic concepts and relations
    Nalewajski, RF
    MOLECULAR PHYSICS, 2004, 102 (06) : 531 - 546
  • [27] Complexity Measurement Based on Information Theory and Kolmogorov Complexity
    Lui, Leong Ting
    Terrazas, German
    Zenil, Hector
    Alexander, Cameron
    Krasnogor, Natalio
    ARTIFICIAL LIFE, 2015, 21 (02) : 205 - 224
  • [28] A Novel Evaluation Method for Building Construction Project Based on Integrated Information Entropy with Reliability Theory
    Bai, Xiao-ping
    Zhang, Xi-wei
    SCIENTIFIC WORLD JOURNAL, 2013,
  • [29] Principal component analysis: the basic building block of chemometrics
    Cordella, Christophe
    ACTUALITE CHIMIQUE, 2010, (345): : 13 - 18
  • [30] Care Platforms: A Basic Building Block For Care Delivery
    Bohmer, Richard M. J.
    Lawrence, David M.
    HEALTH AFFAIRS, 2008, 27 (05) : 1336 - 1340