Information Entropy As a Basic Building Block of Complexity Theory

被引：54

作者：

Gao, Jianbo ^{[1
,2
,3
]}

Liu, Feiyan ^{[4
]}

Zhang, Jianfang ^{[4
]}

Hu, Jing ^{[1
,2
,3
]}

Cao, Yinhe ^{[3
]}

机构：

[1] Guangxi Univ, Sch Mech Engn, Nanning 530005, Peoples R China

[2] Guangxi Univ, China Asean Res Inst, Nanning 530005, Peoples R China

[3] PMB Intelligence LLC, Sunnyvale, CA 94087 USA

[4] Univ Chinese Acad Sci, Sch Management, Beijing 100190, Peoples R China

来源：

ENTROPY | 2013年 / 15卷 / 09期

关键词：

information entropy; thermodynamic entropy; emergence; chaos; fractal; complexity theory; multiscale analysis; LEMPEL-ZIV COMPLEXITY; NOISE; SYSTEMS; CHAOS;

D O I：

10.3390/e15093396

中图分类号：

O4 [物理学];

学科分类号：

0702 ;

摘要：

What is information? What role does information entropy play in this information exploding age, especially in understanding emergent behaviors of complex systems? To answer these questions, we discuss the origin of information entropy, the difference between information entropy and thermodynamic entropy, the role of information entropy in complexity theories, including chaos theory and fractal theory, and speculate new fields in which information entropy may play important roles.

引用

页码：3396 / 3418

页数：23

共 50 条

[41] Information theory methods in communication complexity
Bar-Yossef, Z
Jayram, TS
Kumar, R
Sivakumar, D
17TH ANNUAL IEEE CONFERENCE ON COMPUTATIONAL COMPLEXITY, PROCEEDINGS, 2002, : 93 - 102
[42] Information storage and search complexity theory
Gasanov E.E.
Journal of Mathematical Sciences, 2010, 168 (1) : 32 - 48
[43] An information theory approach to biocultural complexity
M. Humberto Reyes-Valdés
Stella K. Kantartzi
Scientific Reports, 10
[44] Entropy and Information Theory: Uses and Misuses
Ben-Naim, Arieh
ENTROPY, 2019, 21 (12)
[45] Information theory and complexity in probability and statistics
Topsoe, F
SOFT METHODOLOGY AND RANDOM INFORMATION SYSTEMS, 2004, : 363 - 370
[46] Information theory, complexity, and neural networks
Abu-Mostafa, Yaser S., 1600, (27):
[47] An information theory approach to biocultural complexity
Reyes-Valdes, M. Humberto
Kantartzi, Stella K.
SCIENTIFIC REPORTS, 2020, 10 (01)
[48] Algorithmic Information Theory and Computational Complexity
Freivalds, Rusins
ALGORITHMIC PROBABILITY AND FRIENDS: BAYESIAN PREDICTION AND ARTIFICIAL INTELLIGENCE, 2013, 7070 : 142 - 154
[49] INFORMATION AND ENTROPY + INFORMATION-THEORY AND LIVING SYSTEMS
MARCOS, A
ARBOR-CIENCIA PENSAMIENTO Y CULTURA, 1991, 140 (549) : 111 - 135
[50] A Complexity Metric for Web Applications Based on the Entropy Theory
Jung, Woosung
Lee, Eunjoo
Kim, Kapsu
Wu, Chisu
APSEC 2008:15TH ASIA-PACIFIC SOFTWARE ENGINEERING CONFERENCE, PROCEEDINGS, 2008, : 511 - +

← 1 2 3 4 5 →