Local measures of information storage in complex distributed computation

被引:111
|
作者
Lizier, Joseph T. [1 ,2 ,3 ]
Prokopenko, Mikhail [2 ]
Zomaya, Albert Y. [3 ]
机构
[1] Max Planck Inst Math Sci, D-04103 Leipzig, Germany
[2] CSIRO Informat & Commun Technol Ctr, Epping, NSW 1710, Australia
[3] Univ Sydney, Sch Informat Technol, Sydney, NSW 2006, Australia
关键词
Information storage; Intrinsic computation; Complex systems; Information theory; Cellular automata; Particles; CELLULAR-AUTOMATA; MEMORY; SYNCHRONIZATION; DYNAMICS; ENTROPY; SYSTEMS;
D O I
10.1016/j.ins.2012.04.016
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Information storage is a key component of intrinsic distributed computation. Despite the existence of appropriate measures for it (e.g. excess entropy), its role in interacting with information transfer and modification to give rise to distributed computation is not yet well-established. We explore how to quantify information storage on a local scale in space and time, so as to understand its role in the dynamics of distributed computation. To assist these explorations, we introduce the active information storage, which quantifies the information storage component that is directly in use in the computation of the next state of a process. We present the first profiles of local excess entropy and local active information storage in cellular automata, providing evidence that blinkers and background domains are dominant information storage processes in these systems. This application also demonstrates the manner in which these two measures of information storage are distinct but complementary. It also reveals other information storage phenomena, including the misinformative nature of local storage when information transfer dominates the computation, and demonstrates that the local entropy rate is a useful spatiotemporal filter for information transfer structure. (C) 2012 Elsevier Inc. All rights reserved.
引用
收藏
页码:39 / 54
页数:16
相关论文
共 50 条
  • [21] STORAGE AND RETRIEVAL OF INFORMATION ON PSYCHOLOGICAL MEASURES
    CHUN, KT
    COBB, S
    FRENCH, JRP
    SEASHORE, S
    AMERICAN PSYCHOLOGIST, 1973, 28 (07) : 592 - 599
  • [22] Coherent information structure in complex computation
    Joseph T. Lizier
    Mikhail Prokopenko
    Albert Y. Zomaya
    Theory in Biosciences, 2012, 131 : 193 - 203
  • [23] On Cooperative Local Repair in Distributed Storage
    Rawat, Ankit Singh
    Mazumdar, Arya
    Vishwanath, Sriram
    2014 48TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS (CISS), 2014,
  • [24] Cooperative local repair in distributed storage
    Ankit Singh Rawat
    Arya Mazumdar
    Sriram Vishwanath
    EURASIP Journal on Advances in Signal Processing, 2015
  • [25] Cooperative local repair in distributed storage
    Rawat, Ankit Singh
    Mazumdar, Arya
    Vishwanath, Sriram
    EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2015, : 1 - 17
  • [26] GraphA: Efficient Partitioning and Storage for Distributed Graph Computation
    Zhang, Yiming
    Li, Dongsheng
    Zhang, Chengfei
    Wang, Jinyan
    Liu, Ling
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2021, 14 (01) : 155 - 166
  • [27] Storage, Computation, and Communication: A Fundamental Tradeoff in Distributed Computing
    Yan, Qifa
    Yang, Sheng
    Wigger, Michele
    2018 IEEE INFORMATION THEORY WORKSHOP (ITW), 2018, : 595 - 599
  • [28] Distributed information storage and collection for WSNs
    Jardak, Christine
    Osipov, Evgeny
    Mahonen, Petri
    2007 IEEE INTERNATIONAL CONFERENCE ON MOBILE AD-HOC AND SENSOR SYSTEMS, VOLS 1-3, 2007, : 176 - +
  • [29] Computation of probabilistic stability measures for a controlled distributed parameter system
    Field Jr., R.V., 1600, Elsevier Science Ltd, Oxford, United Kingdom (10):
  • [30] COMPUTATION OF STATISTICAL FUNCTIONS IN DISTRIBUTED INFORMATION-SYSTEMS
    CRIVELLARI, F
    DALLALIBERA, F
    FRASSON, S
    SCHREIBER, FA
    INFORMATION SYSTEMS, 1983, 8 (04) : 303 - 308