Local measures of information storage in complex distributed computation

被引:111
|
作者
Lizier, Joseph T. [1 ,2 ,3 ]
Prokopenko, Mikhail [2 ]
Zomaya, Albert Y. [3 ]
机构
[1] Max Planck Inst Math Sci, D-04103 Leipzig, Germany
[2] CSIRO Informat & Commun Technol Ctr, Epping, NSW 1710, Australia
[3] Univ Sydney, Sch Informat Technol, Sydney, NSW 2006, Australia
关键词
Information storage; Intrinsic computation; Complex systems; Information theory; Cellular automata; Particles; CELLULAR-AUTOMATA; MEMORY; SYNCHRONIZATION; DYNAMICS; ENTROPY; SYSTEMS;
D O I
10.1016/j.ins.2012.04.016
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Information storage is a key component of intrinsic distributed computation. Despite the existence of appropriate measures for it (e.g. excess entropy), its role in interacting with information transfer and modification to give rise to distributed computation is not yet well-established. We explore how to quantify information storage on a local scale in space and time, so as to understand its role in the dynamics of distributed computation. To assist these explorations, we introduce the active information storage, which quantifies the information storage component that is directly in use in the computation of the next state of a process. We present the first profiles of local excess entropy and local active information storage in cellular automata, providing evidence that blinkers and background domains are dominant information storage processes in these systems. This application also demonstrates the manner in which these two measures of information storage are distinct but complementary. It also reveals other information storage phenomena, including the misinformative nature of local storage when information transfer dominates the computation, and demonstrates that the local entropy rate is a useful spatiotemporal filter for information transfer structure. (C) 2012 Elsevier Inc. All rights reserved.
引用
收藏
页码:39 / 54
页数:16
相关论文
共 50 条
  • [1] Distributed Algorithms for Computation of Centrality Measures in Complex Networks
    You, Keyou
    Tempo, Roberto
    Qiu, Li
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (05) : 2080 - 2094
  • [2] OPTIMIZATION OF COMPOSITION OF LOCAL COMPUTATION NETWORK FOR DISTRIBUTED INFORMATION-SYSTEMS
    ZASLAVSKY, VA
    SHALAMANOV, VM
    AVTOMATIKA, 1990, (05): : 62 - 69
  • [3] Local active information storage as a tool to understand distributed neural information processing
    Wibral, Michael
    Lizier, Joseph T.
    Voegler, Sebastian
    Priesemann, Viola
    Galuske, Ralf
    FRONTIERS IN NEUROINFORMATICS, 2014, 8
  • [4] MEASURES OF UNCERTAINTY AND INFORMATION IN COMPUTATION
    PACKEL, EW
    TRAUB, JF
    WOZNIAKOWSKI, H
    INFORMATION SCIENCES, 1992, 65 (03) : 253 - 273
  • [5] Computation in a distributed information market
    Feigenbaum, J
    Fortnow, L
    Pennock, DM
    Sami, R
    THEORETICAL COMPUTER SCIENCE, 2005, 343 (1-2) : 114 - 132
  • [6] Verifiable Local Computation on Distributed Data
    Zhang, Liang Feng
    Safavi-Naini, Reihaneh
    Liu, Xiao Wei
    SCC'14: PROCEEDINGS OF THE 2ND INTERNATIONAL WORKSHOP ON SECURITY IN CLOUD COMPUTING, 2014, : 3 - 10
  • [7] Storage and Computation: A Tradeoff in Secure Distributed Computing
    Chen, Jiajun
    Sung, Chi Wan
    Chan, Terence H.
    ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [8] Fabric: A Platform for Secure Distributed Computation and Storage
    Liu, Jed
    George, Michael D.
    Vikram, K.
    Qi, Xin
    Waye, Lucas
    Myers, Andrew C.
    SOSP'09: PROCEEDINGS OF THE TWENTY-SECOND ACM SIGOPS SYMPOSIUM ON OPERATING SYSTEMS PRINCIPLES, 2009, : 321 - 334
  • [9] Local Mixing Time: Distributed Computation and Applications
    Molla, Anisur Rahaman
    Pandurangan, Gopal
    2018 32ND IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS), 2018, : 743 - 752
  • [10] Local and global measures of information storage for the assessment of heartbeat-evoked cortical responses
    Bara, Chiara
    Zaccaro, Andrea
    Antonacci, Yuri
    Dalla Riva, Matteo
    Busacca, Alessandro
    Ferri, Francesca
    Faes, Luca
    Pernice, Riccardo
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 86