Local measures of information storage in complex distributed computation

被引:111
|
作者
Lizier, Joseph T. [1 ,2 ,3 ]
Prokopenko, Mikhail [2 ]
Zomaya, Albert Y. [3 ]
机构
[1] Max Planck Inst Math Sci, D-04103 Leipzig, Germany
[2] CSIRO Informat & Commun Technol Ctr, Epping, NSW 1710, Australia
[3] Univ Sydney, Sch Informat Technol, Sydney, NSW 2006, Australia
关键词
Information storage; Intrinsic computation; Complex systems; Information theory; Cellular automata; Particles; CELLULAR-AUTOMATA; MEMORY; SYNCHRONIZATION; DYNAMICS; ENTROPY; SYSTEMS;
D O I
10.1016/j.ins.2012.04.016
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Information storage is a key component of intrinsic distributed computation. Despite the existence of appropriate measures for it (e.g. excess entropy), its role in interacting with information transfer and modification to give rise to distributed computation is not yet well-established. We explore how to quantify information storage on a local scale in space and time, so as to understand its role in the dynamics of distributed computation. To assist these explorations, we introduce the active information storage, which quantifies the information storage component that is directly in use in the computation of the next state of a process. We present the first profiles of local excess entropy and local active information storage in cellular automata, providing evidence that blinkers and background domains are dominant information storage processes in these systems. This application also demonstrates the manner in which these two measures of information storage are distinct but complementary. It also reveals other information storage phenomena, including the misinformative nature of local storage when information transfer dominates the computation, and demonstrates that the local entropy rate is a useful spatiotemporal filter for information transfer structure. (C) 2012 Elsevier Inc. All rights reserved.
引用
收藏
页码:39 / 54
页数:16
相关论文
共 50 条
  • [31] COMPUTATION OF COMPONENT IMPORTANCE MEASURES FOR RELIABILITY OF COMPLEX SYSTEMS
    Mahboob, Qamar
    Zahid, Faisal Maqbool
    Schoene, Eric
    Kunze, Michael
    Trinckauf, Jochen
    UNCERTAINTY MODELING IN KNOWLEDGE ENGINEERING AND DECISION MAKING, 2012, 7 : 1051 - 1057
  • [32] The Geographic Information System Based on Distributed Parallel Computation
    Huang, He
    Wei, Zhihua
    Li, Zhuoqiu
    2009 INTERNATIONAL CONFERENCE ON NETWORKING AND DIGITAL SOCIETY, VOL 1, PROCEEDINGS, 2009, : 234 - +
  • [33] Information dependability in distributed systems: The dependable distributed storage system
    Distefano, Salvatore
    Puliafito, Antonio
    INTEGRATED COMPUTER-AIDED ENGINEERING, 2014, 21 (01) : 3 - 18
  • [34] Complex entropy and resultant information measures
    Nalewajski, Roman F.
    JOURNAL OF MATHEMATICAL CHEMISTRY, 2016, 54 (09) : 1777 - 1782
  • [35] Complex entropy and resultant information measures
    Roman F. Nalewajski
    Journal of Mathematical Chemistry, 2016, 54 : 1777 - 1782
  • [36] Influence at Scale: Distributed Computation of Complex Contagion in Networks
    Lucier, Brendan
    Oren, Joel
    Singer, Yaron
    KDD'15: PROCEEDINGS OF THE 21ST ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2015, : 735 - 744
  • [37] The security threats and corresponding measures to distributed storage systems
    Chen, Lanxiang
    Feng, Dan
    Ming, Liang
    ADVANCED PARALLEL PROCESSING TECHNOLOGIES, PROCEEDINGS, 2007, 4847 : 551 - 559
  • [38] Evolutionary Computation on Complex Spatially-Distributed Networks
    Pilat, Marcin L.
    Pestov, Irene
    GECCO-2010 COMPANION PUBLICATION: PROCEEDINGS OF THE 12TH ANNUAL GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 2010, : 2107 - 2108
  • [39] CompStor: An In-Storage Computation Platform for Scalable Distributed Processing
    Torabzadehkashi, Mahdi
    Rezaei, Siavash
    Alves, Vladimir
    Bagherzadeh, Nader
    2018 IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW 2018), 2018, : 1260 - 1267
  • [40] Integration and storage of sensory motor information: Computation in the cerebellum
    DAngelo, E
    HUMAN AND MACHINE PERCEPTION: INFORMATION FUSION, 1997, : 109 - 121