Brain-inspired wiring economics for artificial neural networks

被引:0
|
作者
Zhang, Xin-Jie [1 ,2 ]
Moore, Jack Murdoch [1 ,2 ]
Gao, Ting-Ting [1 ,2 ]
Zhang, Xiaozhu [1 ,2 ,3 ,4 ]
Yan, Gang [1 ,2 ,5 ]
机构
[1] Tongji Univ, Sch Phys Sci & Engn, Shanghai 200092, Peoples R China
[2] Tongji Univ, MOE Frontiers Sci Ctr Intelligent Autonomous Syst, Natl Key Lab Autonomous Intelligent Unmanned Syst, Shanghai 200092, Peoples R China
[3] Tech Univ Dresden, Chair Network Dynam, Ctr Adv Elect Dresden cfaed, D-01062 Dresden, Germany
[4] Tech Univ Dresden, Inst Theoret Phys, D-01062 Dresden, Germany
[5] Chinese Acad Sci, CAS Ctr Excellence Brain Sci & Intelligence Techno, Shanghai 200031, Peoples R China
来源
PNAS NEXUS | 2025年 / 4卷 / 01期
基金
中国国家自然科学基金;
关键词
wiring cost; brain-like computing; interpretable AI; bio-inspired AI; sparse neural networks; CONNECTIVITY; OPTIMIZATION; MODULARITY; REGRESSION;
D O I
10.1093/pnasnexus/pgae580
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Wiring patterns of brain networks embody a trade-off between information transmission, geometric constraints, and metabolic cost, all of which must be balanced to meet functional needs. Geometry and wiring economy are crucial in the development of brains, but their impact on artificial neural networks (ANNs) remains little understood. Here, we adopt a wiring cost-controlled training framework that simultaneously optimizes wiring efficiency and task performance during structural evolution of sparse ANNs whose nodes are located at arbitrary but fixed positions. We show that wiring cost control improves performance across a wide range of tasks, ANN architectures and training methods, and can promote task-specific structural modules. An optimal wiring cost range provides both enhanced predictive performance and high values of topological properties, such as modularity and clustering, which are observed in real brain networks and known to improve robustness, interpretability, and performance of ANNs. In addition, ANNs trained using wiring cost can emulate the connection distance distribution observed in the brains of real organisms (such as Ciona intestinalis and Caenorhabditis elegans), especially when achieving high task performance, offering insights into biological organizing principles. Our results shed light on the relationship between topology and task specialization of ANNs trained within biophysical constraints, and their geometric resemblance to real neuronal-level brain maps.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] A two-stage strategy for brain-inspired unsupervised learning in spiking neural networks
    Cao, Zhen
    Ma, Chuanfeng
    Hou, Biao
    Chen, Xiaoyu
    Li, Leida
    Zhu, Hao
    Quan, Dou
    Jiao, Licheng
    NEUROCOMPUTING, 2025, 611
  • [42] Remote sensing image detection method based on brain-inspired spiking neural networks
    Duan, Dexin
    Lu, Yao
    Huang, Liwei
    Liu, Peilin
    Wen, Fei
    National Remote Sensing Bulletin, 2024, 28 (07) : 1713 - 1721
  • [43] Machine unlearning in brain-inspired neural network paradigms
    Wang, Chaoyi
    Ying, Zuobin
    Pan, Zijie
    FRONTIERS IN NEUROROBOTICS, 2024, 18
  • [44] How far is brain-inspired artificial intelligence away from brain?
    Chen, Yucan
    Wei, Zhengde
    Gou, Huixing
    Liu, Haiyi
    Gao, Li
    He, Xiaosong
    Zhang, Xiaochu
    FRONTIERS IN NEUROSCIENCE, 2022, 16
  • [45] Temporal feature analysis in brain-inspired neural systems
    Fukai, Tomoki
    Asabuki, Toshitake
    2019 SILICON NANOELECTRONICS WORKSHOP (SNW), 2019, : 11 - 12
  • [46] Brain-Inspired Hardware Solutions for Inference in Bayesian Networks
    Bagheriye, Leila
    Kwisthout, Johan
    FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [47] Flexible, Brain-Inspired Communication in Massive Wireless Networks
    Bossy, Bartosz
    Kryszkiewicz, Pawel
    Bogucka, Hanna
    SENSORS, 2020, 20 (06)
  • [48] Emerging Memristive Devices for Brain-Inspired Computing and Artificial Perception
    Wang, Jingyu
    Zhu, Ying
    Zhu, Li
    Chen, Chunsheng
    Wan, Qing
    FRONTIERS IN NANOTECHNOLOGY, 2022, 4
  • [49] Brain-inspired stochasticity
    Charlotte Allard
    Nature Reviews Materials, 2022, 7 : 426 - 426
  • [50] BRAIN-INSPIRED SPIKING NEURAL NETWORKS FOR WI-FI BASED HUMAN ACTIVITY RECOGNITION
    Tan, Yee Leong
    Wong, Yan Chiew
    Radzi, Syafeeza Ahmad
    JORDANIAN JOURNAL OF COMPUTERS AND INFORMATION TECHNOLOGY, 2021, 7 (04): : 363 - 372