Rapid learning of spatial representations for goal-directed navigation based on a novel model of hippocampal place fields

被引:2
|
作者
Alabi, Adedapo [1 ]
Vanderelst, Dieter [1 ]
Minai, Ali A. [1 ]
机构
[1] Univ Cincinnati, Dept Elect & Comp Engn, Cincinnati, OH 45221 USA
关键词
Spatial cognition; Robotics; Reinforcement learning; Hippocampus; Computational neuroscience; MORRIS WATER MAZE; FIBER SYNAPTIC-TRANSMISSION; VECTOR CELL MODEL; GRID CELLS; PATH-INTEGRATION; VICARIOUS TRIAL; CHOLINERGIC SUPPRESSION; SELECTIVE SUPPRESSION; NETWORK ACTIVITY; MEMORY;
D O I
10.1016/j.neunet.2023.01.010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The discovery of place cells and other spatially modulated neurons in the hippocampal complex of rodents has been crucial to elucidating the neural basis of spatial cognition. More recently, the replay of neural sequences encoding previously experienced trajectories has been observed during consummatory behavior-potentially with implications for rapid learning, quick memory consolidation, and behavioral planning. Several promising models for robotic navigation and reinforcement learning have been proposed based on these and previous findings. Most of these models, however, use carefully engineered neural networks, and sometimes require long learning periods. In this paper, we present a self-organizing model incorporating place cells and replay, and demonstrate its utility for rapid one-shot learning in non-trivial environments with obstacles. (c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:116 / 128
页数:13
相关论文
共 50 条
  • [41] Interaction of Instrumental and Goal-Directed Learning Modulates Prediction Error Representations in the Ventral Striatum
    Guo, Rong
    Boehmer, Wendelin
    Hebart, Martin
    Chien, Samson
    Sommer, Tobias
    Obermayer, Klaus
    Glaescher, Jan
    JOURNAL OF NEUROSCIENCE, 2016, 36 (50): : 12650 - 12660
  • [42] Functional integration processes underlying the instruction-based learning of novel goal-directed behaviors
    Ruge, Hannes
    Wolfensteller, Uta
    NEUROIMAGE, 2013, 68 : 162 - 172
  • [43] A Bio-Inspired Goal-Directed Visual Navigation Model for Aerial Mobile Robots
    Jun Mao
    Xiaoping Hu
    Lilian Zhang
    Xiaofeng He
    Michael Milford
    Journal of Intelligent & Robotic Systems, 2020, 100 : 289 - 310
  • [44] A Bio-Inspired Goal-Directed Visual Navigation Model for Aerial Mobile Robots
    Mao, Jun
    Hu, Xiaoping
    Zhang, Lilian
    He, Xiaofeng
    Milford, Michael
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2020, 100 (01) : 289 - 310
  • [45] DeFINE: Delayed feedback-based immersive navigation environment for studying goal-directed human navigation
    Tiwari, Kshitij
    Kyrki, Ville
    Cheung, Allen
    Yamamoto, Naohide
    BEHAVIOR RESEARCH METHODS, 2021, 53 (06) : 2668 - 2688
  • [46] DeFINE: Delayed feedback-based immersive navigation environment for studying goal-directed human navigation
    Kshitij Tiwari
    Ville Kyrki
    Allen Cheung
    Naohide Yamamoto
    Behavior Research Methods, 2021, 53 : 2668 - 2688
  • [47] Spatial Learning Drives Rapid Goal Representation in Hippocampal Ripples without Place Field Accumulation or Goal-Oriented Theta Sequences
    Pfeiffer, Brad E.
    JOURNAL OF NEUROSCIENCE, 2022, 42 (19): : 3975 - 3988
  • [48] Learning Model-based F0 Production through Goal-directed Babbling
    Liu, Hao
    Xu, Yi
    2014 9TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP), 2014, : 284 - 288
  • [49] Goal-directed attention alters the tuning of object-based representations in extrastriate cortex
    Chen, Anthony J-W
    Britton, Michael
    Turner, Gary R.
    Vytlacil, Jason
    Thompson, Todd W.
    D'Esposito, Mark
    FRONTIERS IN HUMAN NEUROSCIENCE, 2012, 6
  • [50] Direct cortical inputs to hippocampal area CA1 transmit complementary signals for goal-directed navigation
    Bowler, John C.
    Losonczy, Attila
    NEURON, 2023, 111 (24) : 4071 - 4085.e6