Rapid learning of spatial representations for goal-directed navigation based on a novel model of hippocampal place fields

被引:2
|
作者
Alabi, Adedapo [1 ]
Vanderelst, Dieter [1 ]
Minai, Ali A. [1 ]
机构
[1] Univ Cincinnati, Dept Elect & Comp Engn, Cincinnati, OH 45221 USA
关键词
Spatial cognition; Robotics; Reinforcement learning; Hippocampus; Computational neuroscience; MORRIS WATER MAZE; FIBER SYNAPTIC-TRANSMISSION; VECTOR CELL MODEL; GRID CELLS; PATH-INTEGRATION; VICARIOUS TRIAL; CHOLINERGIC SUPPRESSION; SELECTIVE SUPPRESSION; NETWORK ACTIVITY; MEMORY;
D O I
10.1016/j.neunet.2023.01.010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The discovery of place cells and other spatially modulated neurons in the hippocampal complex of rodents has been crucial to elucidating the neural basis of spatial cognition. More recently, the replay of neural sequences encoding previously experienced trajectories has been observed during consummatory behavior-potentially with implications for rapid learning, quick memory consolidation, and behavioral planning. Several promising models for robotic navigation and reinforcement learning have been proposed based on these and previous findings. Most of these models, however, use carefully engineered neural networks, and sometimes require long learning periods. In this paper, we present a self-organizing model incorporating place cells and replay, and demonstrate its utility for rapid one-shot learning in non-trivial environments with obstacles. (c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:116 / 128
页数:13
相关论文
共 50 条
  • [21] Schematic representations of local environmental space guide goal-directed navigation
    Marchette, Steven A.
    Ryan, Jack
    Epstein, Russell A.
    COGNITION, 2017, 158 : 68 - 80
  • [22] Hippocampal theta phases organize the reactivation of large-scale electrophysiological representations during goal-directed navigation
    Kunz, Lukas
    Wang, Liang
    Lachner-Piza, Daniel
    Zhang, Hui
    Brandt, Armin
    Dumpelmann, Matthias
    Reinacher, Peter C.
    Coenen, Volker A.
    Chen, Dong
    Wang, Wen-Xu
    Zhou, Wenjing
    Liang, Shuli
    Grewe, Philip
    Bien, Christian G.
    Bierbrauer, Anne
    Schroder, Tobias Navarro
    Schulze-Bonhage, Andreas
    Axmacher, Nikolai
    SCIENCE ADVANCES, 2019, 5 (07)
  • [23] Learning actions from vision-based positioning in goal-directed navigation
    Cicirelli, G
    Distante, C
    D'Orazio, T
    Attolico, G
    1998 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS - PROCEEDINGS, VOLS 1-3: INNOVATIONS IN THEORY, PRACTICE AND APPLICATIONS, 1998, : 1715 - 1720
  • [24] Hippocampal neural activity reflects the economy of choices during goal-directed navigation
    Tryon, Valerie L.
    Penner, Marsha R.
    Heide, Shawn W.
    King, Hunter O.
    Larkin, Joshua
    Mizumori, Sheri J. Y.
    HIPPOCAMPUS, 2017, 27 (07) : 743 - 758
  • [25] Motivational states activate distinct hippocampal representations to guide goal-directed behaviors
    Kennedy, Pamela J.
    Shapiro, Matthew L.
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2009, 106 (26) : 10805 - 10810
  • [26] Towards Goal-Directed Navigation Through Combining Learning Based Global and Local Planners
    Zhou, Xiaomao
    Gao, Yanbin
    Guan, Lianwu
    SENSORS, 2019, 19 (01)
  • [27] The hippocampal-striatal axis in learning, prediction and goal-directed behavior
    Pennartz, C. M. A.
    Ito, R.
    Verschure, P. F. M. J.
    Battaglia, F. P.
    Robbins, T. W.
    TRENDS IN NEUROSCIENCES, 2011, 34 (10) : 548 - 559
  • [28] Spatial navigation and hippocampal place cell firing: The problem of goal encoding
    Poucet, B
    Lenck-Santini, PP
    Hok, V
    Save, E
    Banquet, JP
    Gaussier, P
    Muller, RU
    REVIEWS IN THE NEUROSCIENCES, 2004, 15 (02) : 89 - 107
  • [29] Human hippocampal and parahippocampal theta during goal-directed spatial navigation predicts performance on a virtual Morris water maze
    Cornwell, Brian R.
    Johnson, Linda L.
    Holroyd, Tom
    Carver, Frederick W.
    Grillon, Christian
    JOURNAL OF NEUROSCIENCE, 2008, 28 (23): : 5983 - 5990
  • [30] Accelerating Goal-Directed Reinforcement Learning by Model Characterization
    Debnath, Shoubhik
    Sukhatme, Gaurav
    Liu, Lantao
    2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2018, : 8666 - 8673