Applying a Neural Network Architecture with Spatio-Temporal Connections to the Maze Exploration

被引:0
|
作者
Filin, Dmitry [1 ]
Panov, Aleksandr I. [1 ,2 ]
机构
[1] Natl Res Univ, Higher Sch Econ, Moscow, Russia
[2] Russian Acad Sci, Fed Res Ctr Comp Sci & Control, Moscow, Russia
关键词
D O I
10.1007/978-3-319-63940-6_8
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
We present a model of Reinforcement Learning, which consists of modified neural-network architecture with spatio-temporal connections, known as Temporal Hebbian Self-Organizing Map (THSOM). A number of experiments were conducted to test the model on the maze solving problem. The algorithm demonstrates sustainable learning, building a near to optimal routes. This work describes an agents behavior in the mazes of different complexity and also influence of models parameters at the length of formed paths.
引用
收藏
页码:57 / 64
页数:8
相关论文
共 50 条
  • [1] Predicting Multiple Traffic Features using a Spatio-Temporal Neural Network Architecture
    Ichim, Bogdan
    Iordache, Florin
    VEHITS: PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE ON VEHICLE TECHNOLOGY AND INTELLIGENT TRANSPORT SYSTEMS, 2022, : 331 - 337
  • [2] Analysis of Spatio-Temporal Neural Activities by Artificial Neural Network
    Research Center for Advanced Science and Technology, The University of Tokyo, 4-6-1 Komaba, Meguro-ku, Tokyo 153-8904, Japan
    不详
    IEEJ Trans. Electron. Inf. Syst., 2007, 10 (1632-1641+21):
  • [3] Spatio-temporal sequence processing with the counterpropagation neural network
    Wang, LP
    INFORMATION INTELLIGENCE AND SYSTEMS, VOLS 1-4, 1996, : 831 - 835
  • [4] Hybrid neural network for spatio-temporal pattern recognition
    Beijing Univ of Technology, Beijing, China
    Zhongguo Shengwu Yixue Gongcheng Xuebao, 2 (1-6):
  • [5] A neural network filter for complex spatio-temporal patterns
    Ma, JW
    Huang, DZ
    PROCEEDING OF THE 2002 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-3, 2002, : 1028 - 1033
  • [6] STNN: A Spatio-Temporal Neural Network for Traffic Predictions
    He, Zhixiang
    Chow, Chi-Yin
    Zhang, Jia-Dong
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (12) : 7642 - 7651
  • [7] MOTION LEARNING USING SPATIO-TEMPORAL NEURAL NETWORK
    Yusoff, Nooraini
    Kabir-Ahmad, Farzana
    Jemili, Mohamad-Farif
    JOURNAL OF INFORMATION AND COMMUNICATION TECHNOLOGY-MALAYSIA, 2020, 19 (02): : 207 - 223
  • [8] A Neural Network Model for a Hierarchical Spatio-temporal Memory
    Ramanathan, Kiruthika
    Shi, Luping
    Li, Jianming
    Lim, Kian Guan
    Li, Ming Hui
    Ang, Zhi Ping
    Chong, Tow Chong
    ADVANCES IN NEURO-INFORMATION PROCESSING, PT I, 2009, 5506 : 428 - +
  • [9] AutoSTG: Neural Architecture Search for Predictions of Spatio-Temporal Graph
    Pan, Zheyi
    Ke, Songyu
    Yang, Xiaodu
    Liang, Yuxuan
    Yu, Yong
    Zhang, Junbo
    Zheng, Yu
    PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021), 2021, : 1846 - 1855
  • [10] Spatio-temporal neural data mining architecture in learning robots
    Malone, J
    Elshaw, M
    McGarry, K
    Bowerman, C
    Wermter, S
    PROCEEDINGS OF THE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), VOLS 1-5, 2005, : 2802 - 2807