Applying a Neural Network Architecture with Spatio-Temporal Connections to the Maze Exploration

被引:0
|
作者
Filin, Dmitry [1 ]
Panov, Aleksandr I. [1 ,2 ]
机构
[1] Natl Res Univ, Higher Sch Econ, Moscow, Russia
[2] Russian Acad Sci, Fed Res Ctr Comp Sci & Control, Moscow, Russia
关键词
D O I
10.1007/978-3-319-63940-6_8
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
We present a model of Reinforcement Learning, which consists of modified neural-network architecture with spatio-temporal connections, known as Temporal Hebbian Self-Organizing Map (THSOM). A number of experiments were conducted to test the model on the maze solving problem. The algorithm demonstrates sustainable learning, building a near to optimal routes. This work describes an agents behavior in the mazes of different complexity and also influence of models parameters at the length of formed paths.
引用
收藏
页码:57 / 64
页数:8
相关论文
共 50 条
  • [21] Analysis of spatio-temporal cortical activity with artificial neural network
    Takahashi, Hirokazu
    Uchihara, Masanobu
    Funamizu, Akihiro
    Yokota, Ryo
    Kanzaki, Ryohei
    2007 3RD INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING, VOLS 1 AND 2, 2007, : 623 - +
  • [22] Heterogeneous recurrent spiking neural network for spatio-temporal classification
    Chakraborty, Biswadeep
    Mukhopadhyay, Saibal
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [23] A Spatio-Temporal Convolutional Neural Network for Skeletal Action Recognition
    Hu, Lizhang
    Xu, Jinhua
    NEURAL INFORMATION PROCESSING (ICONIP 2017), PT III, 2017, 10636 : 377 - 385
  • [24] Application of a Dynamic Recurrent Neural Network in Spatio-Temporal Forecasting
    Cheng, Tao
    Wang, Jiaqiu
    INFORMATION FUSION AND GEOGRAPHIC INFORMATION SYSTEMS, PROCEEDINGS, 2007, : 173 - +
  • [25] EEG Source Localization Using Spatio-Temporal Neural Network
    Song Cui
    Lijuan Duan
    Bei Gong
    Yuanhua Qiao
    Fan Xu
    Juncheng Chen
    Changming Wang
    中国通信, 2019, 16 (07) : 131 - 143
  • [26] Spatio-Temporal Wireless Traffic Prediction With Recurrent Neural Network
    Qiu, Chen
    Zhang, Yanyan
    Feng, Zhiyong
    Zhang, Ping
    Cui, Shuguang
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2018, 7 (04) : 554 - 557
  • [27] An adaptive wavelet neural network for spatio-temporal system identification
    Wei, H. L.
    Billings, S. A.
    Zhao, Y. F.
    Guo, L. Z.
    NEURAL NETWORKS, 2010, 23 (10) : 1286 - 1299
  • [28] Spatio-Temporal Hypergraph Neural ODE Network for Traffic Forecasting
    Yao, Chengzhi
    Li, Zhi
    Wang, Jumbo
    23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING, ICDM 2023, 2023, : 1499 - 1504
  • [29] A spatio-temporal neural network applied to visual speech recognition
    Baig, AR
    Séguier, R
    Vaucher, G
    NINTH INTERNATIONAL CONFERENCE ON ARTIFICIAL NEURAL NETWORKS (ICANN99), VOLS 1 AND 2, 1999, (470): : 797 - 802
  • [30] EEG Source Localization Using Spatio-Temporal Neural Network
    Cui, Song
    Duan, Lijuan
    Gong, Bei
    Qiao, Yuanhua
    Xu, Fan
    Chen, Juncheng
    Wang, Changming
    CHINA COMMUNICATIONS, 2019, 16 (07) : 131 - 143