The Performance of PredNet Using Predictive Coding in the Visual Cortex: An Empirical Analysis

被引:0
|
作者
Mikkilineni, Sai Ranganath [1 ]
Totaro, Michael Wayne [1 ]
机构
[1] Univ Louisiana Lafayette, Ctr Adv Comp Studies, Lafayette, LA 70504 USA
关键词
Predictive Coding; Deep Learning; Next Frame Prediction; Redundancy Reduction; Self-Supervised Learning; Machine Vision; Visual Cortex; Videos; PredNet; Something-Something dataset; KITTI dataset; End-stopping; End-inhibition; RECEPTIVE-FIELDS; RESPONSES;
D O I
10.1109/IRI51335.2021.00064
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
PredNet is a deep recurrent convolutional neural network developed by Lotter et al.. The architecture drew inspiration from a Hierarchical Neuroscience model of visual processing described and demonstrated by Rao and Ballard. In 2020, Rane, Roshan Prakash, et al. published a critical review of PredNet stating its lack of performance in the task of next frame prediction in videos on a crowd sourced action classification dataset. While their criticism was nearly coherent, it is dubious, when observed, considering the findings reported by Rao and Ballard. In this paper, we reevaluate their review through the application of the two primary datasets used by Lotter et al. and Rane, Roshan Prakash et al.. We address gaps, drawing reasoning using the findings reported by Rao and Ballard. As such, we provide a more comprehensive picture for future research based on predictive coding theory.
引用
收藏
页码:408 / 415
页数:8
相关论文
共 50 条
  • [1] Performance Analysis of Generated Predictive Frames Using PredNet with Multiple Convolution Kernels
    Sakama, Kanato
    Sekiguchi, Shunichi
    Kameyama, Wataru
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY, IWAIT 2023, 2023, 12592
  • [2] Performance Analysis of Generated Predictive Frames Using PredNet Bi-directionally
    Sakama, Kanato
    Sekiguchi, Shunichi
    Kameyama, Wataru
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY (IWAIT) 2022, 2022, 12177
  • [3] AFA-PredNet: The action modulation within predictive coding
    Zhong, Junpei
    Cangelosi, Angelo
    Zhang, Xinzheng
    Ogata, Tetsuya
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [4] Linking pattern completion in the hippocampus to predictive coding in visual cortex
    Hindy, Nicholas C.
    Ng, Felicia Y.
    Turk-Browne, Nicholas B.
    NATURE NEUROSCIENCE, 2016, 19 (05) : 665 - +
  • [5] Predictive coding for motion stimuli in human early visual cortex
    Wouter Schellekens
    Richard J. A. van Wezel
    Natalia Petridou
    Nick F. Ramsey
    Mathijs Raemaekers
    Brain Structure and Function, 2016, 221 : 879 - 890
  • [6] Predictive coding for motion stimuli in human early visual cortex
    Schellekens, Wouter
    van Wezel, Richard J. A.
    Petridou, Natalia
    Ramsey, Nick F.
    Raemaekers, Mathijs
    BRAIN STRUCTURE & FUNCTION, 2016, 221 (02): : 879 - 890
  • [7] Linking pattern completion in the hippocampus to predictive coding in visual cortex
    Nicholas C Hindy
    Felicia Y Ng
    Nicholas B Turk-Browne
    Nature Neuroscience, 2016, 19 : 665 - 667
  • [8] Predictive Coding in the Visual Cortex by a Recurrent Network with Gabor Receptive Fields
    Gustavo Deco
    Bernd Schürmann
    Neural Processing Letters, 2001, 14 : 107 - 114
  • [9] Predictive coding in the visual cortex by a recurrent network with Gabor receptive fields
    Deco, G
    Schürmann, B
    NEURAL PROCESSING LETTERS, 2001, 14 (02) : 107 - 114
  • [10] Layer resolution fMRI to investigate cortical feedback and predictive coding in the visual cortex
    Muckli, Lars
    COGNITIVE PROCESSING, 2014, 15 (01) : S19 - S20