The Performance of PredNet Using Predictive Coding in the Visual Cortex: An Empirical Analysis

被引:0
|
作者
Mikkilineni, Sai Ranganath [1 ]
Totaro, Michael Wayne [1 ]
机构
[1] Univ Louisiana Lafayette, Ctr Adv Comp Studies, Lafayette, LA 70504 USA
关键词
Predictive Coding; Deep Learning; Next Frame Prediction; Redundancy Reduction; Self-Supervised Learning; Machine Vision; Visual Cortex; Videos; PredNet; Something-Something dataset; KITTI dataset; End-stopping; End-inhibition; RECEPTIVE-FIELDS; RESPONSES;
D O I
10.1109/IRI51335.2021.00064
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
PredNet is a deep recurrent convolutional neural network developed by Lotter et al.. The architecture drew inspiration from a Hierarchical Neuroscience model of visual processing described and demonstrated by Rao and Ballard. In 2020, Rane, Roshan Prakash, et al. published a critical review of PredNet stating its lack of performance in the task of next frame prediction in videos on a crowd sourced action classification dataset. While their criticism was nearly coherent, it is dubious, when observed, considering the findings reported by Rao and Ballard. In this paper, we reevaluate their review through the application of the two primary datasets used by Lotter et al. and Rane, Roshan Prakash et al.. We address gaps, drawing reasoning using the findings reported by Rao and Ballard. As such, we provide a more comprehensive picture for future research based on predictive coding theory.
引用
收藏
页码:408 / 415
页数:8
相关论文
共 50 条
  • [31] Visual mismatch negativity: a predictive coding view
    Stefanics, Gabor
    Kremlacek, Jan
    Czigler, Istvan
    FRONTIERS IN HUMAN NEUROSCIENCE, 2014, 8 : 1 - 19
  • [32] A hierarchical predictive coding model of visual processing
    Boris Vladimirskiy
    Walter Senn
    Robert Urbanczik
    BMC Neuroscience, 9 (Suppl 1)
  • [33] Computational components of visual predictive coding circuitry
    Shipp, Stewart
    FRONTIERS IN NEURAL CIRCUITS, 2024, 17
  • [34] Great Expectations: Is there Evidence for Predictive Coding in Auditory Cortex?
    Heilbron, Micha
    Chait, Maria
    NEUROSCIENCE, 2018, 389 : 54 - 73
  • [35] Reflections on agranular architecture: predictive coding in the motor cortex
    Shipp, Stewart
    Adams, Rick A.
    Friston, Karl J.
    TRENDS IN NEUROSCIENCES, 2013, 36 (12) : 706 - 716
  • [36] Portability of Predictive Academic Performance Models: An Empirical Sensitivity Analysis
    Arroyo-Barriguete, Jose Luis
    Carabias-Lopez, Susana
    Curto-Gonzalez, Tomas
    Hernandez, Adolfo
    MATHEMATICS, 2021, 9 (08)
  • [37] VISUAL PERFORMANCE AND IMAGE CODING
    ROETLING, PG
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA, 1976, 66 (02) : 173 - 174
  • [38] Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects
    Rao, RPN
    Ballard, DH
    NATURE NEUROSCIENCE, 1999, 2 (01) : 79 - 87
  • [39] Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects
    Rajesh P. N. Rao
    Dana H. Ballard
    Nature Neuroscience, 1999, 2 : 79 - 87
  • [40] Coding the presence of visual objects in a recurrent neural network of visual cortex
    Zwickel, Timm
    Wachtler, Thomas
    Eckhorn, Reinhard
    BIOSYSTEMS, 2007, 89 (1-3) : 216 - 226