Implicit self-regularization in deep neural networks: Evidence from random matrix theory and implications for learning

被引:0
|
作者
Martin, Charles H. [1 ]
Mahoney, Michael W. [2 ,3 ]
机构
[1] Martin, Charles H.
[2] 2,Mahoney, Michael W.
来源
| 1600年 / Microtome Publishing卷 / 22期
关键词
Random variables;
D O I
暂无
中图分类号
学科分类号
摘要
引用
收藏
相关论文
共 50 条
  • [1] Implicit Self-Regularization in Deep Neural Networks: Evidence from Random Matrix Theory and Implications for Learning
    Martin, Charles H.
    Mahoney, Michael W.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2021, 22
  • [2] Temporally consistent video colorization with deep feature propagation and self-regularization learning
    Yihao Liu
    Hengyuan Zhao
    Kelvin C. K. Chan
    Xintao Wang
    Chen Change Loy
    Yu Qiao
    Chao Dong
    Computational Visual Media, 2024, 10 : 375 - 395
  • [3] Temporally consistent video colorization with deep feature propagation and self-regularization learning
    Liu, Yihao
    Zhao, Hengyuan
    Chan, Kelvin C. K.
    Wang, Xintao
    Loy, Chen Change
    Qiao, Yu
    Dong, Chao
    COMPUTATIONAL VISUAL MEDIA, 2024, 10 (02) : 375 - 395
  • [4] The Weights Reset Technique for Deep Neural Networks Implicit Regularization
    Plusch, Grigoriy
    Arsenyev-Obraztsov, Sergey
    Kochueva, Olga
    COMPUTATION, 2023, 11 (08)
  • [5] Combining Explicit and Implicit Regularization for Efficient Learning in Deep Networks
    Zhao, Dan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [6] Deep Learning with Random Neural Networks
    Gelenbe, Erol
    Yin, Yongha
    2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 1633 - 1638
  • [7] Deep Learning with Random Neural Networks
    Gelenbe, Erol
    Yin, Yongha
    PROCEEDINGS OF SAI INTELLIGENT SYSTEMS CONFERENCE (INTELLISYS) 2016, VOL 2, 2018, 16 : 450 - 462
  • [8] Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks
    Razin, Noam
    Maman, Asaf
    Cohen, Nadav
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [9] Theory of adaptive SVD regularization for deep neural networks
    Bejani, Mohammad Mahdi
    Ghatee, Mehdi
    NEURAL NETWORKS, 2020, 128 : 33 - 46
  • [10] Learning Credible Deep Neural Networks with Rationale Regularization
    Du, Mengnan
    Liu, Ninghao
    Yang, Fan
    Hu, Xia
    2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019), 2019, : 150 - 159