Retarded learning: Rigorous results from statistical mechanics

被引：4
|
作者：
Herschkowitz, D
Opper, M
机构：
[1] Ecole Normale Super, Lab Phys Stat, F-75231 Paris, France
[2] Aston Univ, Neural Comp Res Grp, Birmingham B4 7ET, W Midlands, England
来源：
PHYSICAL REVIEW LETTERS | 2001年 / 86卷 / 10期
关键词：
D O I：
10.1103/PhysRevLett.86.2174
中图分类号：
O4 [物理学];
学科分类号：
0702 ;
摘要：
We study learning of probability distributions characterized by an unknown symmetry direction. Based on an entropic performance measure and the variational method of statistical mechanics we develop exact upper and lower bounds on the scaled critical number of examples below which learning of the direction is impossible. The asymptotic tightness of the bounds suggests an asymptotically optimal method for learning nonsmooth distributions.
引用
收藏
页码：2174 / 2177
页数：4
相关论文
共 50 条
  • [41] STATISTICAL-MECHANICS OF GENERALIZATION - NEW RESULTS FOR PERCEPTRONS
    KINZEL, W
    PHYSICA A, 1993, 200 (1-4): : 613 - 618
  • [42] Statistical mechanics and machine learning of the α-Rényi ensemble
    Jreissaty, Andrew
    Carrasquilla, Juan
    PHYSICAL REVIEW RESEARCH, 2025, 7 (01):
  • [43] Nonextensive statistical mechanics for hybrid learning of neural networks
    Anastasiadis, AD
    Magoulas, GD
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2004, 344 (3-4) : 372 - 382
  • [44] Statistical mechanics of time-domain ensemble learning
    Miyoshi, Seiji
    Uezu, Tatsuya
    Okada, Masato
    JOURNAL OF THE PHYSICAL SOCIETY OF JAPAN, 2006, 75 (08)
  • [45] Bounds for predictive errors in the statistical mechanics of supervised learning
    1600, American Inst of Physics, Woodbury, NY, USA (75):
  • [46] Statistical mechanics approach to a reinforcement learning model with memory
    Lipowski, Adam
    Gontarek, Krzysztof
    Ausloos, Marcel
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2009, 388 (09) : 1849 - 1856
  • [47] STATISTICAL-MECHANICS OF LEARNING ALGORITHMS FOR NEURAL NETWORKS
    OPPER, M
    DIEDERICH, S
    ANLAUF, J
    NEURAL NETWORKS FROM MODELS TO APPLICATIONS, 1989, : 235 - 243
  • [48] An experimental approach to teaching and learning elementary statistical mechanics
    Ellis, Frank B.
    Ellis, David C.
    JOURNAL OF CHEMICAL EDUCATION, 2008, 85 (01) : 78 - 82
  • [49] An experimental approach to teaching and learning elementary statistical mechanics
    Ellis, Frank B.
    Ellis, David C.
    Lambert, Frank L.
    JOURNAL OF CHEMICAL EDUCATION, 2008, 85 (09) : 1191 - 1191
  • [50] Learning nonequilibrium statistical mechanics and dynamical phase transitions
    Tang, Ying
    Liu, Jing
    Zhang, Jiang
    Zhang, Pan
    NATURE COMMUNICATIONS, 2024, 15 (01)
12345