Retarded learning: Rigorous results from statistical mechanics

被引：4
|
作者：
Herschkowitz, D
Opper, M
机构：
[1] Ecole Normale Super, Lab Phys Stat, F-75231 Paris, France
[2] Aston Univ, Neural Comp Res Grp, Birmingham B4 7ET, W Midlands, England
来源：
PHYSICAL REVIEW LETTERS | 2001年 / 86卷 / 10期
关键词：
D O I：
10.1103/PhysRevLett.86.2174
中图分类号：
O4 [物理学];
学科分类号：
0702 ;
摘要：
We study learning of probability distributions characterized by an unknown symmetry direction. Based on an entropic performance measure and the variational method of statistical mechanics we develop exact upper and lower bounds on the scaled critical number of examples below which learning of the direction is impossible. The asymptotic tightness of the bounds suggests an asymptotically optimal method for learning nonsmooth distributions.
引用
收藏
页码：2174 / 2177
页数：4
相关论文
共 50 条
  • [21] THE POLYTHERMAL ENSEMBLE - A RIGOROUS INTERPRETATION OF TEMPERATURE-FLUCTUATIONS IN STATISTICAL-MECHANICS
    PHILLIES, GDJ
    AMERICAN JOURNAL OF PHYSICS, 1984, 52 (07) : 629 - 632
  • [22] STATISTICAL-MECHANICS OF UNSUPERVISED LEARNING
    BIEHL, M
    MIETZNER, A
    EUROPHYSICS LETTERS, 1993, 24 (05): : 421 - 426
  • [23] THE STATISTICAL-MECHANICS OF LEARNING A RULE
    WATKIN, TLH
    RAU, A
    BIEHL, M
    REVIEWS OF MODERN PHYSICS, 1993, 65 (02) : 499 - 556
  • [24] Statistical mechanics of learning in the presence of outliers
    Dietrich, R
    Opper, M
    JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1998, 31 (46): : 9131 - 9147
  • [25] Statistical properties of nonlinear shell models of turbulence from linear advection models: rigorous results
    Benzi, Roberto
    Levant, Boris
    Procaccia, Itamar
    Titi, Edriss S.
    NONLINEARITY, 2007, 20 (06) : 1431 - 1441
  • [26] UTILITY OF EXACT RESULTS IN STATISTICAL-MECHANICS
    GRIFFITHS, RB
    BULLETIN OF THE AMERICAN PHYSICAL SOCIETY, 1978, 23 (01): : 25 - 25
  • [27] Measuring the Stability of Results From Supervised Statistical Learning
    Philipp, Michel
    Rusch, Thomas
    Hornik, Kurt
    Strobl, Carolin
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2018, 27 (04) : 685 - 700
  • [28] RECENT DEVELOPMENTS IN RIGOROUS STUDIES OF FIELD-THEORY AND STATISTICAL-MECHANICS - PREFACE
    HATTORI, T
    PROGRESS OF THEORETICAL PHYSICS SUPPLEMENT, 1987, (92): : R1 - R1
  • [29] Statistical mechanics of mutual learning with a latent teacher
    Hara, Kazuyuki
    Okada, Masato
    JOURNAL OF THE PHYSICAL SOCIETY OF JAPAN, 2007, 76 (01)
  • [30] Statistical mechanics of online learning for ensemble teachers
    Miyoshi, Seiji
    Okada, Masato
    2006 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORK PROCEEDINGS, VOLS 1-10, 2006, : 750 - +
12345