Hessian spectrum at the global minimum of high-dimensional random landscapes

被引:17
|
作者
Fyodorov, Yan, V [1 ]
Le Doussal, Pierre [2 ]
机构
[1] Kings Coll London, Dept Math, London WC2R 2LS, England
[2] PSL Univ, Sorbonne Univ, Lab Phys Theor, Ecole Normale Super,CNRS, 24 Rue Lhomond, F-75231 Paris 05, France
基金
英国工程与自然科学研究理事会;
关键词
spin glasses; random landscapes; random matrix; Hessian; REPLICA SYMMETRY-BREAKING; RANDOM SMOOTH FUNCTIONS; CRITICAL-POINTS; SUPERSYMMETRIC VACUA; RANDOM MATRICES; ELASTIC THEORY; SPIN-GLASSES; COMPLEXITY; DYNAMICS; NUMBER;
D O I
10.1088/1751-8121/aae74f
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Using the replica method we calculate the mean spectral density of the Hessian matrix at the global minimum of a random N >> 1 dimensional isotropic, translationally invariant Gaussian random landscape confined by a parabolic potential with fixed curvature mu > 0. Simple landscapes with generically a single minimum are typical for mu > mu(c), and we show that the Hessian at the global minimum is always gapped, with the low spectral edge being strictly positive. When approaching from above the transitional point mu = mu(c) separating simple landscapes from 'glassy' ones, with exponentially abundant minima, the spectral gap vanishes as (mu-mu(c))(2). For mu < mu(c) the Hessian spectrum is qualitatively different for 'moderately complex' and 'genuinely complex' landscapes. The former are typical for short-range correlated random potentials and correspond to one-step replica-symmetry breaking mechanism. Their Hessian spectra turn out to be again gapped, with the gap vanishing on approaching mu(c) from below with a larger critical exponent, as (mu(c)-mu)(4). At the same time in the 'most complex' landscapes with long-ranged power-law correlations the replica symmetry is completely broken. We show that in that case the Hessian remains gapless for all values of mu < mu(c), indicating the presence of 'marginally stable' spatial directions. Finally, the potentials with logarithmic correlations share both 1RSB nature and gapless spectrum. The spectral density of the Hessian always takes the semi-circular form, up to a shift and an amplitude that we explicitly calculate.
引用
收藏
页数:27
相关论文
共 50 条
  • [41] Random projections for high-dimensional optimization problems
    Ky Vu
    4OR, 2017, 15 : 327 - 328
  • [42] Random graph asymptotics on high-dimensional tori
    Heydenreich, Markus
    van der Hofstad, Remco
    COMMUNICATIONS IN MATHEMATICAL PHYSICS, 2007, 270 (02) : 335 - 358
  • [43] Cliques in High-Dimensional Random Geometric Graphs
    Avrachenkov, Konstantin
    Bobu, Andrei
    COMPLEX NETWORKS AND THEIR APPLICATIONS VIII, VOL 1, 2020, 881 : 591 - 600
  • [44] Random Graph Asymptotics on High-Dimensional Tori
    Markus Heydenreich
    Remco van der Hofstad
    Communications in Mathematical Physics, 2007, 270 : 335 - 358
  • [45] Cliques in high-dimensional random geometric graphs
    Konstantin E. Avrachenkov
    Andrei V. Bobu
    Applied Network Science, 5
  • [46] Analysis of minimum distances in high-dimensional musical spaces
    Casey, Michael
    Rhodes, Christophe
    Slaney, Malcolm
    IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2008, 16 (05): : 1015 - 1028
  • [47] Minimum Distance Lasso for robust high-dimensional regression
    Lozano, Aurelie C.
    Meinshausen, Nicolai
    Yang, Eunho
    ELECTRONIC JOURNAL OF STATISTICS, 2016, 10 (01): : 1296 - 1340
  • [48] THE SPECTRUM OF HIGH-DIMENSIONAL PSEUDODIFFERENTIAL PERIODIC OPERATORS
    YAKOVLEV, NN
    VESTNIK MOSKOVSKOGO UNIVERSITETA SERIYA 1 MATEMATIKA MEKHANIKA, 1985, (03): : 80 - 81
  • [49] On the effectiveness of evolutionary search in high-dimensional NK-landscapes
    Merz, P
    Freisleben, B
    1998 IEEE INTERNATIONAL CONFERENCE ON EVOLUTIONARY COMPUTATION - PROCEEDINGS, 1998, : 741 - 745
  • [50] Exploring high-dimensional free energy landscapes of chemical reactions
    Awasthi, Shalini
    Nair, Nisanth N.
    WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL MOLECULAR SCIENCE, 2019, 9 (03)