Concentration inequalities for the exponential weighting method

被引:2
|
作者
Golubev Y. [1 ,2 ]
Ostrovski D. [3 ]
机构
[1] Aix Marseille Univ., Marseille
[2] Inst. for Inform. Transmission Problems, Moscow
[3] Inst. of Physics and Technology, Moscow
关键词
concentration inequality; exponential weighting; oracle inequality; ordered smoothers; unbiased risk estimation;
D O I
10.3103/S1066530714010025
中图分类号
学科分类号
摘要
The paper is concerned with recovering an unknown vector from noisy data with the help of a family of ordered smoothers [11]. The estimators within this family are aggregated based on the exponential weighting method and the performance of the aggregated estimate is measured by the excess risk controlling deviation of the square losses from the oracle risk. Based on natural statistical properties of ordered smoothers, we propose a novel method for obtaining concentration inequalities for the exponential weighting method. © 2014 Allerton Press, Inc.
引用
收藏
页码:20 / 37
页数:17
相关论文
共 50 条
  • [41] Sobolev inequalities of exponential type
    Edmunds, DE
    Hurri-Syrjänen, R
    ISRAEL JOURNAL OF MATHEMATICS, 2001, 123 (1) : 61 - 92
  • [42] New inequalities for the exponential function
    Qiu, Song-Liang
    Ma, Xiao-Yan
    He, Jian-Hui
    JAEN JOURNAL ON APPROXIMATION, 2021, 12 : 175 - 200
  • [43] Weak transport inequalities and applications to exponential and oracle inequalities
    Wintenberger, Olivier
    ELECTRONIC JOURNAL OF PROBABILITY, 2015, 20
  • [44] Robust Watermarking of Neural Network with Exponential Weighting
    Namba, Ryota
    Sakuma, Jun
    PROCEEDINGS OF THE 2019 ACM ASIA CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY (ASIACCS '19), 2019, : 228 - 240
  • [45] Exponential inequalities for empirical processes
    Rio, E
    COMPTES RENDUS DE L ACADEMIE DES SCIENCES SERIE I-MATHEMATIQUE, 2000, 330 (07): : 597 - 600
  • [46] Concentration inequalities
    Boucheron, S
    Lugosi, G
    Bousquet, O
    ADVANCED LECTURES ON MACHINE LEARNING, 2004, 3176 : 208 - 240
  • [47] Exponential weighting algorithms for reconstruction of bandlimited signals
    Pawlak, M
    Rafajlowicz, E
    Krzyzak, A
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1996, 44 (03) : 538 - 545
  • [48] Modal parameter identification using exponential weighting
    Cooper, JE
    INTEGRATING DYNAMICS, CONDITION MONITORING AND CONTROL FOR THE 21ST CENTURY - DYMAC 99, 1999, : 475 - 479
  • [49] Concentration Inequalities
    Massart, Pascal
    CONCENTRATION INEQUALITIES AND MODEL SELECTION: ECOLE D'ETE DE PROBABILITES DE SAINT-FLOUR XXXIII - 2003, 2007, 1896 : 147 - 181
  • [50] COMPLEX EXPONENTIAL WEIGHTING APPLIED TO HOMOMORPHIC DECONVOLUTION
    SHENSA, MJ
    GEOPHYSICAL JOURNAL OF THE ROYAL ASTRONOMICAL SOCIETY, 1976, 44 (02): : 379 - 387