On the 'optimal' density power divergence tuning parameter

被引:43
|
作者
Basak, Sancharee [1 ]
Basu, Ayanendranath [1 ]
Jones, M. C. [2 ]
机构
[1] Indian Stat Inst, Interdisciplinary Stat Res Unit, 203 BT Rd, Kolkata 700108, India
[2] Open Univ, Sch Math & Stat, Milton Keynes, Bucks, England
关键词
Optimal tuning parameter; pilot estimator; summed mean square error; one-step Warwick-Jones algorithm; iterated Warwick-Jones algorithm; ROBUST ESTIMATION;
D O I
10.1080/02664763.2020.1736524
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The density power divergence, indexed by a single tuning parameter alpha, has proved to be a very useful tool in minimum distance inference. The family of density power divergences provides a generalized estimation scheme which includes likelihood-based procedures (represented by choice for the tuning parameter) as a special case. However, under data contamination, this scheme provides several more stable choices for model fitting and analysis (provided by positive values for the tuning parameter alpha). As larger values of alpha necessarily lead to a drop in model efficiency, determining the optimal value of alpha to provide the best compromise between model-efficiency and stability against data contamination in any real situation is a major challenge. In this paper, we provide a refinement of an existing technique with the aim of eliminating the dependence of the procedure on an initial pilot estimator. Numerical evidence is provided to demonstrate the very good performance of the method. Our technique has a general flavour, and we expect that similar tuning parameter selection algorithms will work well for other M-estimators, or any robust procedure that depends on the choice of a tuning parameter.
引用
收藏
页码:536 / 556
页数:21
相关论文
共 50 条
  • [21] Chance Constraint Tuning for Optimal Power Flow
    Hou, Ashley M.
    Roald, Line A.
    2020 INTERNATIONAL CONFERENCE ON PROBABILISTIC METHODS APPLIED TO POWER SYSTEMS (PMAPS), 2020,
  • [22] Optimal tuning parameter estimation in maximum penalized likelihood method
    Ueki, Masao
    Fueda, Kaoru
    ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2010, 62 (03) : 413 - 438
  • [23] ON THE OPTIMAL MINIMAX TUNING OF CONTROLLERS FOR DISTRIBUTED-PARAMETER SYSTEMS
    POHJOLAINEN, S
    LAAKSONEN, M
    LECTURE NOTES IN CONTROL AND INFORMATION SCIENCES, 1993, 185 : 636 - 648
  • [24] The Power of Scale for Parameter-Efficient Prompt Tuning
    Lester, Brian
    Al-Rfou, Rami
    Constant, Noah
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 3045 - 3059
  • [25] Optimal tuning parameter estimation in maximum penalized likelihood method
    Masao Ueki
    Kaoru Fueda
    Annals of the Institute of Statistical Mathematics, 2010, 62 : 413 - 438
  • [26] Minimum density power divergence estimator for GARCH models
    Sangyeol Lee
    Junmo Song
    TEST, 2009, 18 : 316 - 341
  • [27] Robust Bayes estimation using the density power divergence
    Abhik Ghosh
    Ayanendranath Basu
    Annals of the Institute of Statistical Mathematics, 2016, 68 : 413 - 437
  • [28] Minimum density power divergence estimator for diffusion processes
    Sangyeol Lee
    Junmo Song
    Annals of the Institute of Statistical Mathematics, 2013, 65 : 213 - 236
  • [29] Robust Bayes estimation using the density power divergence
    Ghosh, Abhik
    Basu, Ayanendranath
    ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2016, 68 (02) : 413 - 437
  • [30] Robust and efficient estimation by minimising a density power divergence
    Basu, A
    Harris, IR
    Hjort, NL
    Jones, MC
    BIOMETRIKA, 1998, 85 (03) : 549 - 559