Nonparametric Detection of Signals by Information Theoretic Criteria: Performance Analysis and an Improved Estimator

被引:123
|
作者
Nadler, Boaz [1 ]
机构
[1] Weizmann Inst Sci, Dept Comp Sci & Appl Math, IL-76100 Rehovot, Israel
关键词
Information theoretic criteria; performance analysis; random matrix theory; source enumeration; SOURCE ENUMERATION; MDL METHOD; NUMBER; COMPONENTS; COVARIANCE; MODEL;
D O I
10.1109/TSP.2010.2042481
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Determining the number of sources from observed data is a fundamental problem in many scientific fields. In this paper we consider the nonparametric setting, and focus on the detection performance of two popular estimators based on information theoretic criteria, the Akaike information criterion (AIC) and minimum description length (MDL). We present three contributions on this subject. First, we derive a new expression for the detection performance of the MDL estimator, which exhibits a much closer fit to simulations in comparison to previous formulas. Second, we present a random matrix theory viewpoint of the performance of the AIC estimator, including approximate analytical formulas for its overestimation probability. Finally, we show that a small increase in the penalty term of AIC leads to an estimator with a very good detection performance and a negligible overestimation probability.
引用
收藏
页码:2746 / 2756
页数:11
相关论文
共 50 条
  • [31] Feature selection for classificatory analysis based on information-theoretic criteria
    Department of Automation, Harbin University of Science and Technology, Harbin 150080, China
    不详
    Zidonghua Xuebao, 2008, 3 (383-392):
  • [32] Information Theoretic Based Comparative Analysis of Different Communication Signals in Plants
    Awan, Hamdan
    Adve, Raviraj S.
    Wallbridge, Nigel
    Plummer, Carrol
    Eckford, Andrew W.
    IEEE ACCESS, 2019, 7 : 117075 - 117087
  • [33] PERFORMANCE CRITERION FOR INFORMATION THEORETIC DATA-ANALYSIS
    KINSEY, JL
    LEVINE, RD
    CHEMICAL PHYSICS LETTERS, 1979, 65 (03) : 413 - 416
  • [34] Spatially distributed target detection based on EM algorithm and information-theoretic criteria
    Li T.
    Feng D.-Z.
    Xia Y.-Y.
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2010, 32 (04): : 908 - 912
  • [35] Improved detection performance using a Bayesian decision-theoretic approach
    Collins, L
    Keiswetter, D
    Carin, L
    Won, IJ
    PROCEEDINGS OF THE SYMPOSIUM ON THE APPLICATION OF GEOPHYSICS TO ENVIRONMENTAL AND ENGINEERING PROBLEMS, 1998, : 239 - 247
  • [36] Hybrid causal analysis combining a nonparametric multiplicative regression causality estimator with process connectivity information
    Landman, R.
    Jamsa-Jounela, S-L
    CONTROL ENGINEERING PRACTICE, 2019, 93
  • [37] Magnetic resonance image analysis by information theoretic criteria and stochastic site models
    Wang, Y
    Adali, T
    Xuan, JH
    Szabo, Z
    IEEE TRANSACTIONS ON INFORMATION TECHNOLOGY IN BIOMEDICINE, 2001, 5 (02): : 150 - 158
  • [38] Hyperharmonic analysis for the study of high-order information-theoretic signals
    Medina-Mardones, Anibal M.
    Rosas, Fernando E.
    Rodriguez, Sebastian E.
    Cofre, Rodrigo
    JOURNAL OF PHYSICS-COMPLEXITY, 2021, 2 (03):
  • [39] Information Theoretic Analysis of Canny Edge Detection in Visual Communication
    Jiang, Bo
    Rahman, Zia-ur
    VISUAL INFORMATION PROCESSING XX, 2011, 8056
  • [40] Information-Theoretic Analysis of Human Performance for Command Selection
    Liu, Wanyu
    Rioul, Olivier
    Beaudouin-Lafon, Michel
    Guiard, Yves
    HUMAN-COMPUTER INTERACTION - INTERACT 2017, PT III, 2017, 10515 : 515 - 524