Nonparametric Detection of Signals by Information Theoretic Criteria: Performance Analysis and an Improved Estimator

被引:123
|
作者
Nadler, Boaz [1 ]
机构
[1] Weizmann Inst Sci, Dept Comp Sci & Appl Math, IL-76100 Rehovot, Israel
关键词
Information theoretic criteria; performance analysis; random matrix theory; source enumeration; SOURCE ENUMERATION; MDL METHOD; NUMBER; COMPONENTS; COVARIANCE; MODEL;
D O I
10.1109/TSP.2010.2042481
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Determining the number of sources from observed data is a fundamental problem in many scientific fields. In this paper we consider the nonparametric setting, and focus on the detection performance of two popular estimators based on information theoretic criteria, the Akaike information criterion (AIC) and minimum description length (MDL). We present three contributions on this subject. First, we derive a new expression for the detection performance of the MDL estimator, which exhibits a much closer fit to simulations in comparison to previous formulas. Second, we present a random matrix theory viewpoint of the performance of the AIC estimator, including approximate analytical formulas for its overestimation probability. Finally, we show that a small increase in the penalty term of AIC leads to an estimator with a very good detection performance and a negligible overestimation probability.
引用
收藏
页码:2746 / 2756
页数:11
相关论文
共 50 条
  • [21] Improved binary classification performance using an information theoretic criterion
    Burrascano, P
    Pirollo, D
    NEUROCOMPUTING, 1996, 13 (2-4) : 375 - 383
  • [22] Information-theoretic characterization of Bayes performance and the choice of priors in parametric and nonparametric problems
    Barron, AR
    BAYESIAN STATISTICS 6, 1999, : 27 - 52
  • [23] Comparison of Information Criteria for Detection of Useful Signals in Noisy Environments
    Berlin, Leonid
    Galyaev, Andrey
    Lysenko, Pavel
    SENSORS, 2023, 23 (04)
  • [24] An Improved Signal Number Estimation Method Based on Information Theoretic Criteria in Array Processing
    Bin, Jiang
    Lu An'nan
    Jie, Xu
    2019 IEEE 11TH INTERNATIONAL CONFERENCE ON COMMUNICATION SOFTWARE AND NETWORKS (ICCSN 2019), 2019, : 193 - 197
  • [25] Signal detection and estimation using atomic decomposition and information-theoretic criteria
    López-Risueño, G
    Grajal, J
    Yeste-Ojeda, OA
    2004 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL II, PROCEEDINGS: SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING SIGNAL PROCESSING THEORY AND METHODS, 2004, : 1097 - 1100
  • [26] Joint Detection and DOA Tracking with a Bernoulli Filter Based on Information Theoretic Criteria
    Zhang, Guangpu
    Zheng, Ce
    Sun, Sibo
    Liang, Guolong
    Zhang, Yifeng
    SENSORS, 2018, 18 (10)
  • [27] On the behavior of information theoretic criteria for model order selection of InSAR signals corrupted by multiplicative noise
    Gini, F
    Bordoni, F
    SIGNAL PROCESSING, 2003, 83 (05) : 1047 - 1063
  • [28] ON INFORMATION THEORETIC CRITERIA FOR DETERMINING THE NUMBER OF SIGNALS IN HIGH-RESOLUTION ARRAY-PROCESSING
    WONG, KM
    ZHANG, QT
    REILLY, JP
    YIP, PC
    IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1990, 38 (11): : 1959 - 1971
  • [29] Information Theoretic Analysis of Edge Detection in Visual Communication
    Jiang, Bo
    Rahman, Zia-ur
    MATHEMATICS OF DATA/IMAGE CODING, COMPRESSION, AND ENCRYPTION WITH APPLICATIONS XII, 2010, 7799
  • [30] Eigen-analysis of UWB channel on the basis of information theoretic criteria
    Chehri, Abdellah
    Fortier, Paul
    Tardif, Pierre-Martin
    2007 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, VOLS 1-14, 2007, : 4891 - +