Nonparametric Detection of Signals by Information Theoretic Criteria: Performance Analysis and an Improved Estimator

被引:123
|
作者
Nadler, Boaz [1 ]
机构
[1] Weizmann Inst Sci, Dept Comp Sci & Appl Math, IL-76100 Rehovot, Israel
关键词
Information theoretic criteria; performance analysis; random matrix theory; source enumeration; SOURCE ENUMERATION; MDL METHOD; NUMBER; COMPONENTS; COVARIANCE; MODEL;
D O I
10.1109/TSP.2010.2042481
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Determining the number of sources from observed data is a fundamental problem in many scientific fields. In this paper we consider the nonparametric setting, and focus on the detection performance of two popular estimators based on information theoretic criteria, the Akaike information criterion (AIC) and minimum description length (MDL). We present three contributions on this subject. First, we derive a new expression for the detection performance of the MDL estimator, which exhibits a much closer fit to simulations in comparison to previous formulas. Second, we present a random matrix theory viewpoint of the performance of the AIC estimator, including approximate analytical formulas for its overestimation probability. Finally, we show that a small increase in the penalty term of AIC leads to an estimator with a very good detection performance and a negligible overestimation probability.
引用
收藏
页码:2746 / 2756
页数:11
相关论文
共 50 条
  • [41] Information-theoretic performance analysis of LMS MIMO communications
    Alfano, Giuseppa
    De Maio, Antonio
    Tulino, Antonia M.
    2010 IEEE INFORMATION THEORY WORKSHOP (ITW), 2010,
  • [42] Enhancing information discriminant analysis: Feature extraction with linear statistical model and information-theoretic criteria
    Li, Liling
    Du, Lan
    Zhang, Wei
    He, Hua
    Wang, Penghui
    PATTERN RECOGNITION, 2016, 60 : 554 - 570
  • [43] Improved Processing of LP-residual Information for Detection of Replay Signals
    Dutta, Krishna
    Singh, Madhusudan
    Pati, Debadatta
    2019 IEEE 16TH INDIA COUNCIL INTERNATIONAL CONFERENCE (IEEE INDICON 2019), 2019,
  • [44] Phased array multipath detection: Power delay profile vs. information theoretic criteria
    Durkin, Christopher J.
    Durgin, Gregory D.
    2007 IEEE ANTENNAS AND PROPAGATION SOCIETY INTERNATIONAL SYMPOSIUM, VOLS 1-12, 2007, : 1016 - 1019
  • [45] Network Traffic Pattern Analysis Using Improved Information Theoretic Co-clustering Based Collective Anomaly Detection
    Ahmed, Mohiuddin
    Mahmood, Abdun Naser
    INTERNATIONAL CONFERENCE ON SECURITY AND PRIVACY IN COMMUNICATION NETWORKS, SECURECOMM 2014, PT II, 2015, 153 : 204 - 219
  • [46] Detecting and estimating signals over noisy and unreliable synapses: Information-theoretic analysis
    Manwani, A
    Koch, C
    NEURAL COMPUTATION, 2001, 13 (01) : 1 - 33
  • [47] A decision-theoretic approach to acquire environmental information for improved subsea search performance
    Yetkin, Harun
    Lutz, Collin
    Stilwell, Daniel J.
    OCEAN ENGINEERING, 2020, 204
  • [48] Clustering needles in a haystack: An information theoretic analysis of minority and outlier detection
    Ando, Shin
    ICDM 2007: PROCEEDINGS OF THE SEVENTH IEEE INTERNATIONAL CONFERENCE ON DATA MINING, 2007, : 13 - 22
  • [49] Performance Analysis of Information Theoretic Learning-Based Cooperative Localization
    Mitra, Rangeet
    Kaddoum, Georges
    Dahman, Ghassan
    Poitau, Gwenael
    IEEE COMMUNICATIONS LETTERS, 2021, 25 (07) : 2196 - 2200
  • [50] A Framework for Supervised Classification Performance Analysis with Information-Theoretic Methods
    Valverde-Albacete, Francisco J.
    Pelaez-Moreno, Carmen
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2020, 32 (11) : 2075 - 2087