Nonparametric Estimation of Information-Based Measures of Statistical Dispersion

被引:7
|
作者
Kostal, Lubomir [1 ]
Pokora, Ondrej [1 ]
机构
[1] Acad Sci Czech Republ, Inst Physiol, CR-14220 Prague, Czech Republic
来源
ENTROPY | 2012年 / 14卷 / 07期
关键词
statistical dispersion; entropy; Fisher information; nonparametric density estimation; FISHER INFORMATION; ENTROPY; VARIABILITY; NORMALITY; DISTRIBUTIONS; PATTERNS;
D O I
10.3390/e14071221
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
We address the problem of non-parametric estimation of the recently proposed measures of statistical dispersion of positive continuous random variables. The measures are based on the concepts of differential entropy and Fisher information and describe the "spread" or "variability" of the random variable from a different point of view than the ubiquitously used concept of standard deviation. The maximum penalized likelihood estimation of the probability density function proposed by Good and Gaskins is applied and a complete methodology of how to estimate the dispersion measures with a single algorithm is presented. We illustrate the approach on three standard statistical models describing neuronal activity.
引用
收藏
页码:1221 / 1233
页数:13
相关论文
共 50 条
  • [31] INFORMATION-BASED COMPLEXITY
    PACKEL, EW
    TRAUB, JF
    NATURE, 1987, 328 (6125) : 29 - 33
  • [32] Information-based productivity
    Bennett, S
    TECHNOLOGY AND SCHOLARLY COMMUNICATION, 1999, : 73 - 94
  • [33] INFORMATION-BASED COMPLEXITY
    WOZNIAKOWSKI, H
    ANNUAL REVIEW OF COMPUTER SCIENCE, 1986, 1 : 319 - 380
  • [34] Information-Based Argumentation
    Sierra, Carles
    Debenham, John
    KNOWLEDGE REPRESENTATION FOR AGENTS AND MULTI-AGENT SYSTEMS, 2009, 5605 : 130 - +
  • [35] On Nonparametric Estimation of the Fisher Information
    Cao, Wei
    Dytso, Alex
    Fauss, Michael
    Poor, H. Vincent
    Feng, Gang
    2020 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2020, : 2216 - 2221
  • [36] NONPARAMETRIC DENSITY ESTIMATION AND STATISTICAL DISCRIMINATION
    WINTER, BB
    PSYCHOLOGICAL BULLETIN, 1974, 81 (06) : 371 - 379
  • [37] INFORMATION-BASED HYPOTHESIS
    PARKER, EB
    JOURNAL OF COMMUNICATION, 1978, 28 (01) : 81 - 83
  • [38] Information-based trade
    Bond, Philip
    Eraslan, Huelya
    JOURNAL OF ECONOMIC THEORY, 2010, 145 (05) : 1675 - 1703
  • [39] Mutual information-based neighbor selection method for causal effect estimation
    Kiriakidou, Niki
    Livieris, Ioannis E.
    Pintelas, Panagiotis
    NEURAL COMPUTING & APPLICATIONS, 2024, 36 (16): : 9141 - 9155
  • [40] Video Mosaicing using a Mutual Information-based Motion Estimation Process
    Dame, Amaury
    Marchand, Eric
    2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2011, : 1493 - 1496