Maximizing Renyi Entropy Rate

被引:0
|
作者
Bunte, Christoph [1 ]
Lapidoth, Amos [1 ]
机构
[1] Swiss Fed Inst Technol, Zurich, Switzerland
关键词
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Of all univariate distributions on the nonnegative reals of a given mean, the distribution that maximizes the Renyi entropy is Lomax. But the memoryless Lomax stochastic process does not maximize the Renyi entropy rate: For Renyi orders smaller than one the supremum of the Renyi entropy rates is infinite, and for orders larger than one it is the differential Shannon entropy of the exponential distribution, which is the distribution that maximizes the differential Shannon entropy subject to these constraints. This is shown to be a special case of a much more general principle.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] Some properties of Renyi entropy and Renyi entropy rate
    Golshani, Leila
    Pasha, Einollah
    Yari, Gholamhossein
    INFORMATION SCIENCES, 2009, 179 (14) : 2426 - 2433
  • [2] A characterization of the Multivariate distributions maximizing Renyi entropy
    Costa, JA
    Hero, AO
    Vignat, C
    ISIT: 2002 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, PROCEEDINGS, 2002, : 263 - 263
  • [3] Maximum Renyi Entropy Rate
    Bunte, Christoph
    Lapidoth, Amos
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2016, 62 (03) : 1193 - 1205
  • [4] Estimation of entropy rate and Renyi entropy rate for Markov chains
    Kamath, Sudeep
    Verdu, Sergio
    2016 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, 2016, : 685 - 689
  • [5] Renyi entropy rate for Gaussian processes
    Golshani, Leila
    Pasha, Einollah
    INFORMATION SCIENCES, 2010, 180 (08) : 1486 - 1491
  • [6] Codes for Tasks and Renyi Entropy Rate
    Bunte, Christoph
    Lapidoth, Amos
    2014 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2014, : 346 - 350
  • [7] Renyi entropy measures of heart rate Gaussianity
    Lake, DE
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2006, 53 (01) : 21 - 27
  • [8] Exploration by Maximizing Renyi Entropy for Reward-Free RL Framework
    Zhang, Chuheng
    Cai, Yuanying
    Huang, Longbo
    Li, Jian
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 10859 - 10867
  • [9] Renyi Entropy Rate of Hidden Markov Processes
    Wu, Chengyu
    Xu, Easton Li
    Han, Guangyue
    2017 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2017,
  • [10] Entropy Density and Mismatch in High-Rate Scalar Quantization With Renyi Entropy Constraint
    Kreitmeier, Wolfgang
    Linder, Tamas
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2012, 58 (07) : 4105 - 4116