Kullback-Leibler Divergence and Mutual Information of Partitions in Product MV Algebras

被引:3
|
作者
Markechova, Dagmar [1 ]
Riecan, Beloslav [2 ,3 ]
机构
[1] Constantine Philosopher Univ Nitra, Dept Math, Fac Nat Sci, Hlinku 1, SK-94901 Nitra, Slovakia
[2] Matej Bel Univ, Dept Math, Fac Nat Sci, Tajovskeho 40, SK-97401 Banska Bystrica, Slovakia
[3] Slovak Acad Sci, Math Inst, Stefanikova 49, SK-81473 Bratislava, Slovakia
关键词
product MV algebra; partition; Shannon's entropy; Kullback-Leibler divergence; mutual information; conditional mutual information; RIESZ-DECOMPOSITION PROPERTY; DYNAMICAL-SYSTEMS; ENTROPY; PROBABILITY;
D O I
10.3390/e19060267
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
The purpose of the paper is to introduce, using the known results concerning the entropy in product MV algebras, the concepts of mutual information and Kullback-Leibler divergence for the case of product MV algebras and examine algebraic properties of the proposed measures. In particular, a convexity of Kullback-Leibler divergence with respect to states in product MV algebras is proved, and chain rules for mutual information and Kullback-Leibler divergence are established. In addition, the data processing inequality for conditionally independent partitions in product MV algebras is proved.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Mutual Information and Kullback-Leibler Divergence in the Dempster-Shafer Theory
    Shenoy, Prakash P.
    BELIEF FUNCTIONS: THEORY AND APPLICATIONS, BELIEF 2024, 2024, 14909 : 225 - 233
  • [2] Renyi Divergence and Kullback-Leibler Divergence
    van Erven, Tim
    Harremoes, Peter
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (07) : 3797 - 3820
  • [3] The fractional Kullback-Leibler divergence
    Alexopoulos, A.
    JOURNAL OF PHYSICS A-MATHEMATICAL AND THEORETICAL, 2021, 54 (07)
  • [4] BOUNDS FOR KULLBACK-LEIBLER DIVERGENCE
    Popescu, Pantelimon G.
    Dragomir, Sever S.
    Slusanschi, Emil I.
    Stanasila, Octavian N.
    ELECTRONIC JOURNAL OF DIFFERENTIAL EQUATIONS, 2016,
  • [5] Parameter identifiability with Kullback-Leibler information divergence criterion
    Chen, Badong
    Hu, Jinchun
    Zhu, Yu
    Sun, Zengqi
    INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2009, 23 (10) : 940 - 960
  • [6] On the Kullback-Leibler information divergence of locally stationary processes
    Dahlhaus, R
    STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 1996, 62 (01) : 139 - 168
  • [7] Kullback-Leibler Divergence Revisited
    Raiber, Fiana
    Kurland, Oren
    ICTIR'17: PROCEEDINGS OF THE 2017 ACM SIGIR INTERNATIONAL CONFERENCE THEORY OF INFORMATION RETRIEVAL, 2017, : 117 - 124
  • [8] On the Interventional Kullback-Leibler Divergence
    Wildberger, Jonas
    Guo, Siyuan
    Bhattacharyya, Arnab
    Schoelkopf, Bernhard
    CONFERENCE ON CAUSAL LEARNING AND REASONING, VOL 213, 2023, 213 : 328 - 349
  • [9] MONOTONICITY OF THE FISHER INFORMATION AND THE KULLBACK-LEIBLER DIVERGENCE MEASURE
    RYU, KW
    ECONOMICS LETTERS, 1993, 42 (2-3) : 121 - 128
  • [10] Converting information into probability measures with the Kullback-Leibler divergence
    Bissiri, Pier Giovanni
    Walker, Stephen G.
    ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2012, 64 (06) : 1139 - 1160