An Optimal Transport Approach to the Computation of the LM Rate

被引:0
|
作者
Ye, Wenhao [1 ]
Wu, Huihui [2 ]
Wu, Shitong [1 ]
Wang, Yizhu [2 ]
Zhang, Wenyi [3 ]
Wu, Hao [1 ]
Bai, Bo [2 ]
机构
[1] Tsinghua Univ, Dept Math Sci, Beijing 100084, Peoples R China
[2] Huawei Tech Co Ltd, Cent Res Inst, Theory Lab, Labs 2012, Hong Kong, Peoples R China
[3] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Anhui, Peoples R China
关键词
Entropy optimization; LM rate; mismatch capacity; optimal transport; Sinkhorn algorithm; INFORMATION RATES; FADING CHANNELS;
D O I
10.1109/GLOBECOM48099.2022.10000926
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mismatch capacity characterizes the highest information rate for a channel under a prescribed decoding metric, and is thus a highly relevant fundamental performance metric when dealing with many practically important communication scenarios. Compared with the frequently used generalized mutual information (GMI), the LM rate has been known as a tighter lower bound of the mismatch capacity. The computation of the LM rate,(1) however, has been a difficult task, due to the fact that the LM rate involves a maximization over a function of the channel input, which becomes challenging as the input alphabet size grows, and direct numerical methods (e.g., interior point methods) suffer from intensive memory and computational resource requirements. Noting that the computation of the LM rate can also be formulated as an entropy-based optimization problem with constraints, in this work, we transform the task into an optimal transport (OT) problem with an extra constraint. This allows us to efficiently and accurately accomplish our task by using the well-known Sinkhorn algorithm. Indeed, only a few iterations are required for convergence, due to the fact that the formulated problem does not contain additional regularization terms. Moreover, we convert the extra constraint into a root-finding procedure for a one-dimensional monotonic function. Numerical experiments demonstrate the feasibility and efficiency of our OT approach to the computation of the LM rate.
引用
收藏
页码:239 / 244
页数:6
相关论文
共 50 条
  • [31] Statistical Physics Approach to the Optimal Transport Problem
    Koehl, Patrice
    Delarue, Marc
    Orland, Henri
    PHYSICAL REVIEW LETTERS, 2019, 123 (04)
  • [32] VECTOR QUANTILE REGRESSION: AN OPTIMAL TRANSPORT APPROACH
    Carlier, Guillaume
    Chernozhukov, Victor
    Galichon, Alfred
    ANNALS OF STATISTICS, 2016, 44 (03): : 1165 - 1192
  • [33] κ-statistics approach to optimal transport waveform inversion
    da Silva, Sergio Luiz E. F.
    Kaniadakis, G.
    PHYSICAL REVIEW E, 2022, 106 (03)
  • [34] Measure estimation on manifolds: an optimal transport approach
    Vincent Divol
    Probability Theory and Related Fields, 2022, 183 : 581 - 647
  • [35] An Optimal Transport Approach for the Kinetic Bohmian Equation
    Gangbo W.
    Haskovec J.
    Markowich P.
    Sierra J.
    Journal of Mathematical Sciences, 2019, 238 (4) : 415 - 452
  • [36] Measure estimation on manifolds: an optimal transport approach
    Divol, Vincent
    PROBABILITY THEORY AND RELATED FIELDS, 2022, 183 (1-2) : 581 - 647
  • [37] A PERTURBATIVE APPROACH TO THE PARABOLIC OPTIMAL TRANSPORT PROBLEM
    Abedin, Farhan
    Kitagawa, Jun
    SIAM JOURNAL ON MATHEMATICAL ANALYSIS, 2023, 55 (06) : 6740 - 6763
  • [38] Constrained Reweighting of Distributions: An Optimal Transport Approach
    Chakraborty, Abhisek
    Bhattacharya, Anirban
    Pati, Debdeep
    ENTROPY, 2024, 26 (03)
  • [39] A MINIMALIST APPROACH FOR DOMAIN ADAPTATION WITH OPTIMAL TRANSPORT
    Asadulaev, Arip
    Shutov, Vitaly
    Korotin, Alexander
    Panfilov, Alexander
    Kontsevaya, Vladislava
    Filchenkov, Andrey
    CONFERENCE ON LIFELONG LEARNING AGENTS, VOL 232, 2023, 232 : 1009 - 1024
  • [40] A Vectorial Approach to Unbalanced Optimal Mass Transport
    Zhu, Jiening
    Elkin, Rena
    Oh, Jung Hun
    Deasy, Joseph O.
    Tannenbaum, Allen
    IEEE ACCESS, 2020, 8 : 209224 - 209231