An Optimal Transport Approach to the Computation of the LM Rate

被引:0
|
作者
Ye, Wenhao [1 ]
Wu, Huihui [2 ]
Wu, Shitong [1 ]
Wang, Yizhu [2 ]
Zhang, Wenyi [3 ]
Wu, Hao [1 ]
Bai, Bo [2 ]
机构
[1] Tsinghua Univ, Dept Math Sci, Beijing 100084, Peoples R China
[2] Huawei Tech Co Ltd, Cent Res Inst, Theory Lab, Labs 2012, Hong Kong, Peoples R China
[3] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Anhui, Peoples R China
关键词
Entropy optimization; LM rate; mismatch capacity; optimal transport; Sinkhorn algorithm; INFORMATION RATES; FADING CHANNELS;
D O I
10.1109/GLOBECOM48099.2022.10000926
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mismatch capacity characterizes the highest information rate for a channel under a prescribed decoding metric, and is thus a highly relevant fundamental performance metric when dealing with many practically important communication scenarios. Compared with the frequently used generalized mutual information (GMI), the LM rate has been known as a tighter lower bound of the mismatch capacity. The computation of the LM rate,(1) however, has been a difficult task, due to the fact that the LM rate involves a maximization over a function of the channel input, which becomes challenging as the input alphabet size grows, and direct numerical methods (e.g., interior point methods) suffer from intensive memory and computational resource requirements. Noting that the computation of the LM rate can also be formulated as an entropy-based optimization problem with constraints, in this work, we transform the task into an optimal transport (OT) problem with an extra constraint. This allows us to efficiently and accurately accomplish our task by using the well-known Sinkhorn algorithm. Indeed, only a few iterations are required for convergence, due to the fact that the formulated problem does not contain additional regularization terms. Moreover, we convert the extra constraint into a root-finding procedure for a one-dimensional monotonic function. Numerical experiments demonstrate the feasibility and efficiency of our OT approach to the computation of the LM rate.
引用
收藏
页码:239 / 244
页数:6
相关论文
共 50 条
  • [21] On the computation of switching surfaces in optimal control: A Grobner basis approach
    Walther, U
    Georgiou, TT
    Tannenbaum, A
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2001, 46 (04) : 534 - 540
  • [22] A New Approach to Round-Optimal Secure Multiparty Computation
    Ananth, Prabhanjan
    Choudhuri, Arka Rai
    Jain, Abhishek
    ADVANCES IN CRYPTOLOGY - CRYPTO 2017, PT I, 2017, 10401 : 468 - 499
  • [23] On the computation of switching surfaces in optimal control: A Grobner basis approach
    Walther
    Georgiou
    Tannenbaum
    2001, Institute of Electrical and Electronics Engineers Inc. (46)
  • [24] An optimal control approach to the computation of g-g diagrams
    Massaro, Matteo
    Lovato, Stefano
    Veneri, Matteo
    VEHICLE SYSTEM DYNAMICS, 2024, 62 (02) : 448 - 462
  • [25] Adaptive approach for the optimal computation of associative operations on SIMD architectures
    Hsu, C.-C.
    International Journal of Computers and Applications, 1997, 19 (01): : 38 - 44
  • [26] Minimax rate for optimal transport regression between distributions
    Ghodrati, Laya
    Panaretos, Victor M.
    STATISTICS & PROBABILITY LETTERS, 2023, 194
  • [27] Convergence rate of general entropic optimal transport costs
    Carlier, Guillaume
    Pegon, Paul
    Tamanini, Luca
    CALCULUS OF VARIATIONS AND PARTIAL DIFFERENTIAL EQUATIONS, 2023, 62 (04)
  • [28] Localisation determines the optimal noise rate for quantum transport
    Coates, Alexandre R.
    Lovett, Brendon W.
    Gauger, Erik M.
    NEW JOURNAL OF PHYSICS, 2021, 23 (12):
  • [29] Convergence rate of general entropic optimal transport costs
    Guillaume Carlier
    Paul Pegon
    Luca Tamanini
    Calculus of Variations and Partial Differential Equations, 2023, 62
  • [30] An Optimal Transport Approach to Personalized Federated Learning
    Farnia, Farzan
    Reisizadeh, Amirhossein
    Pedarsani, Ramtin
    Jadbabaie, Ali
    IEEE Journal on Selected Areas in Information Theory, 2022, 3 (02): : 162 - 171