An Optimal Transport Approach to the Computation of the LM Rate

被引:0
|
作者
Ye, Wenhao [1 ]
Wu, Huihui [2 ]
Wu, Shitong [1 ]
Wang, Yizhu [2 ]
Zhang, Wenyi [3 ]
Wu, Hao [1 ]
Bai, Bo [2 ]
机构
[1] Tsinghua Univ, Dept Math Sci, Beijing 100084, Peoples R China
[2] Huawei Tech Co Ltd, Cent Res Inst, Theory Lab, Labs 2012, Hong Kong, Peoples R China
[3] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Anhui, Peoples R China
关键词
Entropy optimization; LM rate; mismatch capacity; optimal transport; Sinkhorn algorithm; INFORMATION RATES; FADING CHANNELS;
D O I
10.1109/GLOBECOM48099.2022.10000926
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mismatch capacity characterizes the highest information rate for a channel under a prescribed decoding metric, and is thus a highly relevant fundamental performance metric when dealing with many practically important communication scenarios. Compared with the frequently used generalized mutual information (GMI), the LM rate has been known as a tighter lower bound of the mismatch capacity. The computation of the LM rate,(1) however, has been a difficult task, due to the fact that the LM rate involves a maximization over a function of the channel input, which becomes challenging as the input alphabet size grows, and direct numerical methods (e.g., interior point methods) suffer from intensive memory and computational resource requirements. Noting that the computation of the LM rate can also be formulated as an entropy-based optimization problem with constraints, in this work, we transform the task into an optimal transport (OT) problem with an extra constraint. This allows us to efficiently and accurately accomplish our task by using the well-known Sinkhorn algorithm. Indeed, only a few iterations are required for convergence, due to the fact that the formulated problem does not contain additional regularization terms. Moreover, we convert the extra constraint into a root-finding procedure for a one-dimensional monotonic function. Numerical experiments demonstrate the feasibility and efficiency of our OT approach to the computation of the LM rate.
引用
收藏
页码:239 / 244
页数:6
相关论文
共 50 条
  • [1] A Communication Optimal Transport Approach to the Computation of Rate Distortion Functions
    Wu, Shitong
    Ye, Wenhao
    Wu, Hao
    Wu, Huihui
    Zhang, Wenyi
    Bai, Bo
    2023 IEEE INFORMATION THEORY WORKSHOP, ITW, 2023, : 92 - 96
  • [2] An Optimal-Transport-Based Reinforcement Learning Approach for Computation Offloading
    Li, Zhuo
    Zhou, Xu
    Li, Taixin
    Liu, Yang
    2021 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2021,
  • [3] Computation of optimal transport with finite volumes
    Natale, Andrea
    Todeschi, Gabriele
    ESAIM-MATHEMATICAL MODELLING AND NUMERICAL ANALYSIS, 2021, 55 (05) : 1847 - 1871
  • [4] Optimal Transport Layer for Secure Computation
    Brandt, Markus
    Orlandi, Claudio
    Shrishak, Kris
    Shulman, Haya
    PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON E-BUSINESS AND TELECOMMUNICATIONS (SECRYPT), VOL 1, 2020, : 130 - 141
  • [5] On Scalable and Efficient Computation of Large Scale Optimal Transport
    Xie, Yujia
    Chen, Minshuo
    Jiang, Haoming
    Zhao, Tuo
    Zha, Hongyuan
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [6] Computation of optimal transport on discrete metric measure spaces
    Erbar, Matthias
    Rumpf, Martin
    Schmitzer, Bernhard
    Simon, Stefan
    NUMERISCHE MATHEMATIK, 2020, 144 (01) : 157 - 200
  • [7] On Robust Optimal Transport: Computational Complexity and Barycenter Computation
    Khang Le
    Huy Nguyen
    Quang Minh Nguyen
    Tung Pham
    Hung Bui
    Nhat Ho
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [8] Computation of optimal transport on discrete metric measure spaces
    Matthias Erbar
    Martin Rumpf
    Bernhard Schmitzer
    Stefan Simon
    Numerische Mathematik, 2020, 144 : 157 - 200
  • [9] A Multiscale Approach to Optimal Transport
    Merigot, Quentin
    COMPUTER GRAPHICS FORUM, 2011, 30 (05) : 1583 - 1592
  • [10] An optimal control approach to optical flow computation
    Borzì, A
    Ito, K
    Kunisch, K
    INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN FLUIDS, 2002, 40 (1-2) : 231 - 240