On the Complexity of Approximating Multimarginal Optimal Transport

被引:0
|
作者
Lin, Tianyi [1 ]
Ho, Nhat [2 ]
Cuturi, Marco [3 ]
Jordan, Michael I. [1 ,4 ]
机构
[1] Department of Electrical Engineering and Computer Science, University of California, Berkeley,CA,94720-1776, United States
[2] Department of Statistics and Data Sciences, University of Texas, Austin,TX,78712-1823, United States
[3] Google Brain, Department of Statistics, CREST - ENSAE
[4] Department of Statistics, University of California, Berkeley,CA,94720-1776, United States
基金
美国国家科学基金会;
关键词
Linear programming - Probability distributions - Complex networks;
D O I
暂无
中图分类号
学科分类号
摘要
We study the complexity of approximating the multimarginal optimal transport (MOT) distance, a generalization of the classical optimal transport distance, considered here between m discrete probability distributions supported each on n support points. First, we show that the standard linear programming (LP) representation of the MOT problem is not a minimum-cost ow problem when m ≥3. This negative result implies that some combinatorial algorithms, e.g., network simplex method, are not suitable for approximating the MOT problem, while the worst-case complexity bound for the deterministic interior-point algorithm remains a quantity of eO (n3m). We then propose two simple and deterministic algorithms for approximating the MOT problem. The first algorithm, which we refer to as multimarginal Sinkhorn algorithm, is a provably efficient multimarginal generalization of the Sinkhorn algorithm. We show that it achieves a complexity bound of eO (m3nmϵ-2) for a tolerance ϵ 2 (0; 1). This provides a first near-linear time complexity bound guarantee for approximating the MOT problem and matches the best known complexity bound for the Sinkhorn algorithm in the classical OT setting when m = 2. The second algorithm, which we refer to as accelerated multimarginal Sinkhorn algorithm, achieves the acceleration by incorporating an estimate sequence and the complexity bound is eO (m3nm+1/3ϵ-4/3). This bound is better than that of the first algorithm in terms of 1/ϵ, and accelerated alternating minimization algorithm (Tupitsa et al., 2020) in terms of n. Finally, we compare our new algorithms with the commercial LP solver Gurobi. Preliminary results on synthetic data and real images demonstrate the effectiveness and efficiency of our algorithms. © 2022 Tianyi Lin, Nhat Ho, Macro Cuturi and Michael. I. Jordan.
引用
收藏
相关论文
共 50 条
  • [1] On the Complexity of Approximating Multimarginal Optimal Transport
    Lin, Tianyi
    Ho, Nhat
    Cuturi, Marco
    Jordan, Michael I.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [2] On Multimarginal Partial Optimal Transport: Equivalent Forms and Computational Complexity
    Khang Le
    Huy Nguyen
    Khai Nguyen
    Tung Pham
    Ho, Nhat
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 151, 2022, 151
  • [3] Multimarginal Optimal Transport by Accelerated Alternating Minimization
    Tupitsa, Nazarii
    Dvurechensky, Pavel
    Gasnikov, Alexander
    Uribe, Cesar A.
    2020 59TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2020, : 6132 - 6137
  • [4] Hardness results for Multimarginal Optimal Transport problems
    Altschuler, Jason M.
    Boix-Adserà, Enric
    Discrete Optimization, 2021, 42
  • [5] CONTINUITY OF MULTIMARGINAL OPTIMAL TRANSPORT WITH REPULSIVE COST
    Colombo, Maria
    Di Marino, Simone
    Stra, Federico
    SIAM JOURNAL ON MATHEMATICAL ANALYSIS, 2019, 51 (04) : 2903 - 2926
  • [6] Hardness results for Multimarginal Optimal Transport problems
    Altschuler, Jason M.
    Boix-Adsera, Enric
    DISCRETE OPTIMIZATION, 2021, 42
  • [7] Joint decomposition of multichannel signals with multimarginal optimal transport
    Mallejac, Jean
    Idier, Jerome
    Soussen, Charles
    Li, Xiangyi
    32ND EUROPEAN SIGNAL PROCESSING CONFERENCE, EUSIPCO 2024, 2024, : 2182 - 2186
  • [8] Efficient and Exact Multimarginal Optimal Transport with Pairwise Costs
    Zhou, Bohan
    Parno, Matthew
    JOURNAL OF SCIENTIFIC COMPUTING, 2024, 100 (01)
  • [9] EFFICIENT AND EXACT MULTIMARGINAL OPTIMAL TRANSPORT WITH PAIRWISE COSTS
    Zhou, Bohan
    Parno, Matthew
    arXiv, 2022,
  • [10] The multimarginal optimal transport formulation of adversarial multiclass classification
    Trillos, Nicolas Garcia
    Kim, Jakwang
    Jacobs, Matt
    JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24