Critical behavior in lossy source coding

被引:7
|
作者
Dembo, A [1 ]
Kontoyiannis, I
机构
[1] Stanford Univ, Dept Math, Stanford, CA 94305 USA
[2] Stanford Univ, Dept Stat, Stanford, CA 94305 USA
[3] Brown Univ, Div Appl Math, Providence, RI 02912 USA
关键词
lossy data compression; rate-distortion theory; redundancy;
D O I
10.1109/18.915693
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The following critical phenomenon was recently discovered. When a memoryless source is compressed using a variable-length fixed-distortion code, the fastest convergence rate of the (pointwise) compression ratio to R(D) is either O(rootn) or O(log n), We show it is always O(rootn), except for discrete, uniformly distributed sources.
引用
收藏
页码:1230 / 1236
页数:7
相关论文
共 50 条
  • [31] A Lego-Brick Approach to Lossy Source Coding
    Ghaddar, Nadim
    Ganguly, Shouvik
    Wang, Lele
    Kim, Young-Han
    2022 17TH CANADIAN WORKSHOP ON INFORMATION THEORY (CWIT), 2022, : 45 - 50
  • [32] On the Separation of Lossy Source-Network Coding and Channel Coding in Wireline Networks
    Jalali, Shirin
    Effros, Michelle
    2010 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, 2010, : 500 - 504
  • [33] Channel Coding and Lossy Source Coding Using a Generator of Constrained Random Numbers
    Muramatsu, Jun
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (05) : 2667 - 2686
  • [34] Lossy Source Coding for Non-Uniform Binary Source with Trellis Codes
    Hiramatsu, Junya
    Isaka, Motohiko
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2018, E101A (02): : 531 - 534
  • [35] Federated Learning With Lossy Distributed Source Coding: Analysis and Optimization
    Yang, Huiyuan
    Ding, Tian
    Yuan, Xiaojun
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (08) : 4561 - 4576
  • [36] Lossy source coding via Markov chain Monte Carlo
    Jalali, Shirin
    Weissman, Tsachy
    2008 INTERNATIONAL ZURICH SEMINAR ON COMMUNICATIONS, 2008, : 80 - 83
  • [37] LDPC Codes for Information Embedding and Lossy Distributed Source Coding
    Sartipi, Mina
    2010 DATA COMPRESSION CONFERENCE (DCC 2010), 2010, : 551 - 551
  • [38] On the Three-Terminal Interactive Lossy Source Coding Problem
    Rey Vega, Leonardo
    Piantanida, Pablo
    Hero, Alfred O., III
    2014 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2014, : 771 - 775
  • [39] Output Constrained Lossy Source Coding With Limited Common Randomness
    Saldi, Naci
    Linder, Tamas
    Yueksel, Serdar
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2015, 61 (09) : 4984 - 4998
  • [40] Lossy Source Coding with Gaussian or Erased Side-Information
    Perron, Etienne
    Diggavi, Suhas
    Telatar, Emre
    2009 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, VOLS 1- 4, 2009, : 1035 - 1039