Critical behavior in lossy source coding

被引:7
|
作者
Dembo, A [1 ]
Kontoyiannis, I
机构
[1] Stanford Univ, Dept Math, Stanford, CA 94305 USA
[2] Stanford Univ, Dept Stat, Stanford, CA 94305 USA
[3] Brown Univ, Div Appl Math, Providence, RI 02912 USA
关键词
lossy data compression; rate-distortion theory; redundancy;
D O I
10.1109/18.915693
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The following critical phenomenon was recently discovered. When a memoryless source is compressed using a variable-length fixed-distortion code, the fastest convergence rate of the (pointwise) compression ratio to R(D) is either O(rootn) or O(log n), We show it is always O(rootn), except for discrete, uniformly distributed sources.
引用
收藏
页码:1230 / 1236
页数:7
相关论文
共 50 条
  • [41] A Lossy Source Coding Interpretation of Wyner's Common Information
    Xu, Ge
    Liu, Wei
    Chen, Biao
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2016, 62 (02) : 754 - 768
  • [42] A Symbolic Dynamical System Approach to Lossy Source Coding with Feedforward
    Shayevitz, Ofer
    2010 DATA COMPRESSION CONFERENCE (DCC 2010), 2010, : 317 - 326
  • [43] Lossy Source Coding via Spatially Coupled LDGM Ensembles
    Aref, Vahid
    Macris, Nicolas
    Urbanke, Ruediger
    Vuffray, Marc
    2012 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS (ISIT), 2012, : 373 - 377
  • [44] Finite Blocklength Lossy Source Coding for Discrete Memoryless Sources
    Zhou, Lin
    Motani, Mehul
    FOUNDATIONS AND TRENDS IN COMMUNICATIONS AND INFORMATION THEORY, 2023, 20 (03): : 157 - 389
  • [45] The Three-Terminal Interactive Lossy Source Coding Problem
    Rey Vega, Leonardo
    Piantanida, Pablo
    Hero, Alfred O., III
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2017, 63 (01) : 532 - 562
  • [46] RATES OF CONVERGENCE IN THE SOURCE-CODING THEOREM, IN EMPIRICAL QUANTIZER DESIGN, AND IN UNIVERSAL LOSSY SOURCE-CODING
    LINDER, T
    LUGOSI, G
    ZEGER, K
    IEEE TRANSACTIONS ON INFORMATION THEORY, 1994, 40 (06) : 1728 - 1740
  • [47] Lossy Source Coding Algorithm Using Lossless Multi-terminal Source Codes
    Muramatsu, Jun
    Miyake, Sigeki
    2008 INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY AND ITS APPLICATIONS, VOLS 1-3, 2008, : 606 - +
  • [48] Lossy joint source-channel coding in the finite blocklength regime
    Kostina, Victoria
    Verdu, Sergio
    2012 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS (ISIT), 2012,
  • [49] Distributed and Cascade Lossy Source Coding with a Side Information "Vending Machine"
    Ahmadi, Behzad
    Simeone, Osvaldo
    2012 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS (ISIT), 2012, : 184 - 188
  • [50] Distributed and Cascade Lossy Source Coding With a Side Information "Vending Machine"
    Ahmadi, Behzad
    Simeone, Osvaldo
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2013, 59 (10) : 6807 - 6819