RATE-DISTORTION-OPTIMIZATION FOR DEEP IMAGE COMPRESSION

被引:3
|
作者
Schaefer, Michael [1 ]
Pientka, Sophie [1 ]
Pfaff, Jonathan [1 ]
Schwarz, Heiko [1 ]
Marpe, Detlev [1 ]
Wiegand, Thomas [1 ]
机构
[1] Fraunhofer Inst Telecommun, Video Commun & Applicat Dept, Heinrich Hertz Inst, Einsteinufer 37, D-10587 Berlin, Germany
关键词
High Efficiency Video Coding (HEVC); Versatile Video Coding (VVC); Deep Learning; Auto-Encoder; Rate-Distortion-Optimization;
D O I
10.1109/ICIP42928.2021.9506513
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Given the capabilities of massive GPU hardware, there has been a surge of using artificial neural networks (ANN) for still image compression. These compression systems usually consist of convolutional layers and can be considered as non-linear transform coding. Notably, these ANNs are based on an end-to-end approach where the encoder determines a compressed version of the image as features. In contrast to this, existing image and video codecs employ a block-based architecture with signal-dependent encoder optimizations. A basic requirement for designing such optimizations is estimating the impact of the quantization error on the resulting bitrate and distortion. As for non-linear, multi-layered neural networks, this is a difficult problem. This paper presents a performant auto-encoder architecture for still image compression, which represents the compressed features at multiple scales. Then, we demonstrate how an algorithm, which tests multiple feature candidates, can reduce the Lagrangian cost and optimize compression efficiency. The algorithm avoids multiple network executions by pre-estimating the impact of the quantization on the distortion by a higher-order polynomial.
引用
收藏
页码:3737 / 3741
页数:5
相关论文
共 50 条
  • [1] Learning True Rate-Distortion-Optimization for End-To-End Image Compression
    Brand, Fabian
    Fischer, Kristian
    Kopte, Alexander
    Kaup, Andre
    DCC 2022: 2022 DATA COMPRESSION CONFERENCE (DCC), 2022, : 443 - 443
  • [2] Rate-Distortion Optimized Encoding for Deep Image Compression
    Schafer, Michael
    Pientka, Sophie
    Pfaff, Jonathan
    Schwarz, Heiko
    Marpe, Detlev
    Wiegand, Thomas
    IEEE OPEN JOURNAL OF CIRCUITS AND SYSTEMS, 2021, 2 : 633 - 647
  • [3] Exploring the rate-distortion-complexity optimization in neural image compression
    Gao, Yixin
    Feng, Runsen
    Guo, Zongyu
    Chen, Zhibo
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 105
  • [4] DEEP FEATURE COMPRESSION USING RATE-DISTORTION OPTIMIZATION GUIDED AUTOENCODER
    Yamazaki, Meguru
    Kora, Yuichiro
    Nakao, Takanori
    Lei, Xuying
    Yokoo, Kaoru
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1216 - 1220
  • [5] Deep Feature Compression with Rate-Distortion Optimization for Networked Camera Systems
    Ikusan, Ademola
    Dai, Rui
    PROCEEDINGS OF THE 2023 PROCEEDINGS OF THE 14TH ACM MULTIMEDIA SYSTEMS CONFERENCE, MMSYS 2023, 2023, : 86 - 96
  • [6] Rate-distortion optimization for: Video compression
    Communication Core Research, PictureTel Corporation, Andover, MA, United States
    不详
    IEEE Signal Process Mag, 6 (74-90):
  • [7] Rate-distortion optimization for video compression
    Sullivan, GJ
    Wiegand, T
    IEEE SIGNAL PROCESSING MAGAZINE, 1998, 15 (06) : 74 - 90
  • [8] An optimization based approach to color image compression using a Rate-Distortion model
    Gershikov, Evgeny
    Porat, Moshe
    PROCEEDINGS OF THE SIXTH IASTED INTERNATIONAL CONFERENCE ON MODELLING, SIMULATION, AND OPTIMIZATION: SCIENCE AND TECHNOLOGY FOR DEVELOPMENT IN THE 21ST CENTURY, 2006, : 13 - +
  • [9] Lossy Depth Image Compression using Greedy Rate-Distortion Slope Optimization
    Schiopu, Ionut
    Tabus, Ioan
    IEEE SIGNAL PROCESSING LETTERS, 2013, 20 (11) : 1066 - 1069
  • [10] Compression of interference spectral image based on weighted rate-distortion optimization for SPIHT
    Ma, Jing
    Wu, Chengke
    Chen, Dong
    Zhou, Youxi
    Wang, Keyan
    Guangxue Xuebao/Acta Optica Sinica, 2007, 27 (03): : 430 - 436