Learning-based lossless light field compression

被引:0
|
作者
Stepanov, Milan [1 ]
Mukati, M. Umair [2 ]
Valenzise, Giuseppe [1 ]
Forchhammer, Soren [2 ]
Dufaux, Frederic [1 ]
机构
[1] Univ Paris Saclay, Lab Signaux & Syst, Cent Supelec, CNRS, F-91190 Gif Sur Yvette, France
[2] Tech Univ Denmark, DTU Foton, DK-2800 Lyngby, Denmark
关键词
light field; lossless coding; deep learning;
D O I
10.1109/MMSP53017.2021.9733637
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We propose a learning-based method for lossless light field compression. The approach consists of two steps: first, the view to be compressed is synthesized based on previously decoded views; then, the synthesized view is used as a context to predict probabilities of the residual signal for adaptive arithmetic coding. We leverage recent advances in deep-learning-based view synthesis and generative modeling. Specifically, we evaluate two strategies for entropy modeling: a fully parallel probability estimation, where all pixel probabilities are estimated simultaneously; and a partially auto-regressive estimation, in which groups of pixels are predicted sequentially. Our results show that the latter approach provides the best coding gains compared to the state of the art, while keeping the computational complexity competitive.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] LEARNING-BASED LIGHT FIELD VIEW SYNTHESIS FOR EFFICIENT TRANSMISSION AND STORAGE
    Wafa, Abrar
    Pourazad, Mahsa T.
    Nasiopoulos, Panos
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 354 - 358
  • [22] Learning Better Lossless Compression Using Lossy Compression
    Mentzer, Fabian
    Van Gool, Luc
    Tschannen, Michael
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6637 - 6646
  • [23] An Image Compression Framework with Learning-based Filter
    Sun, Heming
    Liu, Chao
    Katto, Jiro
    Fan, Yibo
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 602 - 606
  • [24] A Learning-based Approach for Martian Image Compression
    Ding, Qing
    Xu, Mai
    Li, Shengxi
    Deng, Xin
    Shen, Qiu
    Zou, Xin
    2022 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2022,
  • [25] A learning-based method using Epipolar Geometry for light field depth estimation
    Wang, Xucheng
    Liu, Wan
    Sun, Yan
    Yang, Lin
    Qin, Zhentao
    Zheng, Zhenrong
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY VI, 2019, 11187
  • [26] A Unified Learning-Based Framework for Light Field Reconstruction From Coded Projections
    Vadathya, Anil Kumar
    Girish, Sharath
    Mitra, Kaushik
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 : 304 - 316
  • [27] Light Field Video Capture Using a Learning-Based Hybrid Imaging System
    Wang, Ting-Chun
    Zhu, Jun-Yan
    Kalantari, Nima Khademi
    Efros, Alexei A.
    Ramamoorthi, Ravi
    ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (04):
  • [28] Deep Learning-based Semantic Analysis of Sparse Light Field Ray Sets
    Chelli, Kelvin
    Tamboli, Roopak R.
    Herfet, Thorsten
    IEEE MMSP 2021: 2021 IEEE 23RD INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2021,
  • [29] Prediction and Sampling With Local Graph Transforms for Quasi-Lossless Light Field Compression
    Rizkallah, Mira
    Maugey, Thomas
    Guillemot, Christine
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 3282 - 3295
  • [30] AstroDLLC: Efficiently Reducing Storage and Transmission Costs for Massive Solar Observation Data via Deep Learning-based Lossless Compression
    Liu, Xiaoying
    Liu, Yingbo
    Yang, Lei
    Wu, Shichao
    Jiang, Rong
    Xiang, Yongyuan
    PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC, 2024, 136 (07)