Edge-aware pre and post-processing for JPEG images using deep learning architectures

被引:0
|
作者
Mishra, Dipti [1 ]
Singh, Satish Kumar [2 ]
Singh, Rajat Kumar [2 ,3 ]
Sutaone, Mukul Sharad [2 ,4 ]
机构
[1] Mahindra Univ, Ecole Cent Sch Engn, Dept Comp Sci & Engn, Hyderabad, India
[2] Indian Inst Informat Technol Allahabad, Dept Informat Technol, Prayagraj, India
[3] Indian Inst Informat Technol Allahabad, Dept Elect & Commun Engn, Prayagraj, India
[4] Indian Inst Informat Technol Allahabad, Prayagraj, India
关键词
CNN; Codec compatible; Compression-decompression; Deep learning; Edge-aware loss; Canny edge detector; Holistically-nested edge detection (HED); Super-resolution network; COMPRESSION; CNN; NETWORK; DCT;
D O I
10.1016/j.dsp.2024.104953
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We introduce a learning-based CNN architecture for both pre- and post-processing in conjunction with the standard JPEG codec to enhance compression artifact removal. Our approach advances previous methods that use compression-decompression networks by incorporating: (a) an edge-aware loss function designed to reduce blurring, a common issue in earlier works, alongside a super-resolution CNN for post-processing, which improves rate-distortion performance at low bit rates; (b) distinct implementations for compact and full-resolution image representations, tailored for low and high bit rates, respectively. Compared to JPEG, JPEG2000, BPG, VVC-Intra, and recent CNN-based methods, our algorithm demonstrates significant improvements in PSNR, with gains of up to 21% and 25% at low (0.2-0.3 bpp) and high bit rates (0.5-0.7 bpp), respectively. Additionally, the MSSSIM gain reaches approximately 71% and 65% at low and high bit rates, respectively. This timely method has substantial potential to engage multimedia industries, researchers, and standard-setting agencies.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Improving physical activity recognition using a new deep learning architecture and post-processing techniques
    Gil-Martin, Manuel
    San-Segundo, Ruben
    Fernandez-Martinez, Fernando
    Ferreiros-Lopez, Javier
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2020, 92 (92)
  • [22] "More Than Deep Learning": post-processing for API sequence recommendation
    Chen, Chi
    Peng, Xin
    Chen, Bihuan
    Sun, Jun
    Xing, Zhenchang
    Wang, Xin
    Zhao, Wenyun
    EMPIRICAL SOFTWARE ENGINEERING, 2022, 27 (01)
  • [23] “More Than Deep Learning”: post-processing for API sequence recommendation
    Chi Chen
    Xin Peng
    Bihuan Chen
    Jun Sun
    Zhenchang Xing
    Xin Wang
    Wenyun Zhao
    Empirical Software Engineering, 2022, 27
  • [24] Automatic crack detection for tunnel inspection using deep learning and heuristic image post-processing
    Eftychios Protopapadakis
    Athanasios Voulodimos
    Anastasios Doulamis
    Nikolaos Doulamis
    Tania Stathaki
    Applied Intelligence, 2019, 49 : 2793 - 2806
  • [25] An edge-based adaptive post-processing technique for cosine transform coded images
    Wen, W
    Xiao, ZY
    Han, H
    Peng, SL
    International Conference on Computing, Communications and Control Technologies, Vol 2, Proceedings, 2004, : 153 - 158
  • [26] Automatic crack detection for tunnel inspection using deep learning and heuristic image post-processing
    Protopapadakis, Eftychios
    Voulodimos, Athanasios
    Doulamis, Anastasios
    Doulamis, Nikolaos
    Stathaki, Tania
    APPLIED INTELLIGENCE, 2019, 49 (07) : 2793 - 2806
  • [27] An Intelligent Pre-Processing Framework for Standardizing Medical Images for CAD and Other Post-Processing Applications
    Raghupathi, Lakshminarasimhan
    Devarakota, Pandu R.
    Wolf, Matthias
    MEDICAL IMAGING 2012: COMPUTER-AIDED DIAGNOSIS, 2012, 8315
  • [28] Nutil: A Pre- and Post-processing Toolbox for Histological Rodent Brain Section Images
    Groeneboom, Nicolaas E.
    Yates, Sharon C.
    Puchades, Maja A.
    Bjaalie, Jan G.
    FRONTIERS IN NEUROINFORMATICS, 2020, 14
  • [29] Simulation, reconstruction and post-processing of SPECT images using PSF measures
    Schenone, A
    Boccacci, P
    Busallino, F
    Calvini, P
    Gambaro, M
    CAR '97 - COMPUTER ASSISTED RADIOLOGY AND SURGERY, 1997, 1134 : 87 - 90
  • [30] Using pre & post-processing methods to improve binding site predictions
    Sun, Yi
    Gonzalez Castellano, Cristina
    Robinson, Mark
    Adams, Rod
    Rust, Alistair G.
    Davey, Neil
    PATTERN RECOGNITION, 2009, 42 (09) : 1949 - 1958