Edge-aware pre and post-processing for JPEG images using deep learning architectures

被引:0
|
作者
Mishra, Dipti [1 ]
Singh, Satish Kumar [2 ]
Singh, Rajat Kumar [2 ,3 ]
Sutaone, Mukul Sharad [2 ,4 ]
机构
[1] Mahindra Univ, Ecole Cent Sch Engn, Dept Comp Sci & Engn, Hyderabad, India
[2] Indian Inst Informat Technol Allahabad, Dept Informat Technol, Prayagraj, India
[3] Indian Inst Informat Technol Allahabad, Dept Elect & Commun Engn, Prayagraj, India
[4] Indian Inst Informat Technol Allahabad, Prayagraj, India
关键词
CNN; Codec compatible; Compression-decompression; Deep learning; Edge-aware loss; Canny edge detector; Holistically-nested edge detection (HED); Super-resolution network; COMPRESSION; CNN; NETWORK; DCT;
D O I
10.1016/j.dsp.2024.104953
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We introduce a learning-based CNN architecture for both pre- and post-processing in conjunction with the standard JPEG codec to enhance compression artifact removal. Our approach advances previous methods that use compression-decompression networks by incorporating: (a) an edge-aware loss function designed to reduce blurring, a common issue in earlier works, alongside a super-resolution CNN for post-processing, which improves rate-distortion performance at low bit rates; (b) distinct implementations for compact and full-resolution image representations, tailored for low and high bit rates, respectively. Compared to JPEG, JPEG2000, BPG, VVC-Intra, and recent CNN-based methods, our algorithm demonstrates significant improvements in PSNR, with gains of up to 21% and 25% at low (0.2-0.3 bpp) and high bit rates (0.5-0.7 bpp), respectively. Additionally, the MSSSIM gain reaches approximately 71% and 65% at low and high bit rates, respectively. This timely method has substantial potential to engage multimedia industries, researchers, and standard-setting agencies.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Conditional post-processing of JPEG compressed images
    Eschbach, R
    IS&T 50TH ANNUAL CONFERENCE, FINAL PROGRAM AND PROCEEDINGS, 1997, : 443 - 445
  • [2] Depth upsampling based on deep edge-aware learning
    Wang, Zhihui
    Ye, Xinchen
    Sun, Baoli
    Yang, Jingyu
    Xu, Rui
    Li, Haojie
    PATTERN RECOGNITION, 2020, 103
  • [3] Parsing very high resolution urban scene images by learning deep ConvNets with edge-aware loss
    Zheng, Xianwei
    Huan, Linxi
    Xia, Gui-Song
    Gong, Jianya
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 170 : 15 - 28
  • [4] Advanced pre/post-processing for DCT coded images
    Mancuso, M
    Borneo, A
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 1998, 44 (03) : 1039 - 1041
  • [5] Edge-aware and edge-enhancing single digital image super-resolution using deep learning
    Kolli, Abhiram
    De Silva, Perumadura
    Mohsenzadegan, Kabeh
    Tavakkoli, Vahid
    Al Sayed, Mohamad
    Kyamakya, Kyandoghere
    Pichler, Ralf
    Bouwmeester, Olaf
    Zupan, Robert
    DEVELOPMENTS OF ARTIFICIAL INTELLIGENCE TECHNOLOGIES IN COMPUTATION AND ROBOTICS, 2020, 12 : 1069 - 1077
  • [6] Research on pre-processing and post-processing algorithms in edge tracing
    Huang, CZ
    Yang, M
    ISTM/2003: 5TH INTERNATIONAL SYMPOSIUM ON TEST AND MEASUREMENT, VOLS 1-6, CONFERENCE PROCEEDINGS, 2003, : 1931 - 1935
  • [7] A new post-processing method for low bit rate JPEG coded images
    Sun, DQ
    Cham, WK
    Xie, JH
    Visual Communications and Image Processing 2005, Pts 1-4, 2005, 5960 : 1204 - 1214
  • [8] Extraction and Calculation of Roadway Area from Satellite Images Using Improved Deep Learning Model and Post-Processing
    Yerram, Varun
    Takeshita, Hiroyuki
    Iwahori, Yuji
    Hayashi, Yoshitsugu
    Bhuyan, M. K.
    Fukui, Shinji
    Kijsirikul, Boonserm
    Wang, Aili
    JOURNAL OF IMAGING, 2022, 8 (05)
  • [9] Multiple Facial Image Editing Using Edge-Aware PDE Learning
    Liang, Lingyu
    Jin, Lianwen
    Zhang, Xin
    Xu, Yong
    COMPUTER GRAPHICS FORUM, 2015, 34 (07) : 203 - 212
  • [10] Deep learning for post-processing ensemble weather forecasts
    Gronquist, Peter
    Yao, Chengyuan
    Ben-Nun, Tal
    Dryden, Nikoli
    Dueben, Peter
    Li, Shigang
    Hoefler, Torsten
    PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2021, 379 (2194):