Edge-aware pre and post-processing for JPEG images using deep learning architectures

被引:0
|
作者
Mishra, Dipti [1 ]
Singh, Satish Kumar [2 ]
Singh, Rajat Kumar [2 ,3 ]
Sutaone, Mukul Sharad [2 ,4 ]
机构
[1] Mahindra Univ, Ecole Cent Sch Engn, Dept Comp Sci & Engn, Hyderabad, India
[2] Indian Inst Informat Technol Allahabad, Dept Informat Technol, Prayagraj, India
[3] Indian Inst Informat Technol Allahabad, Dept Elect & Commun Engn, Prayagraj, India
[4] Indian Inst Informat Technol Allahabad, Prayagraj, India
关键词
CNN; Codec compatible; Compression-decompression; Deep learning; Edge-aware loss; Canny edge detector; Holistically-nested edge detection (HED); Super-resolution network; COMPRESSION; CNN; NETWORK; DCT;
D O I
10.1016/j.dsp.2024.104953
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We introduce a learning-based CNN architecture for both pre- and post-processing in conjunction with the standard JPEG codec to enhance compression artifact removal. Our approach advances previous methods that use compression-decompression networks by incorporating: (a) an edge-aware loss function designed to reduce blurring, a common issue in earlier works, alongside a super-resolution CNN for post-processing, which improves rate-distortion performance at low bit rates; (b) distinct implementations for compact and full-resolution image representations, tailored for low and high bit rates, respectively. Compared to JPEG, JPEG2000, BPG, VVC-Intra, and recent CNN-based methods, our algorithm demonstrates significant improvements in PSNR, with gains of up to 21% and 25% at low (0.2-0.3 bpp) and high bit rates (0.5-0.7 bpp), respectively. Additionally, the MSSSIM gain reaches approximately 71% and 65% at low and high bit rates, respectively. This timely method has substantial potential to engage multimedia industries, researchers, and standard-setting agencies.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Extended depth of field in images through complex amplitude pre-processing and optimized digital post-processing
    Ledesma-Carrillo, L. M.
    Lopez-Ramirez, M.
    Rivera-Romero, C. A.
    Garcia-Perez, A.
    Botella, G.
    Cabal-Yepez, E.
    COMPUTERS & ELECTRICAL ENGINEERING, 2014, 40 (01) : 29 - 40
  • [42] Developing image analysis pipelines of whole-slide images: Pre- and post-processing
    Smith, Byron
    Hermsen, Meyke
    Lesser, Elizabeth
    Ravichandar, Deepak
    Kremers, Walter
    JOURNAL OF CLINICAL AND TRANSLATIONAL SCIENCE, 2021, 5 (01)
  • [43] Soil erosion state interpretation with use of multichannel radar images pre- and post-processing
    Kulemin, GP
    Lukin, VV
    Zelensky, AA
    Kurekin, AA
    Engman, ET
    REMOTE SENSING FOR AGRICULTURE, ECOSYSTEMS, AND HYDROLOGY, 1998, 3499 : 134 - 144
  • [44] Impact of Pre- and Post-Processing Steps for Supervised Classification of Colorectal Cancer in Hyperspectral Images
    Tkachenko, Mariia
    Chalopin, Claire
    Jansen-Winkeln, Boris
    Neumuth, Thomas
    Gockel, Ines
    Maktabi, Marianne
    CANCERS, 2023, 15 (07)
  • [45] A deep learning-based post-processing method for automated pulmonary lobe and airway trees segmentation using chest CT images in PET/CT
    Xing, Haiqun
    Zhang, Xin
    Nie, Yingbin
    Wang, Sicong
    Wang, Tong
    Jing, Hongli
    Li, Fang
    QUANTITATIVE IMAGING IN MEDICINE AND SURGERY, 2022, 12 (10) : 4747 - 4757
  • [46] Post-Processing Deflectometry Grid Images Using Particle Image Velocimetry Analysis
    O'Donoughue, Patrick
    Robin, Olivier
    Rouard, Kevin
    Le Bot, Alain
    Berry, Alain
    JOURNAL OF VIBRATION AND ACOUSTICS-TRANSACTIONS OF THE ASME, 2022, 144 (03):
  • [47] Improving Post-Processing of Audio Event Detectors Using Reinforcement Learning
    Giannakopoulos, Petros
    Pikrakis, Aggelos
    Cotronis, Yannis
    IEEE ACCESS, 2022, 10 : 84398 - 84404
  • [48] Post-processing of global horizontal irradiance forecasts using machine learning
    Soos, Viktoria
    Mayer, Martin Janos
    9TH INTERNATIONAL YOUTH CONFERENCE ON ENERGY, IYCE 2024, 2024,
  • [49] Pre-processing and post-processing method for geostress simulation using seismic interpretation results
    ZHANG, Li-hong
    Mining Science and Technology, 2009, 19 (03): : 369 - 372
  • [50] PRE- AND POST-PROCESSING IN A VIDEO TERMINAL USING MOTION VECTORS.
    Chiariglione, L.
    Corgnier, L.
    Guglielmo, M.
    CSELT Technical Reports, 1987, 15 (03): : 195 - 198