Edge-aware pre and post-processing for JPEG images using deep learning architectures

被引:0
|
作者
Mishra, Dipti [1 ]
Singh, Satish Kumar [2 ]
Singh, Rajat Kumar [2 ,3 ]
Sutaone, Mukul Sharad [2 ,4 ]
机构
[1] Mahindra Univ, Ecole Cent Sch Engn, Dept Comp Sci & Engn, Hyderabad, India
[2] Indian Inst Informat Technol Allahabad, Dept Informat Technol, Prayagraj, India
[3] Indian Inst Informat Technol Allahabad, Dept Elect & Commun Engn, Prayagraj, India
[4] Indian Inst Informat Technol Allahabad, Prayagraj, India
关键词
CNN; Codec compatible; Compression-decompression; Deep learning; Edge-aware loss; Canny edge detector; Holistically-nested edge detection (HED); Super-resolution network; COMPRESSION; CNN; NETWORK; DCT;
D O I
10.1016/j.dsp.2024.104953
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We introduce a learning-based CNN architecture for both pre- and post-processing in conjunction with the standard JPEG codec to enhance compression artifact removal. Our approach advances previous methods that use compression-decompression networks by incorporating: (a) an edge-aware loss function designed to reduce blurring, a common issue in earlier works, alongside a super-resolution CNN for post-processing, which improves rate-distortion performance at low bit rates; (b) distinct implementations for compact and full-resolution image representations, tailored for low and high bit rates, respectively. Compared to JPEG, JPEG2000, BPG, VVC-Intra, and recent CNN-based methods, our algorithm demonstrates significant improvements in PSNR, with gains of up to 21% and 25% at low (0.2-0.3 bpp) and high bit rates (0.5-0.7 bpp), respectively. Additionally, the MSSSIM gain reaches approximately 71% and 65% at low and high bit rates, respectively. This timely method has substantial potential to engage multimedia industries, researchers, and standard-setting agencies.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Consultant-2: Pre- and post-processing of Machine Learning applications
    Univ of Aberdeen, Aberdeen, United Kingdom
    Int J Hum Comput Stud, 1 (43-63):
  • [32] Multiple description image coding using pre- and post-processing
    Shirani, S
    Gallant, M
    Kossentini, F
    INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY: CODING AND COMPUTING, PROCEEDINGS, 2001, : 35 - 39
  • [33] Post-Processing Association Rules using Networks and Transductive Learning
    de Padua, Renan
    Rezende, Solange Oliveira
    de Carvalho, Veronica Oliveira
    2014 13TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2014, : 318 - 323
  • [34] Challenges in Reducing Bias Using Post-Processing Fairness for Breast Cancer Stage Classification with Deep Learning
    Soltan, Armin
    Washington, Peter
    ALGORITHMS, 2024, 17 (04)
  • [35] DeepEMhancer: a deep learning solution for cryo-EM volume post-processing
    Sanchez-Garcia, Ruben
    Gomez-Blanco, Josue
    Cuervo, Ana
    Maria Carazo, Jose
    Sorzano, Carlos Oscar S.
    Vargas, Javier
    COMMUNICATIONS BIOLOGY, 2021, 4 (01)
  • [36] Segmentation of Nucleus in Histopathological Images Using Deep Learning Architectures
    Ayaz, Ogun
    Usta, Hamdullah
    Bilgin, Gokhan
    TIP TEKNOLOJILERI KONGRESI (TIPTEKNO'21), 2021,
  • [37] DeepEMhancer: a deep learning solution for cryo-EM volume post-processing
    Ruben Sanchez-Garcia
    Josue Gomez-Blanco
    Ana Cuervo
    Jose Maria Carazo
    Carlos Oscar S. Sorzano
    Javier Vargas
    Communications Biology, 4
  • [38] Classifying Breast Cytological Images using Deep Learning Architectures
    Zerouaoui, Hasnae
    Idri, Ali
    HEALTHINF: PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON BIOMEDICAL ENGINEERING SYSTEMS AND TECHNOLOGIES - VOL 5: HEALTHINF, 2021, : 557 - 564
  • [39] Post-processing for removing coding artifacts using edge-preserving regularization
    Yao, S
    Lin, X
    PROCEEDINGS OF 2001 INTERNATIONAL SYMPOSIUM ON INTELLIGENT MULTIMEDIA, VIDEO AND SPEECH PROCESSING, 2001, : 121 - 124
  • [40] Evaluation of Pre-Processing, Thresholding and Post-Processing Steps for Very Small Target Detection in Infrared Images
    Yardimci, Ozan
    Ulusoy, Ilkay
    AUTOMATIC TARGET RECOGNITION XXVI, 2016, 9844