WCDANN: A Lightweight CNN Post-Processing Filter for VVC-Based Video Compression

被引:2
|
作者
Zhang, Hao [1 ]
Jung, Cheolkon [1 ]
Zou, Dan [2 ]
Li, Ming [2 ]
机构
[1] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
[2] Guangdong OPPO Mobile Telecommun Corp, Dongguan 523860, Peoples R China
基金
中国国家自然科学基金;
关键词
Video compression; attention; convolutional neural network; depthwise separable convolution; in-loop filter; post-processing;
D O I
10.1109/ACCESS.2023.3301145
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose a weakly connected dense attention neural network for compression artifact removal, called WCDANN. WCDANN is a convolutional neural network (CNN)-based post-processing filter to enhance the quality of versatile video coding (VVC)-decoded videos without requiring any codec changes. WCDANN consists of several weakly connected dense attention blocks (WCDABs) based on residual learning, which takes the compressed video after codecs as the input. We use depthwise separable convolution for WCDANN as the basic convolution unit to generate a lightweight model. Moreover, we introduce attention mechanisms into the proposed filter to capture important features. Experimental results show that WCDANN achieves good performance in Bjontegaard Delta Bit Rate (BD-BR). Compared with VTM-11.0-NNVC anchor, WCDANN achieves average 2.81%, 4.12% and 3.81% BD-rate reductions for Y channel on A1, A2, B, C, D and E classes in RA, AI and LDP configurations, respectively.
引用
收藏
页码:83400 / 83413
页数:14
相关论文
共 50 条
  • [11] Entropy and Energy Bounds for Metastability Based TRNG with Lightweight Post-Processing
    Suresh, Vikram B.
    Burleson, Wayne P.
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2015, 62 (07) : 1785 - 1793
  • [12] CONFUSION NETWORK BASED VIDEO OCR POST-PROCESSING APPROACH
    Liu, Anan
    Fei, Jinghao
    Fan, Jianping
    Pang, Lin
    Zhang, Yongdong
    Li, Jintao
    ICME: 2009 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-3, 2009, : 137 - +
  • [13] Efficient post-processing for block-based compressed video
    Kim, Y
    Yi, T
    PROCEEDINGS EC-VIP-MC 2003, VOLS 1 AND 2, 2003, : 101 - 105
  • [14] A video pre/post-processing LSI for video capture
    Kinugasa, T
    Nishizawa, A
    Koshio, K
    Iguchi, T
    Kamimura, J
    Marumori, H
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 1996, 42 (03) : 776 - 780
  • [15] Video pre/post-processing LSI for video capture
    Hitachi Ltd, Yokohama, Japan
    IEEE Trans Consum Electron, 3 (776-780):
  • [16] Region-based Temporally Consistent Video Post-processing
    Dong, Xuan
    Bonev, Boyan
    Zhu, Yu
    Yuille, Alan L.
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 714 - 722
  • [17] A video pre/post-processing LSI for video capture
    Kinugasa, T
    Nishizawa, A
    Koshio, K
    Iguchi, T
    Kamimura, J
    Marumori, H
    ICCE - INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS, 1996 DIGEST OF TECHNICAL PAPERS, 1996, : 396 - 397
  • [18] Adaptive post-processing for fractal image compression
    Giang, NK
    Saupe, D
    2000 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL II, PROCEEDINGS, 2000, : 183 - 186
  • [19] CNN-Based Forensic Method on Contrast Enhancement with JPEG Post-Processing
    Yan, Ziqing
    Yang, Pengpeng
    Ni, Rongrong
    Zhao, Yao
    Qi, Hairong
    CMC-COMPUTERS MATERIALS & CONTINUA, 2021, 69 (03): : 3205 - 3216
  • [20] CNN-BASED DETECTION OF GENERIC CONTRAST ADJUSTMENT WITH JPEG POST-PROCESSING
    Barni, M.
    Costanzo, A.
    Nowroozi, E.
    Tondi, B.
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 3803 - 3807