Cross-Component Prediction Boosted With Local and Non-Local Information in Video Coding

被引:1
|
作者
Zhang, Kai [1 ]
Deng, Zhipin [2 ]
Zhang, Li [1 ]
机构
[1] Bytedance Inc, San Diego, CA 92122 USA
[2] Bytedance Inc, Beijing 100098, Peoples R China
关键词
VVC; ECM; cross-component prediction; local-boosting cross-component prediction; history-based cross-component prediction; non-local cross-component prediction; CHROMA INTRA-PREDICTION; LINEAR-MODEL;
D O I
10.1109/TIP.2024.3353672
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the versatile video coding (VVC) standard, cross-component prediction (CCP) is introduced to utilize the correlation between luma and chroma components. To further exploit the cross-component redundancy, a bundle of novel CCP methods with more sophisticated models are studied in enhanced compression model (ECM), which is a platform targeting at the next generation video coding standard, developed by JVET. This paper presents two methods, known as local-boosting CCP (LB-CCP) and non-local CCP (NL-CCP) to improve CCP with local and non-local information. With LB-CCP, prediction samples of CCP can be filtered with neighbouring samples. Besides, neighbouring template costs are calculated to determine the range of training samples, as well as the cross-component prediction method used in the chroma fusion mode. With NL-CCP, a CCP model can be derived with samples non-adjacent to the current block. As an equivalent but simpler implementation, the CCP model can be inherited from a CCP-coded neighbouring block as a spatial CCP candidate. Moreover, the CCP model of a previous CCP-coded block can be stored in a history-based table, which can be fetched and used by the current block as a history-based CCP candidate. A NL-CCP candidate list is built with the two kinds of candidates. The encoder can select the optimal candidate and send an index to the decoder. Experimental results show that LB-CCP together with NL-CCP can provide an average Bjontegaard delta rate (BD-rate) reduction of 0.27%, 2.31%, 2.44% on Y, Cb, Cr components, respectively, with a negligible change in the running time, compared with ECM-8.0 in all intra configurations. Both LB-CCP and NL-CCP have been adopted into ECM.
引用
收藏
页码:942 / 956
页数:15
相关论文
共 50 条
  • [21] Utilising Low Complexity CNNs to Lift Non-Local Redundancies in Video Coding
    Klopp, Jan P.
    Chen, Liang-Gee
    Chien, Shao-Yi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 6372 - 6385
  • [22] Extended cross-component prediction in HEVC
    Siekmann M.
    Khairat A.
    Nguyen T.
    Marpe D.
    Wiegand T.
    2017, Cambridge University Press (06):
  • [23] Extended Cross-Component Prediction in HEVC
    Tung Nguyen
    Khairat, Ali
    Marpe, Detlev
    Siekmann, Mischa
    Wiegand, Thomas
    2015 Picture Coding Symposium (PCS) with 2015 Packet Video Workshop (PV), 2015, : 164 - 168
  • [24] CONVOLUTIONAL NEURAL NETWORKS FOR VIDEO INTRA PREDICTION USING CROSS-COMPONENT ADAPTATION
    Meyer, Maria
    Wiesner, Jonathan
    Schneider, Jens
    Rohlfing, Christian
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 1607 - 1611
  • [25] NON-LOCAL STORAGE OF TEMPORAL INFORMATION
    LONGUETHIGGINS, HC
    PROCEEDINGS OF THE ROYAL SOCIETY SERIES B-BIOLOGICAL SCIENCES, 1968, 171 (1024): : 327 - +
  • [26] Neural Coding: Non-Local but Explicit and Conceptual
    Foeldiak, Peter
    CURRENT BIOLOGY, 2009, 19 (19) : R904 - R906
  • [27] NON-LOCAL FIELD AND NON-LOCAL INTERACTION
    KATAYAMA, Y
    PROGRESS OF THEORETICAL PHYSICS, 1952, 8 (03): : 381 - 382
  • [28] Non-local NetVLAD Encoding for Video Classification
    Tang, Yongyi
    Zhang, Xing
    Wang, Jingwen
    Chen, Shaoxiang
    Ma, Lin
    Jiang, Yu-Gang
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT IV, 2019, 11132 : 219 - 228
  • [29] EFFICIENT CODING OF VIDEO SEQUENCES BY NON-LOCAL IN-LOOP DENOISING OF REFERENCE FRAMES
    Wige, Eugen
    Yammine, Gilbert
    Amon, Peter
    Hutter, Andreas
    Kaup, Andre
    2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2011, : 1209 - 1212
  • [30] Progressive Side Information Refinement with Non-Local Means Based Denoising Process for Wyner-Ziv Video Coding
    Shen, Yun-Chung
    Wang, Pin-Shiang
    Wu, Ja-Ling
    2012 DATA COMPRESSION CONFERENCE (DCC), 2012, : 219 - 226