Latitude-Redundancy-Aware All-Zero Block Detection for Fast 360-Degree Video Coding

被引:0
|
作者
Yu, Chang [1 ]
Fan, Xiaopeng [1 ]
Chen, Pengjin [1 ]
Ni, Yuxin [1 ]
Man, Hengyu [1 ]
Zhao, Debin [1 ]
机构
[1] Harbin Inst Technol, Dept Comp Sci & Technol, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Quantization (signal); Video coding; Transforms; Image coding; Redundancy; Encoding; Optimization; Three-dimensional displays; Rate-distortion; Prediction algorithms; 360 video coding; fast transform and quantization; latitude adaptive video coding; all-zero block; DCT COEFFICIENTS; ALGORITHM;
D O I
10.1109/TIP.2024.3482172
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The sphere-to-plane projection of 360-degree video introduces substantial stretched redundant data, which is discarded when reprojected to the 3D sphere for display. Consequently, encoding and transmitting such redundant data is unnecessary. Highly redundant blocks can be referred to as all-zero blocks (AZBs). Detecting these AZBs in advance can reduce computational and transmission resource consumption. However, this cannot be achieved by existing AZB detection techniques due to the unawareness of the stretching redundancy. In this paper, we first derive a latitude-adaptive redundancy detection (LARD) approach to adaptively detect coefficients carrying redundancy in transformed blocks by modeling the dependency between valid frequency range and the stretching degree based on spectrum analysis. Utilizing LARD, a latitude-redundancy-aware AZB detection scheme tailored for fast 360-degree video coding (LRAS) is proposed to accelerate the encoding process. LRAS consists of three sequential stages: latitude-adaptive AZB (L-AZB) detection, latitude-adaptive genuine-AZB (LG-AZB) detection and latitude-adaptive pseudo-AZB (LP-AZB) detection. Specifically, L-AZB refers to the AZB introduced by projection. LARD is used to detect L-AZB directly. LG-AZB refers to the AZB after hard-decision quantization and zeroing redundant coefficients. A novel latitude-adaptive sum of absolute difference estimation model is built to derive the threshold for LG-AZB detection. LP-AZB refers to the AZB in terms of rate-distortion optimization considering redundancy. A latitude-adaptive rate-distortion model is established for LP-AZB detection. Experimental results show that LRAS can achieve an average total encoding time reduction of 25.85% and 20.38% under low-delay and random access configurations compared to the original HEVC encoder, with only 0.16% and 0.13% BDBR increases and 0.01dB BDPSNR loss, respectively. The transform and quantization time savings are 60.13% and 59.94% on average.
引用
收藏
页码:6129 / 6142
页数:14
相关论文
共 23 条
  • [1] Revisiting All-Zero Block Detection for Versatile Video Coding
    Sun, Zhenhao
    Wang, Meng
    Chen, Peilin
    Wang, Xu
    Wang, Shiqi
    Kwong, Sam
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 6144 - 6155
  • [2] Fast Mode Decision Using All-Zero Block Detection for Fidelity and Spatial Scalable Video Coding
    Jung, Seung-Won
    Baek, Seung-Jin
    Park, Chun-Su
    Ko, Sung-Jea
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2010, 20 (02) : 201 - 206
  • [3] A New All-zero Block Detection Algorithm for High Efficiency Video Coding
    Yin, Haibing
    Cai, Hao
    Lu, Huijuan
    2017 DATA COMPRESSION CONFERENCE (DCC), 2017, : 470 - 470
  • [4] An efficient all-zero block detection algorithm for high efficiency video coding with RDOQ
    Yin, Haibing
    Cai, Hao
    Yang, Enhui
    Zhou, Yang
    Wu, Jiao
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2018, 60 : 79 - 90
  • [5] Latitude-Based Flexible Complexity Allocation for 360-Degree Video Coding
    Lin, Jielian
    Lin, Liqun
    Li, Weimeng
    Xu, Yiwen
    Zhao, Tiesong
    IEEE TRANSACTIONS ON BROADCASTING, 2022, 68 (03) : 572 - 581
  • [6] Fast sample adaptive offset algorithm for 360-degree video coding
    Zhou, Yan
    Chen, Zhenzhong
    Liu, Shan
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 80
  • [7] Fast all zero block detection algorithm for versatile video coding
    Weihong Niu
    Xiaofeng Huang
    Haibing Yin
    Yu Lu
    Yang Zhou
    Chenggang Yan
    Multimedia Tools and Applications, 2023, 82 : 33693 - 33718
  • [8] Fast all zero block detection algorithm for versatile video coding
    Niu, Weihong
    Huang, Xiaofeng
    Yin, Haibing
    Lu, Yu
    Zhou, Yang
    Yan, Chenggang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (22) : 33693 - 33718
  • [9] A fast intra CU partition algorithm in Versatile Video Coding for 360-degree video
    Chen, Yan
    Li, Tiansong
    Liu, Haokun
    Cui, Shaoguo
    Yu, Li
    Wu, Kejun
    Wang, Hongkui
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 104
  • [10] An All-zero Blocks Early Detection Method for High Efficiency Video Coding
    Lv, Zhengguang
    Dong, Shengfu
    Wang, Ronggang
    Xie, Xiaodong
    Jia, Huizhu
    Wang, Wenmin
    Gao, Wen
    VISUAL INFORMATION PROCESSING AND COMMUNICATION V, 2014, 9029