A rate-distortion optimization algorithm based on visual perception

被引：0
|
作者：
Wei H. [1 ,2 ]
Liu J. [1 ,2 ]
Lin L. [1 ,2 ]
Yang J. [1 ,2 ]
Chen W. [1 ,2 ]
机构：
[1] College of Physics and Information Engineering, Fuzhou University, Fuzhou
[2] Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, Fuzhou
来源：
Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument | 2022年 / 43卷 / 05期
关键词：
Just noticeable distortion; Rate distortion optimization; Saliency model; The third generation audio and video coding standard;
D O I：
10.19650/j.cnki.cjsi.J2108588
中图分类号：
学科分类号：
摘要：
The rate-distortion optimization plays a key role in video coding, which aims to achieve a tradeoff between compression efficiency and video quality distortion. The existing rate-distortion optimization algorithms mainly aim to eliminate time and space redundancy, which ignore subjective perception of video content and result in a large amount of perceptual redundancy in video. To address these issues, a rate distortion algorithm based on visual perception is proposed in this article. Firstly, the Lagrangian multiplier factor is obtained based on the data-driven just noticeable distortion prediction mode, which is more in line with the perception of the human eye. Secondly, the Lagrangian multiplier weight coefficient is based on salient model. Finally, the fusion of two models is applied to rate-distortion optimization, and SW-SSIM is used to evaluate video quality and achieve perceptual video coding optimization. Compared with the third generation audio and video coding standard algorithm, experimental results show that the proposed algorithm reduces bitrate by 12.15% averagely, and the salience weighted-structural similarity index metric increases by 0.004 3. Furthermore, the proposed algorithm reduces the perceptual redundancy in video content, and improves the video perceptual quality and coding performance. © 2022, Science Press. All right reserved.
引用
收藏
页码：175 / 182
页数：7
相关论文
共 18 条
  • [1] LI X H, WU X P., Video coding rate control method based on rate distortion, Chinese Journal of Scientific Instrument, 27, 3, pp. 327-330, (2006)
  • [2] YUAN D, ZHAO T, XU Y, Et al., Visual JND: A perceptual measurement in video coding, IEEE Access, 7, 99, pp. 29014-29022, (2019)
  • [3] NACCAR M, PEREIRA F., Decoder side just noticeable distortion model estimation for efficient H.264/AVC based perceptual video coding, Proceedings of the International Conference on Image Processing (ICIP), pp. 2573-2576, (2010)
  • [4] KI S, KIM M, KO H., Just noticeable quantization distortion based preprocessing for perceptual video coding, Proceedings of the Visual Communications and Image Processing (VCIP), (2017)
  • [5] NAMI S, PAKDAMAN F, HASHEMI M., Juniper: A JND-based perceptual video coding framework to jointly utilize saliency and JND, Proceedings of the IEEE International Conference on Multimedia and Expo Workshops (ICMEW), (2020)
  • [6] LU X, CAO Y H, ZHOU X Y, Et al., Two-stage saliency object detection based on deep reinforcement learning, Journal of Electronic Measurement and Instrumentation, 35, 6, pp. 34-42, (2021)
  • [7] ZHU P, XU Z., Spatiotemporal visual saliency guided perceptual high efficiency video coding with neural network, Neurocomputing, 275, pp. 511-522, (2018)
  • [8] ROUIS K, LARAB MI, TAHAR J., Perceptually adaptive lagrangian multiplier for HEVC guided rate-distortion optimization, IEEE Access, 6, pp. 33589-33603, (2018)
  • [9] SONG R, ZHANG Y., High efficiency video coding intra prediction optimization algorithm based on region of interest, Journal of Electronics and Information Technology, 42, 11, pp. 2781-2787, (2020)
  • [10] ZHOU M, WEI K, WANG S., SSIM-Based global optimization for CTU-Level rate control in HEVC, Transactions on Multimedia, 21, 8, pp. 1921-1933, (2019)
12