Mode Skipping for HEVC Screen Content Coding via Random Forest

被引:24
|
作者
Tsang, Sik-Ho [1 ]
Chan, Yui-Lam [1 ]
Kuang, Wei [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Elect & Informat Engn, Hung Hom, Hong Kong, Peoples R China
关键词
HEVC; machine learning; random forest; screen content coding; video coding; INTRA BLOCK COPY;
D O I
10.1109/TMM.2019.2907472
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Screen content coding (SCC) is the extension to high-efficiency video coding (HEVC) for compressing screen content videos. New coding tools, intrablock copy (IBC), and palette (PLT) modes, are introduced to encode screen content (SC) such as texts and graphics. The IBC mode is used for encoding repeating patterns by performing block matching within the same frame, while the PLT mode is designed for SC with few distinct colors by coding the major colors and their corresponding locations using an index map. However, the use of IBC and PLT modes increases the encoder complexity remarkably though coding efficiency can be improved. Therefore, we propose to have a mode skipping approach to reduce the encoder complexity of SCC by making use of SC characteristics, neighbor coding unit (CU) correlations, and intermediate cost information via random forest (RF). Detailed feature analyses and sample preparation are also described. A novel hyperparameter tuning approach with the consideration of coding bitrate and encoding time is proposed for RFs at each CU size to further boost the encoding process. Experimental results show that our proposed approach can obtain 45.06% average encoding time reduction with only a 1.08% increase in Bjontegaard delta bitrate. Average encoding time can even be reduced to 58.57% by regulating the hyperparameters.
引用
收藏
页码:2433 / 2446
页数:14
相关论文
共 50 条
  • [1] IMPROVING SCREEN CONTENT CODING IN HEVC BY TRANSFORM SKIPPING
    Mrak, Marta
    Xu, Ji-Zheng
    2012 PROCEEDINGS OF THE 20TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2012, : 1209 - 1213
  • [2] Fast Algorithm with Palette Mode Skipping and Splitting Early Termination for HEVC Screen Content Coding
    Badry, Emad
    Shalaby, Ahmed
    Sayed, Mohammed S.
    2019 IEEE 62ND INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS), 2019, : 606 - 609
  • [3] Palette Mode Coding in HEVC Screen Content Coding Extension
    Pu, Wei
    Karczewicz, Marta
    Joshi, Rajan
    Seregin, Vadim
    Zou, Feng
    Sole, Joel
    Sun, Yu-Chen
    Chuang, Tzu-Der
    Lai, Polin
    Liu, Shan
    Hsiang, Shih-Ta
    Ye, Jing
    Huang, Yu-Wen
    IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2016, 6 (04) : 420 - 432
  • [4] Ultra Fast Screen Content Coding via Random Forest
    Tsang, Sik-Ho
    Kwong, Ngai-Wing
    Chan, Yui-Lam
    2020 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2020, : 1112 - 1117
  • [5] COPY MODE FOR STATIC SCREEN CONTENT CODING WITH HEVC
    Laude, Thorsten
    Ostermann, Joern
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 1930 - 1934
  • [6] Efficient Mode Decision for HEVC Screen Content Coding by Content Analysis
    Kuang, Wei
    Chan, Yui-Lam
    Tsang, Sik-Ho
    2019 13TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATION SYSTEMS (ICSPCS), 2019,
  • [7] Improved Transform Skip Mode for HEVC Screen Content Coding
    Kao, Jiun-Yu
    Hashemi, Maryam Azimi
    Xiu, Xiaoyu
    Ye, Yan
    He, Yuwen
    Dong, Jie
    5TH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, THEORY, TOOLS AND APPLICATIONS 2015, 2015, : 504 - 509
  • [8] Fast transform mode decision for HEVC screen content coding
    Lee, Dokyung
    Jeong, Jecheng
    PROCEEDINGS OF 2017 INTERNATIONAL CONFERENCE ON VIDEO AND IMAGE PROCESSING (ICVIP 2017), 2017, : 172 - 175
  • [9] PALETTE MODE - A NEW CODING TOOL IN SCREEN CONTENT CODING EXTENSIONS OF HEVC
    Sun, Yu-Chen
    Chuang, Tzu-Der
    Lai, PoLin
    Chen, Yi-Wen
    Liu, Shan
    Huang, Yu-Wen
    Lei, Shawmin
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 2409 - 2413
  • [10] Mode skipping for screen content coding based on Neural Network Classifier
    Nabila Elsawy
    Mohammed S. Sayed
    Fathi Farag
    Journal of Real-Time Image Processing, 2021, 18 : 2453 - 2468