Online Dictionary Learning Based Intra-frame Video Coding

被引:0
|
作者
Yipeng Sun
Mai Xu
Xiaoming Tao
Jianhua Lu
机构
[1] Tsinghua University,Tsinghua National Laboratory for Information Science and Technology (TNList), State Key Laboratory on Microwave and Digital Communications, Department of Electronic Engineering
[2] Beihang University,School of Electronic and Information Engineering
来源
关键词
Video coding; Intra-frame; Sparse representation ; Dictionary learning;
D O I
暂无
中图分类号
学科分类号
摘要
In this paper, we propose an online learning based intra-frame video coding approach, exploiting the texture sparsity of natural images. The proposed method is capable of learning the basic texture elements from previous frames with convergence guaranteed, leading to effective dictionaries for sparser representation of incoming frames. Benefiting from online learning, the proposed online dictionary learning based codec (ODL codec) is able to achieve a goal that the more video frames are being coded, the less non-zero coefficients are required to be transmitted. Then, these non-zero coefficients for image patches are further quantized and coded combined with dictionary synchronization. The experimental results demonstrate that the number of non-zero coefficients of each frame decreases rapidly while more frames are encoded. Compared to the off-line mode training, the proposed ODL codec, learning from video on the fly, is able to reduce the computational complexity with fast convergence. Finally, the rate distortion performance shows improvement in terms of PSNR compared with the K-SVD dictionary based compression and H.264/AVC for intra-frame video at low bit rates.
引用
收藏
页码:1281 / 1295
页数:14
相关论文
共 50 条
  • [41] Nonlinearly-adapted lapped transforms for intra-frame coding
    Lelescu, Dan
    2006 IEEE International Conference on Multimedia and Expo - ICME 2006, Vols 1-5, Proceedings, 2006, : 797 - 800
  • [42] Blind MV-based video steganalysis based on joint inter-frame and intra-frame statistics
    Ghamsarian, Negin
    Schoeffmann, Klaus
    Khademi, Morteza
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (06) : 9137 - 9159
  • [43] Blind MV-based video steganalysis based on joint inter-frame and intra-frame statistics
    Negin Ghamsarian
    Klaus Schoeffmann
    Morteza Khademi
    Multimedia Tools and Applications, 2021, 80 : 9137 - 9159
  • [44] An Intra-frame Classification Network for Video Anomaly Detection and Localization
    Xu, Ke
    Jiang, Xinghao
    Sun, Tanfeng
    2018 11TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2018), 2018,
  • [45] Recurrent Neural Networks with Intra-Frame Iterations for Video Deblurring
    Nah, Seungjun
    Son, Sanghyun
    Lee, Kyoung Mu
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 8094 - 8103
  • [46] INTRA-FRAME CONTEXT-BASED OCTREE CODING FOR POINT-CLOUD GEOMETRY
    Garcia, Diogo C.
    de Queiroz, Ricardo L.
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 1807 - 1811
  • [47] Hybrid Codec-Based Intra-Frame Joint Rate Control for Stereoscopic Video
    Chang, Yongjun
    Kim, Munchurl
    IEEE SIGNAL PROCESSING LETTERS, 2011, 18 (10) : 543 - 546
  • [48] Fast Mode and Partition Decision Using Machine Learning for Intra-Frame Coding in HEVC Screen Content Coding Extension
    Duanmu, Fanyi
    Ma, Zhan
    Wang, Yao
    IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2016, 6 (04) : 517 - 531
  • [49] Learning-Based Complexity Reduction Scheme for VVC Intra-Frame Prediction
    Saldanha, Mario
    Sanchez, Gustavo
    Marcon, Cesar
    Agostini, Luciano
    2021 INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2021,
  • [50] An Intra-Frame Rate Control Algorithm for Ultralow Delay H.264/Advanced Video Coding (AVC)
    Lee, Yun Gu
    Song, Byung Cheol
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2009, 19 (05) : 747 - 752