Spherical Coordinates Transform-Based Motion Model for Panoramic Video Coding

被引:15
|
作者
Wang, Yefei [1 ]
Liu, Dong [1 ]
Ma, Siwei [2 ]
Wu, Feng [1 ]
Gao, Wen [2 ]
机构
[1] Univ Sci & Technol China, CAS Key Lab Technol Geospatial Informat Proc & Ap, Hefei 230027, Anhui, Peoples R China
[2] Peking Univ, Natl Engn Lab Video Technol, Beijing 100871, Peoples R China
关键词
Motion model; panoramic video coding; spherical coordinates transform;
D O I
10.1109/JETCAS.2019.2896265
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Panoramic video is produced and displayed as if it is supported on sphere, but it is usually mapped to two-dimensional (2D) plane for compression purpose. The mapping from sphere to 2D plane inevitably causes deformation of video content, which shall be taken into account in panoramic video coding. In this paper, we propose a new motion model based on spherical coordinates transform to explicitly address the deformation problem. Different from the traditional 2D translational motion model, our model assumes a 3D translational motion, which is characterized by a 2D motion vector and a relative depth parameter. Based on spherical coordinates transform, we can deduce the motion compensation and motion estimation algorithms for our proposed motion model. We then integrate the algorithms into the joint exploration model (JEM) scheme for panoramic video coding, and perform experiments on some typical equirectangular projection format video sequences. Experimental results show that our proposed method leads to up to 10.7% and on average 2.6% BD-rate reduction compared to the JEM anchor on our test sequences, with no increase of decoding time.
引用
收藏
页码:98 / 109
页数:12
相关论文
共 50 条
  • [1] A NEW MOTION MODEL FOR PANORAMIC VIDEO CODING
    Wang, Yefei
    Li, Li
    Liu, Dong
    Wu, Feng
    Gao, Wen
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 1407 - 1411
  • [2] Adaptive lapped transform-based image and video coding
    Klausutis, TJ
    Madisetti, VK
    VISUAL COMMUNICATIONS AND IMAGE PROCESSING '97, PTS 1-2, 1997, 3024 : 117 - 128
  • [3] Hadamard Transform-Based Optimized HEVC Video Coding
    Tang, Minhao
    Chen, Xinyao
    Wen, Jiangtao
    Han, Yuxing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (03) : 827 - 839
  • [4] Side information refinement using motion estimation in DC domain for transform-based distributed video coding
    Badem, M. B.
    Mrak, M.
    Fernando, W. A. C.
    ELECTRONICS LETTERS, 2008, 44 (16) : 965 - 966
  • [5] Transform Domain Temporal Prediction and Geodesic Motion Compensation in Spherical Video Coding
    Sivakumar, Kruthika Koratti
    Vishwanath, Bharath
    Rose, Kenneth
    2020 54TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2020, : 1127 - 1131
  • [6] Transform-Based Feature Map Compression Method for Video Coding for Machines (VCM)
    Lee, Minhun
    Park, Seungjin
    Oh, Seoung-Jun
    Kim, Younhee
    Jeong, Se Yoon
    Lee, Jooyoung
    Sim, Donggyu
    ELECTRONICS, 2023, 12 (19)
  • [7] Panoramic video coding based on spherical distortion with spatio-temporal dependency
    Yang X.
    Zhu C.
    Guo H.
    Luo L.
    Tongxin Xuebao/Journal on Communications, 2023, 44 (10): : 58 - 71
  • [8] Wavelet Transform-Based Downsampling for Low Bit-Rate Video Coding
    Zheng, Kankan
    Zhang, Liang
    Xie, Rong
    PROCEEDINGS OF 2015 INTERNATIONAL CONFERENCE ON ESTIMATION, DETECTION AND INFORMATION FUSION ICEDIF 2015, 2015, : 233 - 238
  • [9] On the study of transform-based lossless coding
    Li, X
    Orchard, MT
    VISUAL COMMUNICATIONS AND IMAGE PROCESSING '99, PARTS 1-2, 1998, 3653 : 1354 - 1363
  • [10] Adaptive selection of motion models for panoramic video coding
    Zheng, Jiali
    Shen, Yanfei
    Zhang, Yongdong
    Ni, Guangnan
    2007 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-5, 2007, : 1319 - 1322