Spherical Coordinates Transform-Based Motion Model for Panoramic Video Coding

被引:15
|
作者
Wang, Yefei [1 ]
Liu, Dong [1 ]
Ma, Siwei [2 ]
Wu, Feng [1 ]
Gao, Wen [2 ]
机构
[1] Univ Sci & Technol China, CAS Key Lab Technol Geospatial Informat Proc & Ap, Hefei 230027, Anhui, Peoples R China
[2] Peking Univ, Natl Engn Lab Video Technol, Beijing 100871, Peoples R China
关键词
Motion model; panoramic video coding; spherical coordinates transform;
D O I
10.1109/JETCAS.2019.2896265
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Panoramic video is produced and displayed as if it is supported on sphere, but it is usually mapped to two-dimensional (2D) plane for compression purpose. The mapping from sphere to 2D plane inevitably causes deformation of video content, which shall be taken into account in panoramic video coding. In this paper, we propose a new motion model based on spherical coordinates transform to explicitly address the deformation problem. Different from the traditional 2D translational motion model, our model assumes a 3D translational motion, which is characterized by a 2D motion vector and a relative depth parameter. Based on spherical coordinates transform, we can deduce the motion compensation and motion estimation algorithms for our proposed motion model. We then integrate the algorithms into the joint exploration model (JEM) scheme for panoramic video coding, and perform experiments on some typical equirectangular projection format video sequences. Experimental results show that our proposed method leads to up to 10.7% and on average 2.6% BD-rate reduction compared to the JEM anchor on our test sequences, with no increase of decoding time.
引用
收藏
页码:98 / 109
页数:12
相关论文
共 50 条
  • [31] Projection Deformation Based Motion Compensation for Panoramic Video
    Zheng, Ruidi
    Huangfu, Xuchang
    Sun, Yule
    Yu, Lu
    2018 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2018,
  • [32] Pansharpening with transform-based gradient transferring model
    Liu, Pengfei
    IET IMAGE PROCESSING, 2019, 13 (13) : 2614 - 2622
  • [33] A new video coding based on 3D wavelet transform and motion compensation
    Nian, YJ
    Wu, LH
    He, SB
    Wavelet Analysis and Active Media Technology Vols 1-3, 2005, : 1307 - 1313
  • [34] MOTION-ADAPTIVE INTRAFRAME TRANSFORM CODING OF VIDEO SIGNALS
    DEWITH, PHN
    PHILIPS JOURNAL OF RESEARCH, 1989, 44 (2-3) : 345 - 364
  • [35] New multiresolution motion estimation for wavelet transform video coding
    Chung, MS
    Kang, S
    Choi, JH
    Kwak, HS
    APCCAS '96 - IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS '96, 1996, : 10 - 13
  • [36] Motion compensated Prediction in Transform Domain Distributed Video Coding
    Borchert, S.
    Westerlaken, R. P.
    Gunnewiek, R. Klein
    Lagendijk, R. L.
    2008 IEEE 10TH WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, VOLS 1 AND 2, 2008, : 336 - +
  • [37] 360 degrees Panoramic Video Coding Based on Region of Interest
    Wu Zhiqiang
    Mei, Yu
    Hao, Jiang
    Fen, Chen
    Jiang Gangyi
    LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (06)
  • [38] Wavelet Transform-Based High-Definition Map Construction From a Panoramic Camera
    Zhuang H.
    Zhou X.
    Wang C.
    Qian Y.
    Journal of Shanghai Jiaotong University (Science), 2021, 26 (05) : 569 - 576
  • [39] Variable block size adaptive lapped transform-based image coding
    Klausutis, TJ
    Madisetti, VK
    INTERNATIONAL CONFERENCE ON IMAGE PROCESSING - PROCEEDINGS, VOL III, 1997, : 686 - 689
  • [40] On hybrid directional transform-based intra-band image coding
    Alecu, Alin
    Munteanu, Adrian
    Pizurica, Aleksandra
    Cornelis, Jan
    Schelkens, Peter
    ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS, PROCEEDINGS, 2007, 4678 : 1049 - 1060