Multi-Frame Motion Compensation using Extrapolated Frame by Optical Flow for Lossless Video Coding

被引:0
|
作者
Kameda, Yusuke [1 ]
Kishi, Hiroyuki [1 ]
Ishikawa, Tomokazu [1 ]
Matsuda, Ichiro [1 ]
Itoh, Susumu [1 ]
机构
[1] Tokyo Univ Sci, Fac Sci & Technol, 2641 Yamazaki, Noda, Chiba 2788510, Japan
关键词
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We propose an efficient motion compensation method based on a temporally extrapolated frame by using a pel-wise motion (optical flow) estimation. In traditional motion compensation methods, motion vectors are generally detected on a block-by-block basis and sent to the decoder as side information. However, such block-wise motions are not always suitable for motions such as local scaling, rotation, and deformation. On the other hand, pel-wise motion can be estimated on both the side of the encoder and decoder from two successive frames that were previously encoded without side information. The use of pel-wise motion enables the extrapolated frame to be generated under the assumption of linear uniform motions within a short time period. This frame is an approximation of the frame to be encoded. The proposed bi-prediction method uses the extrapolated frame as one of the reference frames. The experimental results indicate that the prediction performance of the proposed method is higher than that of the traditional method.
引用
收藏
页码:300 / 304
页数:5
相关论文
共 50 条
  • [41] VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimation
    Shi, Xiaoyu
    Huang, Zhaoyang
    Bian, Weikang
    Li, Dasong
    Zhang, Manyuan
    Cheung, Ka Chun
    See, Simon
    Qin, Hongwei
    Dai, Jifeng
    Li, Hongsheng
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 12435 - 12446
  • [42] A Simple and Effective Fusion Approach for Multi-frame Optical Flow Estimation
    Ren, Zhile
    Gallo, Orazio
    Sun, Deqing
    Yang, Ming-Hsuan
    Sudderth, Erik B.
    Kautz, Jan
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT VI, 2019, 11134 : 706 - 710
  • [43] Multi-frame motion estimation: Application to motion compensated prediction
    Gibson, D
    Spann, M
    ISCAS '99: PROCEEDINGS OF THE 1999 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL 4: IMAGE AND VIDEO PROCESSING, MULTIMEDIA, AND COMMUNICATIONS, 1999, : 54 - 57
  • [44] Multi-frame motion-compensated video compression for the digital set top box
    Girod, B
    Flierl, M
    2002 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL II, PROCEEDINGS, 2002, : 1 - 4
  • [45] Multi-frame Abnormality Detection in Video Capsule Endoscopy
    Jablonski, James
    Fernandes, Philip
    Adewole, Sodiq
    Syed, Sana
    Brown, Donald
    Porter, Michael
    PROCEEDINGS OF THE FUTURE TECHNOLOGIES CONFERENCE (FTC) 2021, VOL 2, 2022, 359 : 177 - 186
  • [46] Multi-frame motion detection for active/unstable cameras
    Ristivojevic, Mirko
    Konrad, Janusz
    2009 XXII BRAZILIAN SYMPOSIUM ON COMPUTER GRAPHICS AND IMAGE PROCESSING (SIBGRAPI 2009), 2009, : 284 - 290
  • [47] Constrained, globally optimal, multi-frame motion estimation
    Farsiu, Sina
    Elad, Michael
    Milanfar, Peyman
    2005 IEEE/SP 13TH WORKSHOP ON STATISTICAL SIGNAL PROCESSING (SSP), VOLS 1 AND 2, 2005, : 1313 - 1318
  • [48] Unsupervised Learning Optical Flow in Multi-frame Dynamic Environment Using Temporal Dynamic Modeling
    Sun, Zitang
    Nishida, Shin'ya
    Luo, Zhengbo
    arXiv, 2023,
  • [49] A single frame and multi-frame joint network for 360-degree panorama video
    Liu, Hongying
    Ma, Wanhao
    Ruan, Zhubo
    Fang, Chaowei
    Shang, Fanhua
    Liu, Yuanyuan
    Wang, Lijun
    Wang, Chaoli
    Jiang, Dongmei
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 134
  • [50] Unsupervised learning of optical flow in a multi-frame dynamic environment using temporal dynamic modeling
    Zitang Sun
    Zhengbo Luo
    Shin’ya Nishida
    Complex & Intelligent Systems, 2024, 10 : 2215 - 2231