MFNet:Real-Time Motion Focus Network for Video Frame Interpolation

被引:3
|
作者
Zhu, Guosong [1 ]
Qin, Zhen [1 ]
Ding, Yi [1 ]
Liu, Yao [1 ]
Qin, Zhiguang [1 ]
机构
[1] Univ Elect Sci & Technol China, Network & Data Secur Key Lab Sichuan Prov, Chengdu 610056, Peoples R China
基金
中国国家自然科学基金;
关键词
Interpolation; Optical imaging; Task analysis; Optical distortion; Memory management; Streaming media; Dynamics; Memory consumption reduction; motion focus; time efficiency improvement; video frame interpolation;
D O I
10.1109/TMM.2023.3308442
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As a popular research topic in computer vision, video frame interpolation is widely used in video processing tasks. However, this task is often limited by slow processing speed or high memory consumption in practical applications. To address these drawbacks, a frame interpolation network focusing on motion regions named MFNet is proposed, which consists of a sampler for adaptive and efficient separation of motion regions from the background, a fine-grained module for direct approximation of intermediate streams, and a lightweight module for bi-directional optical stream fusion. Extensive experiments show that our MFNet achieves optimal accuracy on some frame interpolation tasks and is much faster than other state-of-the-art methods. In addition, transplantation of the core components of MFNet to other frame interpolation networks can significantly improve the performance.
引用
收藏
页码:3251 / 3262
页数:12
相关论文
共 50 条
  • [1] Real-Time Intermediate Flow Estimation for Video Frame Interpolation
    Huang, Zhewei
    Zhang, Tianyuan
    Heng, Wen
    Shi, Boxin
    Zhou, Shuchang
    COMPUTER VISION - ECCV 2022, PT XIV, 2022, 13674 : 624 - 642
  • [2] TimeLens-XL: Real-Time Event-Based Video Frame Interpolation with Large Motion
    Ma, Yongrui
    Guo, Shi
    Chen, Yutian
    Xue, Tianfan
    Gu, Jinwei
    COMPUTER VISION - ECCV 2024, PT LXXXIV, 2025, 15142 : 178 - 194
  • [3] Enhanced Real-Time Intermediate Flow Estimation for Video Frame Interpolation
    Kim, Minseop
    Choi, Haechul
    JOURNAL OF WEB ENGINEERING, 2021, 20 (08): : 2413 - 2431
  • [4] FastRIFE: Optimization of Real-Time Intermediate Flow Estimation for Video Frame Interpolation
    Kubas, Malwina
    Sarwas, Grzegorz
    Computer Science Research Notes, 2021, 29 (1-2): : 21 - 28
  • [5] A Motion Refinement Network With Local Compensation for Video Frame Interpolation
    Wang, Kaiqiao
    Liu, Peng
    IEEE ACCESS, 2023, 11 : 103092 - 103101
  • [6] Real-time motion-based frame estimation in video lossy transmission
    Aly, SG
    Youssef, A
    2001 SYMPOSIUM ON APPLICATIONS AND THE INTERNET, PROCEEDINGS, 2001, : 139 - 146
  • [7] Real-Time Full Frame Video Stabilization
    Song, Dacheng
    Chen, Xiaogang
    Yang, Jie
    2012 INTERNATIONAL CONFERENCE ON APPLIED INFORMATICS AND COMMUNICATION (ICAIC 2012), 2013, : 312 - 317
  • [8] Progressive Motion Context Refine Network for Efficient Video Frame Interpolation
    Kong, Lingtong
    Liu, Jinfeng
    Yang, Jie
    arXiv, 2022,
  • [9] Progressive Motion Context Refine Network for Efficient Video Frame Interpolation
    Kong, Lingtong
    Liu, Jinfeng
    Yang, Jie
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 2338 - 2342
  • [10] A block-wise frame difference method for real-time video motion detection
    Wei, Han
    Peng, Qiao
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2018, 15 (04):