MFNet:Real-Time Motion Focus Network for Video Frame Interpolation

被引:3
|
作者
Zhu, Guosong [1 ]
Qin, Zhen [1 ]
Ding, Yi [1 ]
Liu, Yao [1 ]
Qin, Zhiguang [1 ]
机构
[1] Univ Elect Sci & Technol China, Network & Data Secur Key Lab Sichuan Prov, Chengdu 610056, Peoples R China
基金
中国国家自然科学基金;
关键词
Interpolation; Optical imaging; Task analysis; Optical distortion; Memory management; Streaming media; Dynamics; Memory consumption reduction; motion focus; time efficiency improvement; video frame interpolation;
D O I
10.1109/TMM.2023.3308442
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As a popular research topic in computer vision, video frame interpolation is widely used in video processing tasks. However, this task is often limited by slow processing speed or high memory consumption in practical applications. To address these drawbacks, a frame interpolation network focusing on motion regions named MFNet is proposed, which consists of a sampler for adaptive and efficient separation of motion regions from the background, a fine-grained module for direct approximation of intermediate streams, and a lightweight module for bi-directional optical stream fusion. Extensive experiments show that our MFNet achieves optimal accuracy on some frame interpolation tasks and is much faster than other state-of-the-art methods. In addition, transplantation of the core components of MFNet to other frame interpolation networks can significantly improve the performance.
引用
收藏
页码:3251 / 3262
页数:12
相关论文
共 50 条
  • [21] MFNet: Multi-Feature Fusion Network for Real-Time Semantic Segmentation in Road Scenes
    Lu, Mengxu
    Chen, Zhenxue
    Liu, Chengyun
    Ma, Sile
    Cai, Lei
    Qin, Hao
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) : 20991 - 21003
  • [22] Forward Warping-Based Video Frame Interpolation Using a Motion Selective Network
    Heo, Jeonghwan
    Jeong, Jechang
    ELECTRONICS, 2022, 11 (16)
  • [23] Efficient Real-time Video Conferencing with Adaptive Frame Delivery
    Liu, Libin
    Li, Jingzong
    Xu, Hong
    Xue, Kaiwen
    Xue, Jason Chun
    COMPUTER NETWORKS, 2023, 234
  • [24] Asymmetric Bilateral Motion Estimation for Video Frame Interpolation
    Park, Junheum
    Lee, Chul
    Kim, Chang-Su
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14519 - 14528
  • [25] Temporal video segmentation for real-time key frame extraction
    Calic, J
    Sav, S
    Izquierdo, E
    Marlow, S
    Murphy, N
    O'Connor, NE
    2002 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS I-IV, PROCEEDINGS, 2002, : 3632 - 3635
  • [26] Video Frame Interpolation for Large Motion with Generative Prior
    Huang, Yuheng
    Jia, Xu
    Su, Xin
    Zhang, Lu
    Li, Xiaomin
    Wang, Qinghe
    Lu, Huchuan
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT X, 2025, 15040 : 402 - 415
  • [27] Robust Video Frame Interpolation With Exceptional Motion Map
    Park, Minho
    Kim, Hak Gu
    Lee, Sangmin
    Ro, Yong Man
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (02) : 754 - 764
  • [28] Frame Difference-Based Real-Time Video Stylization in Video Calls
    Xiong, Zheyang
    Weber, Cornelius
    Hu, Xiaolin
    2018 NINTH INTERNATIONAL CONFERENCE ON INTELLIGENT CONTROL AND INFORMATION PROCESSING (ICICIP), 2018, : 333 - 339
  • [29] Real-time anomaly detection in full motion video
    Konowicz, Glenn
    Li, Jiang
    FULL MOTION VIDEO (FMV) WORKFLOWS AND TECHNOLOGIES FOR INTELLIGENCE, SURVEILLANCE, AND RECONNAISSANCE (ISR) AND SITUATIONAL AWARENESS, 2012, 8386
  • [30] Real-time recursive motion segmentation of video data
    Wittebrood, R
    de Haan, G
    ICCE: 2001 INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS, DIGEST OF TECHNICAL PAPERS, 2001, : 288 - 289