Video Inpainting Algorithm Using Spatio-Temporal Consistency

被引:0
|
作者
Lee, Sang-Heon [2 ]
Lee, Soon-Young [2 ]
Heu, Jun-Hee [2 ]
Kim, Chang-Su [1 ]
Lee, Sang-Uk [2 ]
机构
[1] Seoul Natl Univ, Sch Elect Engn, San 56-1, Seoul 151742, South Korea
[2] Seoul Natl Univ, Signal Proc Lab, Sch Elect Engn, Seoul 151, South Korea
来源
COMPUTATIONAL IMAGING VII | 2009年 / 7246卷
关键词
inpainting; restoration; optimization; video editing; spatio-temporal inpainting;
D O I
10.1117/12.805892
中图分类号
TH742 [显微镜];
学科分类号
摘要
A new video inpainting algorithm is proposed for removing unwanted or erroneous objects from video data. The proposed algorithm fills a mask region with source blocks from unmasked areas, while keeping spatio-temporal consistency. First, a 3-dimensional graph is constructed over consecutive frames. It defines a structure of nodes over which the source blocks are pasted. Then, we form temporal block bundles using the motion information. The best block bundles, which minimize an objective function, are arranged in the 3-dimensional graph. Extensive simulation results demonstrate that the proposed algorithm can yield visually pleasing video inpainting results even for dynamic sequences.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Video shot similarity algorithm based on spatio-temporal slices
    Cai, Bo
    Yin, Shuangtai
    Du, Hao
    Zhang, Dengyi
    Zhao, Jianhui
    2008 PROCEEDINGS OF INFORMATION TECHNOLOGY AND ENVIRONMENTAL SYSTEM SCIENCES: ITESS 2008, VOL 4, 2008, : 862 - 866
  • [22] Embracing Consistency: A One-Stage Approach for Spatio-Temporal Video Grounding
    Jin, Yang
    Li, Yongzhi
    Yuan, Zehuan
    Mu, Yadong
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [23] ENHANCED SPATIO-TEMPORAL VIDEO COPY DETECTION BY COMBINING TRAJECTORY AND SPATIAL CONSISTENCY
    Ozkan, Savas
    Esen, Ersin
    Akar, Gozde Bozdagi
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 2527 - 2531
  • [24] Video Synopsis Generation Using Spatio-Temporal Groups
    Ahmed, A.
    Kar, S.
    Dogra, D. P.
    Patnaik, R.
    Lee, S.
    Choi, H.
    Kim, I.
    2017 IEEE INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING APPLICATIONS (ICSIPA), 2017, : 512 - 517
  • [25] Video Caption Extraction Using Spatio-Temporal Slices
    Chen, Liang-Hua
    Su, Chih-Wen
    INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2018, 18 (02)
  • [26] Spatio-temporal segmentation using laserscanner and video sequences
    Kaempchen, N
    Zocholl, M
    Dietmayer, KCJ
    PATTERN RECOGNITION, 2004, 3175 : 367 - 374
  • [27] Video texture indexing using spatio-temporal wavelets
    Smith, JR
    Lin, CH
    Naphade, M
    2002 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL II, PROCEEDINGS, 2002, : 437 - 440
  • [28] Video spatio-temporal signatures using polynomial transforms
    Rivero-Moreno, CJ
    Bres, S
    VISUAL INFORMATION AND INFORMATION SYSTEMS, 2006, 3736 : 50 - 59
  • [29] Video Identification Using Spatio-temporal Salient Points
    Li, Yue-nan
    Lu, Zhe-ming
    FIFTH INTERNATIONAL CONFERENCE ON INFORMATION ASSURANCE AND SECURITY, VOL 2, PROCEEDINGS, 2009, : 79 - 82
  • [30] Human Motion Prediction via Spatio-Temporal Inpainting
    Ruiz, A. Hernandez
    Gall, J.
    Moreno-Noguer, F.
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 7133 - 7142