Video Inpainting Algorithm Using Spatio-Temporal Consistency

被引:0
|
作者
Lee, Sang-Heon [2 ]
Lee, Soon-Young [2 ]
Heu, Jun-Hee [2 ]
Kim, Chang-Su [1 ]
Lee, Sang-Uk [2 ]
机构
[1] Seoul Natl Univ, Sch Elect Engn, San 56-1, Seoul 151742, South Korea
[2] Seoul Natl Univ, Signal Proc Lab, Sch Elect Engn, Seoul 151, South Korea
来源
COMPUTATIONAL IMAGING VII | 2009年 / 7246卷
关键词
inpainting; restoration; optimization; video editing; spatio-temporal inpainting;
D O I
10.1117/12.805892
中图分类号
TH742 [显微镜];
学科分类号
摘要
A new video inpainting algorithm is proposed for removing unwanted or erroneous objects from video data. The proposed algorithm fills a mask region with source blocks from unmasked areas, while keeping spatio-temporal consistency. First, a 3-dimensional graph is constructed over consecutive frames. It defines a structure of nodes over which the source blocks are pasted. Then, we form temporal block bundles using the motion information. The best block bundles, which minimize an objective function, are arranged in the 3-dimensional graph. Extensive simulation results demonstrate that the proposed algorithm can yield visually pleasing video inpainting results even for dynamic sequences.
引用
收藏
页数:8
相关论文
共 50 条
  • [31] Spatio-temporal video search using the object based video representation
    Zhong, D
    Chang, SF
    INTERNATIONAL CONFERENCE ON IMAGE PROCESSING - PROCEEDINGS, VOL I, 1997, : 21 - 24
  • [32] Spatio-Temporal Consistency and Distributivity as Qualities of Features
    Eckmann, Michael
    Boult, Terrance E.
    2008 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, VOLS 1-3, 2008, : 1356 - +
  • [33] Algorithm of Spatio-temporal Combining Video Denoising Based on Structural Similarity
    Di, Hongwei
    Huang, Chengcheng
    Gao, Hui
    MEASUREMENT TECHNOLOGY AND ENGINEERING RESEARCHES IN INDUSTRY, PTS 1-3, 2013, 333-335 : 845 - 848
  • [34] Spatio-temporal consistency enhancement for disparity sequence
    Liu, Haixu
    Liu, Chenyu
    Tang, Yufang
    Sun, Haohui
    Li, Xueming
    International Journal of Signal Processing, Image Processing and Pattern Recognition, 2014, 7 (05) : 229 - 238
  • [35] Automatic video object segmentation algorithm based on spatio-temporal information
    Zhang, Xiao-Bo
    Liu, Wen-Yao
    Lu, Da-Wei
    Guangdianzi Jiguang/Journal of Optoelectronics Laser, 2008, 19 (03): : 384 - 387
  • [36] Video vehicle detection algorithm through spatio-temporal slices processing
    Liu Anan
    Yang Zhaoxuan
    PROCEEDINGS OF THE 2006 IEEE/ASME INTERNATIONAL CONFERENCE ON MECHATRONIC AND EMBEDDED SYSTEMS AND APPLICATIONS, 2006, : 407 - +
  • [37] An efficient spatio-temporal boundary matching algorithm for video error concealment
    Xiang, Youjun
    Feng, Liangmou
    Xie, Shengli
    Zhou, Zhiheng
    MULTIMEDIA TOOLS AND APPLICATIONS, 2011, 52 (01) : 91 - 103
  • [38] An efficient spatio-temporal boundary matching algorithm for video error concealment
    Youjun Xiang
    Liangmou Feng
    Shengli Xie
    Zhiheng Zhou
    Multimedia Tools and Applications, 2011, 52 : 91 - 103
  • [39] Video Fingerprint Algorithm Based on Spatio-Temporal Deep Neural Network
    Wang Dongdong
    Li Yuenan
    LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (01)
  • [40] Video Segmentation with Spatio-Temporal Tubes
    Trichet, Remi
    Nevatia, Ramakant
    2013 10TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS 2013), 2013, : 330 - 335