Video Inpainting Algorithm Using Spatio-Temporal Consistency

被引：0
|
作者：
Lee, Sang-Heon [2 ]
Lee, Soon-Young [2 ]
Heu, Jun-Hee [2 ]
Kim, Chang-Su [1 ]
Lee, Sang-Uk [2 ]
机构：
[1] Seoul Natl Univ, Sch Elect Engn, San 56-1, Seoul 151742, South Korea
[2] Seoul Natl Univ, Signal Proc Lab, Sch Elect Engn, Seoul 151, South Korea
来源：
COMPUTATIONAL IMAGING VII | 2009年 / 7246卷
关键词：
inpainting; restoration; optimization; video editing; spatio-temporal inpainting;
D O I：
10.1117/12.805892
中图分类号：
TH742 [显微镜];
学科分类号：
摘要：
A new video inpainting algorithm is proposed for removing unwanted or erroneous objects from video data. The proposed algorithm fills a mask region with source blocks from unmasked areas, while keeping spatio-temporal consistency. First, a 3-dimensional graph is constructed over consecutive frames. It defines a structure of nodes over which the source blocks are pasted. Then, we form temporal block bundles using the motion information. The best block bundles, which minimize an objective function, are arranged in the 3-dimensional graph. Extensive simulation results demonstrate that the proposed algorithm can yield visually pleasing video inpainting results even for dynamic sequences.
引用
收藏
页数：8
相关论文
共 50 条
  • [1] Spatio-Temporal Inference Transformer Network for Video Inpainting
    Tudavekar, Gajanan
    Saraf, Santosh S.
    Patil, Sanjay R.
    INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2023, 23 (01)
  • [2] A Spatio-temporal Inpainting Method for Kinect Depth Video
    Zhang, Dongdong
    Yao, Ye
    Zang, Di
    Chen, Yanyu
    2013 IEEE INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING APPLICATIONS (IEEE ICSIPA 2013), 2013, : 67 - 70
  • [3] Spatio-Temporal Consistency in Depth Video Enhancement
    Li, Li
    Zhang, Caiming
    JOURNAL OF ADVANCED MECHANICAL DESIGN SYSTEMS AND MANUFACTURING, 2013, 7 (05): : 808 - 817
  • [4] SPATIO-TEMPORAL CONSISTENCY IN VIDEO DISPARITY ESTIMATION
    Khoshabeh, Ramsin
    Chan, Stanley H.
    Nguyen, Truong Q.
    2011 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2011, : 885 - 888
  • [5] SPATIO-TEMPORAL BINARY VIDEO INPAINTING VIA THRESHOLD DYNAMICS
    Oliver, M.
    Palomares, R. P.
    Ballester, C.
    Haro, G.
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 1822 - 1826
  • [6] Spatio-temporal texture synthesis and image inpainting for video applications
    Kumar, S
    Biswas, M
    Belongie, SJ
    Nguyen, TQ
    2005 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), VOLS 1-5, 2005, : 2317 - 2320
  • [7] Real time Video Fire Detection using Spatio-Temporal Consistency Energy
    Barmpoutis, Panagiotis
    Dimitropoulos, Kosmas
    Grammalidis, Nikos
    2013 10TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS 2013), 2013, : 365 - 370
  • [8] DSTA-Net: Deformable Spatio-Temporal Attention Network for Video Inpainting
    Liu, Tongxing
    Qiu, Guoxin
    Xuan, Hanyu
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 771 - 775
  • [9] STARNet: Low-light video enhancement using spatio-temporal consistency aggregation
    Wu, Zhe
    Sheng, Zehua
    Zhang, Xue
    Cao, Si-Yuan
    Zhang, Runmin
    Yu, Beinan
    Zhang, Chenghao
    Yang, Bailin
    Shen, Hui-Liang
    PATTERN RECOGNITION, 2025, 160
  • [10] A Novel Spatio-Temporal Video Object Segmentation Algorithm
    Zhu, Shiping
    Xia, Xi
    Zhang, Qingrong
    Belloulata, Kamel
    2008 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY, VOLS 1-5, 2008, : 1916 - +
12345