Increasing space-time resolution in video

被引:0
|
作者
Shechtman, E [1 ]
Caspi, Y [1 ]
Irani, M [1 ]
机构
[1] Weizmann Inst Sci, Dept Comp Sci & Appl Math, IL-76100 Rehovot, Israel
来源
关键词
super-resolution; space-time analysis;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a method for constructing a video sequence of high space-time resolution by combining information from multiple low-resolution video sequences of the same dynamic scene. Super-resolution is performed simultaneously in time and in space. By "temporal super-resolution" we mean recovering rapid dynamic events that occur faster than regular frame-rate. Such dynamic events are not visible (or else observed incorrectly) in any of the input sequences, even if these are played in "slow-motion". The spatial and temporal dimensions are very different in nature, yet are inter-related. This leads to interesting visual tradeoffs in time and space, and to new video applications. These include: (i) treatment of spatial artifacts (e.g., motion-blur) by increasing the temporal resolution, and (ii) combination of input sequences of different space-time resolutions (e.g., NTSC, PAL, and even high quality still images) to generate a high quality video sequence.
引用
收藏
页码:753 / 768
页数:16
相关论文
共 50 条
  • [1] Space-Time Distillation for Video Super-Resolution
    Xiao, Zeyu
    Fu, Xueyang
    Huang, Jie
    Cheng, Zhen
    Xiong, Zhiwei
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 2113 - 2122
  • [2] Learning for Unconstrained Space-Time Video Super-Resolution
    Shi, Zhihao
    Liu, Xiaohong
    Li, Chengqi
    Dai, Linhui
    Chen, Jun
    Davidson, Timothy N.
    Zhao, Jiying
    IEEE TRANSACTIONS ON BROADCASTING, 2022, 68 (02) : 345 - 358
  • [3] Space-Time Super-Resolution from a Single Video
    Shahar, Oded
    Faktor, Alon
    Irani, Michal
    2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011,
  • [4] Space-time completion of video
    Wexler, Yonatan
    Shechtman, Eli
    Irani, Michal
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (03) : 463 - 476
  • [5] Space-Time Video Super-Resolution Using Temporal Profiles
    Xiao, Zeyu
    Xiong, Zhiwei
    Fu, Xueyang
    Liu, Dong
    Zha, Zheng-Jun
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 664 - 672
  • [6] Space-time video completion
    Wexler, Y
    Shechtman, E
    Irani, M
    PROCEEDINGS OF THE 2004 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, 2004, : 120 - 127
  • [7] On the resolution of space-time singularities
    Madore, J
    INTERNATIONAL JOURNAL OF MODERN PHYSICS B, 2000, 14 (22-23): : 2419 - 2425
  • [8] Increasing the Space-Time Resolution of Mapped Sea Surface Height From Altimetry
    Archer, Matthew R.
    Li, Zhijin
    Fu, LeeLueng
    JOURNAL OF GEOPHYSICAL RESEARCH-OCEANS, 2020, 125 (06)
  • [9] Temporal Modulation Network for Controllable Space-Time Video Super-Resolution
    Xu, Gang
    Xu, Jun
    Li, Zhen
    Wang, Liang
    Sun, Xing
    Cheng, Ming-Ming
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 6384 - 6393
  • [10] On improving space-time super resolution using a small set of video inputs
    Mudenagudi, Uma
    Banerjee, Subhashis
    Kalra, Prem
    SIXTH INDIAN CONFERENCE ON COMPUTER VISION, GRAPHICS & IMAGE PROCESSING ICVGIP 2008, 2008, : 320 - +