Increasing space-time resolution in video

被引:0
|
作者
Shechtman, E [1 ]
Caspi, Y [1 ]
Irani, M [1 ]
机构
[1] Weizmann Inst Sci, Dept Comp Sci & Appl Math, IL-76100 Rehovot, Israel
来源
关键词
super-resolution; space-time analysis;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a method for constructing a video sequence of high space-time resolution by combining information from multiple low-resolution video sequences of the same dynamic scene. Super-resolution is performed simultaneously in time and in space. By "temporal super-resolution" we mean recovering rapid dynamic events that occur faster than regular frame-rate. Such dynamic events are not visible (or else observed incorrectly) in any of the input sequences, even if these are played in "slow-motion". The spatial and temporal dimensions are very different in nature, yet are inter-related. This leads to interesting visual tradeoffs in time and space, and to new video applications. These include: (i) treatment of spatial artifacts (e.g., motion-blur) by increasing the temporal resolution, and (ii) combination of input sequences of different space-time resolutions (e.g., NTSC, PAL, and even high quality still images) to generate a high quality video sequence.
引用
收藏
页码:753 / 768
页数:16
相关论文
共 50 条
  • [21] On the resolution of space-time singularities II
    Maceda M.
    Madore J.
    Journal of Nonlinear Mathematical Physics, 2004, 11 (Suppl 1) : 21 - 36
  • [22] Efficient Space-time Video Super Resolution using Low-Resolution Flow and Mask Upsampling
    Dutta, Saikat
    Shah, Nisarg A.
    Mittal, Anurag
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 314 - 323
  • [23] Space-time super-resolution
    Shechtman, E
    Caspi, Y
    Irani, M
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2005, 27 (04) : 531 - 545
  • [24] An image detector with space-time resolution
    Yaroshenko, IF
    Il'in, SA
    Kapitanov, GA
    INSTRUMENTS AND EXPERIMENTAL TECHNIQUES, 2000, 43 (05) : 659 - 663
  • [25] An image detector with space-time resolution
    I. F. Yaroshenko
    S. A. Il’in
    G. A. Kapitanov
    Instruments and Experimental Techniques, 2000, 43 : 659 - 663
  • [26] On the resolution of space-time singularities II
    Maceda, M
    Madore, J
    JOURNAL OF NONLINEAR MATHEMATICAL PHYSICS, 2004, 11 : 21 - 36
  • [27] Optical Flow Reusing for High-Efficiency Space-Time Video Super Resolution
    Zhang, Yuantong
    Wang, Huairui
    Zhu, Han
    Chen, Zhenzhong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (05) : 2116 - 2128
  • [28] Fast and Context-Aware Framework for Space-Time Video Super-Resolution
    Zhang, Xueheng
    Chen, Li
    Song, Li
    Gao, Zhiyong
    2021 INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2021,
  • [29] Combining optical flow and Swin Transformer for Space-Time video super-resolution
    Wang, Xin
    Wang, Hua
    Zhang, Mingli
    Zhang, Fan
    Engineering Applications of Artificial Intelligence, 2024, 137
  • [30] Learning Inter-Frame Information for Space-Time Video Super-Resolution
    Zhang, Zhuo
    Guo, Haifa
    Ren, Sheng
    Guo, Kehua
    2022 TENTH INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA, CBD, 2022, : 139 - 144