Increasing space-time resolution in video

被引:0
|
作者
Shechtman, E [1 ]
Caspi, Y [1 ]
Irani, M [1 ]
机构
[1] Weizmann Inst Sci, Dept Comp Sci & Appl Math, IL-76100 Rehovot, Israel
来源
关键词
super-resolution; space-time analysis;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a method for constructing a video sequence of high space-time resolution by combining information from multiple low-resolution video sequences of the same dynamic scene. Super-resolution is performed simultaneously in time and in space. By "temporal super-resolution" we mean recovering rapid dynamic events that occur faster than regular frame-rate. Such dynamic events are not visible (or else observed incorrectly) in any of the input sequences, even if these are played in "slow-motion". The spatial and temporal dimensions are very different in nature, yet are inter-related. This leads to interesting visual tradeoffs in time and space, and to new video applications. These include: (i) treatment of spatial artifacts (e.g., motion-blur) by increasing the temporal resolution, and (ii) combination of input sequences of different space-time resolutions (e.g., NTSC, PAL, and even high quality still images) to generate a high quality video sequence.
引用
收藏
页码:753 / 768
页数:16
相关论文
共 50 条
  • [31] RSTT: Real-time Spatial Temporal Transformer for Space-Time Video Super-Resolution
    Geng, Zhicheng
    Liang, Luming
    Ding, Tianyu
    Zharkov, Ilya
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 17420 - 17430
  • [32] A pioneering video-to-video super-resolution reconstruction algorithm based on segmentation and space-time regularisation
    Guo, L.
    He, X. H.
    Chen, W. L.
    Qing, L. B.
    Luo, D. S.
    IMAGING SCIENCE JOURNAL, 2014, 62 (04): : 236 - 250
  • [33] A comparison between space-time video descriptors
    Costantini, Luca
    Capodiferro, Licia
    Neri, Alessandro
    IMAGE PROCESSING: ALGORITHMS AND SYSTEMS XI, 2013, 8655
  • [34] Space-time multiple description video coding
    Wang, D
    Canagarajah, N
    Bull, D
    VISUAL COMMUNICATIONS AND IMAGE PROCESSING 2006, PTS 1 AND 2, 2006, 6077
  • [35] Space-time Mixing Attention for Video Transformer
    Bulat, Adrian
    Perez-Rua, Juan-Manuel
    Sudhakaran, Swathikiran
    Martinez, Brais
    Tzimiropoulos, Georgios
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021,
  • [36] Video watermarking by space-time interest points
    Li, Lei-Da
    Guo, Bao-Long
    Pan, Jeng-Shyang
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2008, E91A (08): : 2252 - 2256
  • [37] Dual Bidirectional Feature Enhancement Network for Continuous Space-Time Video Super-Resolution
    Luo, Laigan
    Yi, Benshun
    Wang, Zhongyuan
    He, Zheng
    Zhu, Chao
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2025, 11 : 228 - 236
  • [38] Resolution and Comparison of Space-time Signals.
    Pogorelov, A.I.
    Izvestiya Vysshikh Uchebnykh Zavedenij. Radioelektronika, 1980, 23 (07): : 3 - 9
  • [39] VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolution
    Chen, Zeyuan
    Chen, Yinbo
    Liu, Jingwen
    Xu, Xingqian
    Goel, Vidit
    Wang, Zhangyang
    Shi, Humphrey
    Wang, Xiaolong
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 2037 - 2047
  • [40] Controllable Space-Time Video Super-Resolution via Enhanced Bidirectional Flow Warping
    Zhang, Yuantong
    Wang, Huairui
    Chen, Zhenzhong
    2022 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2022,