Increasing space-time resolution in video

被引:0
|
作者
Shechtman, E [1 ]
Caspi, Y [1 ]
Irani, M [1 ]
机构
[1] Weizmann Inst Sci, Dept Comp Sci & Appl Math, IL-76100 Rehovot, Israel
来源
关键词
super-resolution; space-time analysis;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a method for constructing a video sequence of high space-time resolution by combining information from multiple low-resolution video sequences of the same dynamic scene. Super-resolution is performed simultaneously in time and in space. By "temporal super-resolution" we mean recovering rapid dynamic events that occur faster than regular frame-rate. Such dynamic events are not visible (or else observed incorrectly) in any of the input sequences, even if these are played in "slow-motion". The spatial and temporal dimensions are very different in nature, yet are inter-related. This leads to interesting visual tradeoffs in time and space, and to new video applications. These include: (i) treatment of spatial artifacts (e.g., motion-blur) by increasing the temporal resolution, and (ii) combination of input sequences of different space-time resolutions (e.g., NTSC, PAL, and even high quality still images) to generate a high quality video sequence.
引用
收藏
页码:753 / 768
页数:16
相关论文
共 50 条
  • [11] STDAN: Deformable Attention Network for Space-Time Video Super-Resolution
    Wang, Hai
    Xiang, Xiaoyu
    Tian, Yapeng
    Yang, Wenming
    Liao, Qingmin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (08) : 10606 - 10616
  • [12] Learned Low Bitrate Video Compression with Space-Time Super-Resolution
    Yang, Jiayu
    Yang, Chunhui
    Xiong, Fei
    Wang, Feng
    Wang, Ronggang
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 1785 - 1789
  • [13] Deformable Attention Network for Efficient Space-Time Video Super-Resolution
    Wang, Hua
    Chamchong, Rapeeporn
    Chomphuwiset, Phatthanaphong
    Pawara, Pornntiwa
    IET IMAGE PROCESSING, 2025, 19 (01)
  • [14] Space-Time Video Super-Resolution 3D Transformer
    Zheng, Minyan
    Luo, Jianping
    MULTIMEDIA MODELING, MMM 2023, PT II, 2023, 13834 : 374 - 385
  • [15] STDAN: Deformable Attention Network for Space-Time Video Super-Resolution
    Wang, Hai
    Xiang, Xiaoyu
    Tian, Yapeng
    Yang, Wenming
    Liao, Qingmin
    arXiv, 2022,
  • [16] Space-time compression of FLIR video
    Russo, LE
    2000 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL II, PROCEEDINGS, 2000, : 419 - 422
  • [17] Space-Time Regularization for Video Decompression
    Schaeffer, Hayden
    Yang, Yi
    Osher, Stanley
    SIAM JOURNAL ON IMAGING SCIENCES, 2015, 8 (01): : 373 - 402
  • [18] SPACE-TIME DYNAMICS IN VIDEO FEEDBACK
    CRUTCHFIELD, JP
    PHYSICA D, 1984, 10 (1-2): : 229 - &
  • [19] Space-Time Video Super-Resolution Based on Long-Term Time Dependence
    Huang, Xinyi
    Xue, Tong
    Hu, Yiwen
    Lan, Hui
    Sun, Jinshan
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VII, 2023, 14260 : 514 - 526
  • [20] Video stabilization using space-time video completion
    Voronin, V.
    Frantc, V.
    Marchuk, V.
    Shrayfel, I.
    Gapon, N.
    Agaian, S.
    MOBILE MULTIMEDIA/IMAGE PROCESSING, SECURITY, AND APPLICATIONS 2016, 2016, 9869