RETINA-INSPIRED SPATIO-TEMPORAL FILTERING FOR DYNAMIC VIDEO CODING

被引:0
|
作者
Doutsi, Effrosyni [1 ,2 ]
Antonini, Marc [1 ]
Tsakalides, Panagiotis [2 ]
机构
[1] Univ Cote dAzur, CNRS, I3S, Nice, France
[2] FORTH, Inst Comp Sci, Iraklion, Greece
关键词
Center-surround filter; dynamic transform; video compression; retina; neuro-inspired filtering; perception-based processing; IMAGE;
D O I
10.1109/ICIP46576.2022.9897355
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The goal of this work is to propose a simple yet efficient way to dynamically transform a sequence of images according to the functional properties of the visual system. To achieve this goal, we extend to video sequences the Retina-Inspired Filter (RIF), which we have recently proposed for still images. Under the assumption that the input signal remains constant for a given time, the RIF decomposition was proven to be invertible, meaning that the image could be perfectly recovered. In this paper, we relax this assumption into a piece-wise constant input and we prove that RIF can be applied to a Group Of Pictures (GOP). Under the condition that a GOP consists of frames without strong pixel motion, we mathematically prove and experimentally show that when RIF is applied to GOP, whatever the size of the GOP is, we are still able to perfectly recover the video frames and at the same time simplify the complexity of the whole process. In addition, we show that while the GOP size increases, the memory cost required to store this amount of frames is sufficiently reduced.
引用
收藏
页码:3321 / 3325
页数:5
相关论文
共 50 条
  • [21] Spatio-temporal Sampling for Video
    Shankar, Mohan
    Pitsiauis, Nikos P.
    Brady, David
    IMAGE RECONSTRUCTION FROM INCOMPLETE DATA V, 2008, 7076
  • [22] Hybrid coding of video with spatio-temporal scalability using subband decomposition
    Domanski, M
    Luczak, A
    Mackowiak, S
    Swierczynski, R
    VISUAL COMMUNICATIONS AND IMAGE PROCESSING '99, PARTS 1-2, 1998, 3653 : 1018 - 1025
  • [23] Spatio-Temporal Correlation Guided Geometric Partitioning for Versatile Video Coding
    Meng, Xuewei
    Jia, Chuanmin
    Zhang, Xinfeng
    Wang, Shanshe
    Ma, Siwei
    IEEE Transactions on Image Processing, 2022, 31 : 30 - 42
  • [24] MULTIPLE SELECTION APPROXIMATION FOR IMPROVED SPATIO-TEMPORAL PREDICTION IN VIDEO CODING
    Seiler, Juergen
    Kaup, Andre
    2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 886 - 889
  • [25] Panoramic video coding based on spherical distortion with spatio-temporal dependency
    Yang X.
    Zhu C.
    Guo H.
    Luo L.
    Tongxin Xuebao/Journal on Communications, 2023, 44 (10): : 58 - 71
  • [26] Spatio-temporal Video Representation with Locality-Constrained Linear Coding
    Al Ghamdi, Manal
    Al Harbi, Nouf
    Gotoh, Yoshihiko
    COMPUTER VISION - ECCV 2012, PT III, 2012, 7585 : 101 - 110
  • [27] SPATIO-TEMPORAL PREDICTION IN VIDEO CODING BY SPATIALLY REFINED MOTION COMPENSATION
    Seiler, Juergen
    Kaup, Andre
    2008 15TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-5, 2008, : 2788 - 2791
  • [28] Multiple selection approximation for improved spatio-temporal prediction in video coding
    Department of Multimedia Communications and Signal Processing, University of Erlangen-Nuremberg, Cauerstr. 7, 91058 Erlangen, Germany
    ICASSP IEEE Int Conf Acoust Speech Signal Process Proc, 2010, (886-889):
  • [29] Weighted average spatio-temporal update operator for subband video coding
    Tillier, C
    Pesquet-Popescu, B
    van der Schaar, M
    ICIP: 2004 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1- 5, 2004, : 1305 - 1308
  • [30] MULTIPLE SELECTION APPROXIMATION FOR IMPROVED SPATIO-TEMPORAL PREDICTION IN VIDEO CODING
    Seiler, Jürgen
    Kaup, André
    arXiv, 2022,