Internet Video Delivery Improved by Super-Resolution with GAN

被引:3
|
作者
Liborio, Joao da Mata [1 ,2 ]
Melo, Cesar [1 ]
Silva, Marcos [1 ]
机构
[1] Fed Univ Amazonas UFAM, Comp Inst, BR-69080900 Manaus, Brazil
[2] Amazonas State Univ UEA, Ctr Higher Studies Itacoatiara, BR-69101416 Itacoatiara, Brazil
关键词
super-resolution; deep neural networks; GAN; streaming traffic; CDN; video delivery; cloud;
D O I
10.3390/fi14120364
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, image and video super-resolution have gained attention outside the computer vision community due to the outstanding results produced by applying deep-learning models to solve the super-resolution problem. These models have been used to improve the quality of videos and images. In the last decade, video-streaming applications have also become popular. Consequently, they have generated traffic with an increasing quantity of data in network infrastructures, which continues to grow, e.g., global video traffic is forecast to increase from 75% in 2017 to 82% in 2022. In this paper, we leverage the power of deep-learning-based super-resolution methods and implement a model for video super-resolution, which we call VSRGAN+. We train our model with a dataset proposed to teach systems for high-level visual comprehension tasks. We also test it on a large-scale JND-based coded video quality dataset containing 220 video clips with four different resolutions. Additionally, we propose a cloud video-delivery framework that uses video super-resolution. According to our findings, the VSRGAN+ model can reconstruct videos without perceptual distinction of the ground truth. Using this model with added compression can decrease the quantity of data delivered to surrogate servers in a cloud video-delivery framework. The traffic decrease reaches 98.42% in total.
引用
收藏
页数:23
相关论文
共 50 条
  • [31] A Video Super-Resolution Framework Using SCoBeP
    Barzigar, Nafise
    Roozgard, Aminmohammad
    Verma, Pramode
    Cheng, Samuel
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2016, 26 (02) : 264 - 277
  • [32] Video Super-Resolution With Convolutional Neural Networks
    Kappeler, Armin
    Yoo, Seunghwan
    Dai, Qiqin
    Katsaggelos, Aggelos K.
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2016, 2 (02) : 109 - 122
  • [33] Simultaneously retargeting and super-resolution for stereoscopic video
    Kai Kang
    Yang Cao
    Zengfu Wang
    Multimedia Tools and Applications, 2017, 76 : 11081 - 11095
  • [34] Optical flow for video super-resolution: a survey
    Zhigang Tu
    Hongyan Li
    Wei Xie
    Yuanzhong Liu
    Shifu Zhang
    Baoxin Li
    Junsong Yuan
    Artificial Intelligence Review, 2022, 55 : 6505 - 6546
  • [35] Rethinking Alignment in Video Super-Resolution Transformers
    Shi, Shuwei
    Gu, Jinjin
    Xie, Liangbin
    Wang, Xintao
    Yang, Yujiu
    Dong, Chao
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [36] Deformable transformer for endoscopic video super-resolution
    Song, Xiaowei
    Tang, Hui
    Yang, Chunfeng
    Zhou, Guangquan
    Wang, Yangang
    Huang, Xinjun
    Hua, Jie
    Coatrieux, Gouenou
    He, Xiaopu
    Chen, Yang
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 77
  • [37] EFFICIENT JOINT VIDEO DENOISING AND SUPER-RESOLUTION
    Huang, Yuning
    Wang, Tianqi
    Lin, Qian
    Allebach, Jan P.
    Zhu, Fengqing
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1865 - 1869
  • [38] A Survey of Deep Learning Video Super-Resolution
    Baniya, Arbind Agrahari
    Lee, Tsz-Kwan
    Eklund, Peter W.
    Aryal, Sunil
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (04): : 2655 - 2676
  • [39] Understanding Deformable Alignment in Video Super-Resolution
    Chan, Kelvin C. K.
    Wang, Xintao
    Yu, Ke
    Dong, Chao
    Loy, Chen Change
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 973 - 981
  • [40] Accelerating the Training of Video Super-resolution Models
    Lin, Lijian
    Wang, Xintao
    Qi, Zhongang
    Shan, Ying
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 2, 2023, : 1595 - 1603