EVASR: Edge-Based Video Delivery with Salience-Aware Super-Resolution

被引:2
|
作者
Li, Na [1 ]
Liu, Yao [1 ]
机构
[1] Rutgers State Univ, Piscataway, NJ 08854 USA
关键词
Video delivery; edge computing; super-resolution; deep-learning; salience-aware; visual quality;
D O I
10.1145/3587819.3590967
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid growth of video content consumption, it is important to deliver high-quality streaming videos to users even under limited available network bandwidth. In this paper, we propose EVASR, a system that performs edge-based video delivery to clients with salience-aware super-resolution. We select patches with higher saliency score to perform super-resolution while applying the simple yet efficient bicubic interpolation for the remaining patches in the same video frame. To efficiently use the computation resources available at the edge server, we introduce a new metric called lsaliency visual qualityz and formulate patch selection as an optimization problem to achieve the best performance when an edge server is serving multiple users. We implement EVASR based on the FFmpeg framework and conduct extensive experiments for evaluation. Results show that EVASR outperforms baseline approaches in both resource efficiency and visual quality metrics including PSNR, saliency visual quality (SVQ), and VMAF.
引用
收藏
页码:142 / 152
页数:11
相关论文
共 50 条
  • [1] Edge-based Motion and Intensity Prediction for Video Super-Resolution
    Wang, Jen-Wen
    Chiu, Ching-Te
    2014 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2014, : 1039 - 1043
  • [2] Video Super-resolution using Edge-based Optical Flow and Intensity Prediction
    Jen-Wen Wang
    Ching-Te Chiu
    Journal of Signal Processing Systems, 2018, 90 : 1699 - 1711
  • [3] Video Super-resolution using Edge-based Optical Flow and Intensity Prediction
    Wang, Jen-Wen
    Chiu, Ching-Te
    JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2018, 90 (12): : 1699 - 1711
  • [4] EDGE-BASED LOSS FUNCTION FOR SINGLE IMAGE SUPER-RESOLUTION
    Seif, George
    Androutsos, Dimitrios
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 1468 - 1472
  • [5] Compression-Aware Video Super-Resolution
    Wang, Yingwei
    Isobe, Takashi
    Jia, Xu
    Tao, Xin
    Lu, Huchuan
    Tai, Yu-Wing
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 2012 - 2021
  • [6] Adaptive large scale artifact reduction in edge-based image super-resolution
    Wong, Alexander
    Bishop, William
    PROCEEDINGS OF THE NINTH IASTED INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING, 2007, : 230 - 235
  • [7] Video Super-Resolution Based on Generative Adversarial Network and Edge Enhancement
    Wang, Jialu
    Teng, Guowei
    An, Ping
    ELECTRONICS, 2021, 10 (04) : 1 - 19
  • [8] Edge-Oriented Compressed Video Super-Resolution
    Wang, Zheng
    Quan, Guancheng
    He, Gang
    SENSORS, 2024, 24 (01)
  • [9] Internet Video Delivery Improved by Super-Resolution with GAN
    Liborio, Joao da Mata
    Melo, Cesar
    Silva, Marcos
    FUTURE INTERNET, 2022, 14 (12)
  • [10] Edge-Aware Attention Transformer for Image Super-Resolution
    Wang, Haoqian
    Xing, Zhongyang
    Xu, Zhongjie
    Cheng, Xiangai
    Li, Teng
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 2905 - 2909