EVASR: Edge-Based Video Delivery with Salience-Aware Super-Resolution

被引:2
|
作者
Li, Na [1 ]
Liu, Yao [1 ]
机构
[1] Rutgers State Univ, Piscataway, NJ 08854 USA
关键词
Video delivery; edge computing; super-resolution; deep-learning; salience-aware; visual quality;
D O I
10.1145/3587819.3590967
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid growth of video content consumption, it is important to deliver high-quality streaming videos to users even under limited available network bandwidth. In this paper, we propose EVASR, a system that performs edge-based video delivery to clients with salience-aware super-resolution. We select patches with higher saliency score to perform super-resolution while applying the simple yet efficient bicubic interpolation for the remaining patches in the same video frame. To efficiently use the computation resources available at the edge server, we introduce a new metric called lsaliency visual qualityz and formulate patch selection as an optimization problem to achieve the best performance when an edge server is serving multiple users. We implement EVASR based on the FFmpeg framework and conduct extensive experiments for evaluation. Results show that EVASR outperforms baseline approaches in both resource efficiency and visual quality metrics including PSNR, saliency visual quality (SVQ), and VMAF.
引用
收藏
页码:142 / 152
页数:11
相关论文
共 50 条
  • [21] Super-resolution image reconstruction with edge adaptive weight in video sequence
    Kwon, Ji Yong
    Yoo, Du Sic
    Park, Jong Hyun
    Park, Se Hyeok
    Kang, Moon Gi
    Proceedings of SPIE - The International Society for Optical Engineering, 2012, 8295
  • [22] ERQA: Edge-restoration Quality Assessment for Video Super-Resolution
    Kirillova, Anastasia
    Lyapustin, Eugene
    Antsiferova, Anastasia
    Vatolin, Dmitry
    PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 4, 2022, : 315 - 322
  • [23] Super-Resolution Image Reconstruction with Edge Adaptive Weight in Video Sequence
    Kwon, Ji Yong
    Yoo, Du Sic
    Park, Jong Hyun
    Park, Se Hyeok
    Kang, Moon Gi
    IMAGE PROCESSING: ALGORITHMS AND SYSTEMS X AND PARALLEL PROCESSING FOR IMAGING APPLICATIONS II, 2012, 8295
  • [24] Regularized Super-Resolution Reconstruction Based on Edge Prior
    Luo, Zhenzhao
    Chen, Dongfang
    Wang, Xiaofeng
    INTELLIGENT COMPUTING METHODOLOGIES, ICIC 2018, PT III, 2018, 10956 : 408 - 417
  • [25] A scheme for super-resolution of video based on r/KPSO
    Yan, Yunyi
    He, Yujie
    Hu, Yingying
    Guo, Baolong
    Zhu, Juanjuan
    Journal of Information and Computational Science, 2014, 11 (05): : 1463 - 1470
  • [26] Video Super-Resolution Based on Multiple Networks Merging
    Shao, Weiye
    Xu, Zhihai
    Feng, Huajun
    Li, Qi
    2018 4TH INTERNATIONAL CONFERENCE ON ENVIRONMENTAL SCIENCE AND MATERIAL APPLICATION, 2019, 252
  • [27] A BLOCK-BASED SUPER-RESOLUTION FOR VIDEO SEQUENCES
    Prendergast, Ryan S.
    Nguyen, Truong Q.
    2008 15TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-5, 2008, : 1240 - 1243
  • [28] Edge-Aware Image Super-Resolution Using a Generative Adversarial Network
    Das B.
    Roy S.D.
    SN Computer Science, 4 (2)
  • [29] Lightweight Video Super-Resolution for Compressed Video
    Kwon, Ilhwan
    Li, Jun
    Prasad, Mukesh
    ELECTRONICS, 2023, 12 (03)
  • [30] VIDEO SUPER-RESOLUTION FOR MIXED RESOLUTION STEREO
    Jain, Ankit K.
    Nguyen, Truong Q.
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 962 - 966