A Novel and Efficient Spatial–Temporal Saliency-Driven Integrated Video Compression

被引:0
|
作者
Anitha Kumari R.D. [1 ]
Udupa A.N. [2 ]
机构
[1] School of Electronics and Communication, REVA University, Affiliated to VTU, Belagavi, Karnataka, Bengaluru
[2] Philips Research, Karnataka, Bengaluru
关键词
Saliency video compression; Video compression;
D O I
10.1007/s42979-023-02503-8
中图分类号
学科分类号
摘要
High-definition devices require the HD-videos for their proper utilization; however, it comprises several issues while transmission such as high computational complexity, long encoding time and restricted battery power. Moreover, several video compression algorithm has been introduced in past to solve the above-mentioned problem, however, due to the high-traffic video and low metrics of the existing algorithm, there is a requirement for an efficient algorithm. A major growth factor results in the contributions put forth towards video saliency, the existing methods perform saliency detection through a frame-wise approach that results in various challenges by incorporating an incoherent pixel-based saliency map detection that uses a spatio-temporal mechanism that utilizes frame-wise motion saliency with pixel-based temporal uniformity for diffusion purpose. This research develops an integrated video compression (IVC). At first, an effective and optimal spatio-temporal aware inter-frame and intra-frame-based saliency model is developed along with optimization modelling. Furthermore, two algorithms for designing a saliency map and optimized quantization for bitrate minimization. Performance analysis is carried out on a standard dataset; also comparison is carried out with existing state-of-art techniques to prove the model efficiency. IVC achieves better performance considering AUC, NCC, SIM and KL metrics. © The Author(s), under exclusive licence to Springer Nature Singapore Pte Ltd 2024.
引用
收藏
相关论文
共 50 条
  • [1] A Saliency-driven Video Magnifier for People with Low Vision
    Aydin, Ali Selman
    Feiz, Shirin
    Ashok, Vikas
    Ramakrishnan, I., V
    17TH INTERNATIONAL WEB FOR ALL CONFERENCE (WEB4ALL), 2020,
  • [2] SALIENCY-DRIVEN VERSATILE VIDEO CODING FOR NEURAL OBJECT DETECTION
    Fischer, Kristian
    Fleckenstein, Felix
    Herglotz, Christian
    Kaup, Andre
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1505 - 1509
  • [3] CONTENT-AWARE COMPRESSION USING SALIENCY-DRIVEN IMAGE RETARGETING
    Zuend, Fabio
    Pritch, Yael
    Sorkine-Hornung, Alexander
    Mangold, Stefan
    Gross, Thomas
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 1845 - 1849
  • [4] Saliency-Driven Real-Time Video-to-Tactile Translation
    Kim, Myongchan
    Lee, Sungkil
    Choi, Seungmoon
    IEEE TRANSACTIONS ON HAPTICS, 2014, 7 (03) : 394 - 404
  • [5] Video Compression through Advanced Video Saliency Aware Spatial-Temporal Integration and Attention Mechanisms
    H. Ravishankar
    R. D. AnithaKumari
    D. R. Sarvamangala
    C. Rashmi
    K. R. Deepa
    SN Computer Science, 5 (7)
  • [6] Robust Saliency-Driven Quality Adaptation for Mobile 360-Degree Video Streaming
    Wang, Shibo
    Yang, Shusen
    Su, Hairong
    Zhao, Cong
    Xu, Chenren
    Qian, Feng
    Wang, Nanbin
    Xu, Zongben
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (02) : 1312 - 1329
  • [7] SalientVR: Saliency-Driven Mobile 360-Degree Video Streaming with Gaze Information
    Wang, Shibo
    Yang, Shusen
    Li, Hailiang
    Zhang, Xiaodan
    Zhou, Chen
    Xu, Chenren
    Qian, Feng
    Wang, Nanbin
    Xu, Zongben
    PROCEEDINGS OF THE 2022 THE 28TH ANNUAL INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND NETWORKING, ACM MOBICOM 2022, 2022, : 542 - 555
  • [8] SDSR: Optimizing Metaverse Video Streaming via Saliency-Driven Dynamic Super-Resolution
    Chai, Baili
    Chen, Jinyu
    Luo, Zhenxiao
    Wang, Zelong
    Hu, Miao
    Zhou, Yipeng
    Wu, Di
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2024, 42 (04) : 978 - 989
  • [9] SD-DSAN: SALIENCY-DRIVEN DENSE SPATIAL ATTENTION NETWORK FOR PAN-SHARPENING
    Zhu, Wanning
    Sun, Yang
    Wang, Shan
    Zhang, Libao
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1079 - 1082
  • [10] A NOVEL SALIENCY-DRIVEN OIL TANK DETECTION METHOD FOR SYNTHETIC APERTURE RADAR IMAGES
    Zhang, Libao
    Liu, Congyang
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2608 - 2612