State-of-the-Art in 360° Video/Image Processing: Perception, Assessment and Compression

被引:189
|
作者
Xu, Mai [1 ]
Li, Chen [1 ]
Zhang, Shanyi [1 ]
Le Callet, Patrick [2 ]
机构
[1] Beihang Univ, Sch Elect & Informat Engn, Beijing 100191, Peoples R China
[2] Univ Nantes, Polytech Nantes, F-44306 Nantes 3, France
关键词
360 degrees video; image; perception; assessment; comp-ression; IMAGE QUALITY ASSESSMENT; STRUCTURAL SIMILARITY; SALIENCY ESTIMATION; VISUAL-ATTENTION; VIDEO; PREDICTION; INDEX;
D O I
10.1109/JSTSP.2020.2966864
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Nowadays, 360 degrees video/image has been increasingly popular and drawn great attention. The spherical viewing range of 360 degrees video/image accounts for huge data, which pose the challenges to 360 degrees video/image processing in solving the bottleneck of storage, transmission, etc. Accordingly, the recent years have witnessed the explosive emergence of works on 360 degrees video/image processing. In this article, we review the state-of-the-art works on 360 degrees video/image processing from the aspects of perception, assessment and compression. First, this article reviews both datasets and visual attention modelling approaches for 360 degrees video/image. Second, we survey the related works on both subjective and objective visual quality assessment (VQA) of 360 degrees video/image. Third, we overview the compression approaches for 360 degrees video/image, which either utilize the spherical characteristics or visual attention models. Finally, we summarize this overview article and outlook the future research trends on 360 degrees video/image processing.
引用
收藏
页码:5 / 26
页数:22
相关论文
共 50 条
  • [1] Lossy hyperspectral image compression with state-of-the-art video encoder
    Santos, Lucana
    Lopez, Sebastian
    Callico, Gustavo M.
    Lopez, Jose F.
    Sarmiento, Roberto
    HIGH-PERFORMANCE COMPUTING IN REMOTE SENSING, 2011, 8183
  • [2] Comparison of the State-of-the-Art Image and Video Quality Assessment Metrics
    Akkaya, Emre
    Ozbek, Nukhet
    29TH IEEE CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS (SIU 2021), 2021,
  • [3] GLORIA IMAGE-PROCESSING - THE STATE-OF-THE-ART
    SEARLE, RC
    LEBAS, TP
    MITCHELL, NC
    SOMERS, ML
    PARSON, LM
    PATRIAT, P
    MARINE GEOPHYSICAL RESEARCHES, 1990, 12 (1-2) : 21 - 39
  • [4] TOBI IMAGE-PROCESSING - THE STATE-OF-THE-ART
    LEBAS, TP
    MASON, DC
    MILLARD, NC
    IEEE JOURNAL OF OCEANIC ENGINEERING, 1995, 20 (01) : 85 - 93
  • [5] Lossless Image Compression Techniques: A State-of-the-Art Survey
    Rahman, Md Atiqur
    Hamada, Mohamed
    SYMMETRY-BASEL, 2019, 11 (10):
  • [6] ELECTROSLAG PROCESSING: STATE-OF-THE-ART ASSESSMENT.
    Anon
    Electric Power Research Institute (Report) EPRI EM, 1987,
  • [7] The Impact of State-of-the-Art Techniques for Lossless Still Image Compression
    Rahman, Md Atiqur
    Hamada, Mohamed
    Shin, Jungpil
    ELECTRONICS, 2021, 10 (03) : 1 - 40
  • [8] Watermarking digital image and video data - A state-of-the-art overview
    Langelaar, GC
    Setyawan, I
    Lagendijk, RL
    IEEE SIGNAL PROCESSING MAGAZINE, 2000, 17 (05) : 20 - 46
  • [9] Can Exposure, Noise and Compression affect Image Recognition? An Assessment of the Impacts on State-of-the-art ConvNets
    Steffens, C. R.
    Messias, L. R., V
    Drews-Jr, P. L. J.
    Botelho, S. S. d C.
    2019 LATIN AMERICAN ROBOTICS SYMPOSIUM, 2019 BRAZILIAN SYMPOSIUM ON ROBOTICS (SBR) AND 2019 WORKSHOP ON ROBOTICS IN EDUCATION (LARS-SBR-WRE 2019), 2019, : 61 - 66
  • [10] IMAGE-PROCESSING - A STATE-OF-THE-ART WAY TO LEARN SCIENCE
    RAPHAEL, J
    GREENBERG, R
    EDUCATIONAL LEADERSHIP, 1995, 53 (02) : 34 - 37