State-of-the-Art in 360° Video/Image Processing: Perception, Assessment and Compression

被引:189
|
作者
Xu, Mai [1 ]
Li, Chen [1 ]
Zhang, Shanyi [1 ]
Le Callet, Patrick [2 ]
机构
[1] Beihang Univ, Sch Elect & Informat Engn, Beijing 100191, Peoples R China
[2] Univ Nantes, Polytech Nantes, F-44306 Nantes 3, France
关键词
360 degrees video; image; perception; assessment; comp-ression; IMAGE QUALITY ASSESSMENT; STRUCTURAL SIMILARITY; SALIENCY ESTIMATION; VISUAL-ATTENTION; VIDEO; PREDICTION; INDEX;
D O I
10.1109/JSTSP.2020.2966864
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Nowadays, 360 degrees video/image has been increasingly popular and drawn great attention. The spherical viewing range of 360 degrees video/image accounts for huge data, which pose the challenges to 360 degrees video/image processing in solving the bottleneck of storage, transmission, etc. Accordingly, the recent years have witnessed the explosive emergence of works on 360 degrees video/image processing. In this article, we review the state-of-the-art works on 360 degrees video/image processing from the aspects of perception, assessment and compression. First, this article reviews both datasets and visual attention modelling approaches for 360 degrees video/image. Second, we survey the related works on both subjective and objective visual quality assessment (VQA) of 360 degrees video/image. Third, we overview the compression approaches for 360 degrees video/image, which either utilize the spherical characteristics or visual attention models. Finally, we summarize this overview article and outlook the future research trends on 360 degrees video/image processing.
引用
收藏
页码:5 / 26
页数:22
相关论文
共 50 条
  • [31] State-of-the-art techniques for lossless compression of 3D medical image sets
    Philips, W
    Van Assche, S
    De Rycke, D
    Denecker, K
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2001, 25 (02) : 173 - 185
  • [32] Multimodal video indexing: A review of the state-of-the-art
    Snoek, CGM
    Worring, M
    MULTIMEDIA TOOLS AND APPLICATIONS, 2005, 25 (01) : 5 - 35
  • [33] Multimodal Video Indexing: A Review of the State-of-the-art
    Cees G.M. Snoek
    Marcel Worring
    Multimedia Tools and Applications, 2005, 25 : 5 - 35
  • [34] State-of-the-art Video Coding Approaches: A Survey
    Xu, Mai
    Liang, Yilin
    Wang, Zulin
    PROCEEDINGS OF 2015 IEEE 14TH INTERNATIONAL CONFERENCE ON COGNITIVE INFORMATICS & COGNITIVE COMPUTING (ICCI*CC), 2015, : 284 - 290
  • [35] Video Question Answering: A survey of the state-of-the-art
    Jeshmol, P. J.
    Kovoor, Binsu C.
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 105
  • [36] Manhattan Room Layout Reconstruction from a Single 360° Image: A Comparative Study of State-of-the-Art Methods
    Zou, Chuhang
    Su, Jheng-Wei
    Peng, Chi-Han
    Colburn, Alex
    Shan, Qi
    Wonka, Peter
    Chu, Hung-Kuo
    Hoiem, Derek
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (05) : 1410 - 1431
  • [37] The Evolution of Technologies: An Assessment of the State-of-the-Art
    Dosi G.
    Nelson R.R.
    Eurasian Business Review, 2013, 3 (1) : 3 - 46
  • [38] State-of-the-art pain assessment and management
    Foster, Roxie L.
    JOURNAL FOR SPECIALISTS IN PEDIATRIC NURSING, 2007, 12 (03) : 137 - 138
  • [39] THE EVOLUTION OF TECHNOLOGIES: AN ASSESSMENT OF THE STATE-OF-THE-ART
    Dosi, Giovanni
    Nelson, Richard R.
    EURASIAN BUSINESS REVIEW, 2013, 3 (01) : 3 - 46
  • [40] Processing emotional body expressions: state-of-the-art
    Enea, Violeta
    Iancu, Sorina
    SOCIAL NEUROSCIENCE, 2016, 11 (05) : 495 - 506