State-of-the-Art in 360° Video/Image Processing: Perception, Assessment and Compression

被引:189
|
作者
Xu, Mai [1 ]
Li, Chen [1 ]
Zhang, Shanyi [1 ]
Le Callet, Patrick [2 ]
机构
[1] Beihang Univ, Sch Elect & Informat Engn, Beijing 100191, Peoples R China
[2] Univ Nantes, Polytech Nantes, F-44306 Nantes 3, France
关键词
360 degrees video; image; perception; assessment; comp-ression; IMAGE QUALITY ASSESSMENT; STRUCTURAL SIMILARITY; SALIENCY ESTIMATION; VISUAL-ATTENTION; VIDEO; PREDICTION; INDEX;
D O I
10.1109/JSTSP.2020.2966864
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Nowadays, 360 degrees video/image has been increasingly popular and drawn great attention. The spherical viewing range of 360 degrees video/image accounts for huge data, which pose the challenges to 360 degrees video/image processing in solving the bottleneck of storage, transmission, etc. Accordingly, the recent years have witnessed the explosive emergence of works on 360 degrees video/image processing. In this article, we review the state-of-the-art works on 360 degrees video/image processing from the aspects of perception, assessment and compression. First, this article reviews both datasets and visual attention modelling approaches for 360 degrees video/image. Second, we survey the related works on both subjective and objective visual quality assessment (VQA) of 360 degrees video/image. Third, we overview the compression approaches for 360 degrees video/image, which either utilize the spherical characteristics or visual attention models. Finally, we summarize this overview article and outlook the future research trends on 360 degrees video/image processing.
引用
收藏
页码:5 / 26
页数:22
相关论文
共 50 条
  • [41] Asian language processing: current state-of-the-art
    Huang, Chu-Ren
    Tokunaga, Takenobu
    Lee, Sophia Yat Mei
    LANGUAGE RESOURCES AND EVALUATION, 2006, 40 (3-4) : 203 - 218
  • [42] Asian language processing: current state-of-the-art
    Chu-Ren Huang
    Takenobu Tokunaga
    Sophia Yat Mei Lee
    Language Resources and Evaluation, 2006, 40 : 203 - 218
  • [43] Transformers: State-of-the-Art Natural Language Processing
    Wolf, Thomas
    Debut, Lysandre
    Sanh, Victor
    Chaumond, Julien
    Delangue, Clement
    Moi, Anthony
    Cistac, Picnic
    Rault, Tim
    Louf, Remi
    Funtowicz, Morgan
    Davison, Joe
    Shleifer, Sam
    von Platen, Patrick
    Ma, Clara
    Jernite, Yacine
    Plu, Julien
    Xu, Canwen
    Le Scao, Teven
    Gugger, Sylvain
    Drame, Mariama
    Lhoest, Quentin
    Rush, Alexander M.
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING: SYSTEM DEMONSTRATIONS, 2020, : 38 - 45
  • [44] The state of the art in image and video retrieval
    Sebe, N
    Lew, MS
    Zhou, X
    Huang, TS
    Bakker, EM
    IMAGE AND VIDEO RETRIEVAL, PROCEEDINGS, 2003, 2728 : 1 - 8
  • [45] The state of the art in image and video retrieval
    Sebe, Nicu
    Lew, Michael S.
    Zhou, Xiang
    Huang, Thomas S.
    Bakker, Erwin M.
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2003, 2728 : 1 - 8
  • [46] State-of-the-art Processing Solutions of Steelmaking Residuals
    Rieger, Johannes
    Schenk, Johannes
    BHM Berg- und Huttenmannische Monatshefte, 2020, 165 (05): : 227 - 231
  • [47] Quantification of pulmonary functional MRI: state-of-the-art and emerging image processing methods and measurements
    Sharma, Maksym
    Wyszkiewicz, Paulina, V
    Desaigoudar, Vedanth
    Guo, Fumin
    Capaldi, Dante P., I
    Parraga, Grace
    PHYSICS IN MEDICINE AND BIOLOGY, 2022, 67 (22):
  • [48] A STATE-OF-THE-ART REVIEW OF ELECTROPHORESIS IN DOWNSTREAM PROCESSING
    IVORY, CF
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 1988, 195 : 4 - MBTD
  • [49] A HOPFIELD RECURRENT NEURAL NETWORK TRAINED ON NATURAL IMAGES PERFORMS STATE-OF-THE-ART IMAGE COMPRESSION
    Hillar, Christopher
    Mehta, Ram
    Koepsell, Kilian
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 4092 - 4096
  • [50] Image understanding and the web: a state-of-the-art review
    Fauzi, Fariza
    Belkhatir, Mohammed
    JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2014, 43 (02) : 271 - 306