State-of-the-Art in 360° Video/Image Processing: Perception, Assessment and Compression

被引:189
|
作者
Xu, Mai [1 ]
Li, Chen [1 ]
Zhang, Shanyi [1 ]
Le Callet, Patrick [2 ]
机构
[1] Beihang Univ, Sch Elect & Informat Engn, Beijing 100191, Peoples R China
[2] Univ Nantes, Polytech Nantes, F-44306 Nantes 3, France
关键词
360 degrees video; image; perception; assessment; comp-ression; IMAGE QUALITY ASSESSMENT; STRUCTURAL SIMILARITY; SALIENCY ESTIMATION; VISUAL-ATTENTION; VIDEO; PREDICTION; INDEX;
D O I
10.1109/JSTSP.2020.2966864
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Nowadays, 360 degrees video/image has been increasingly popular and drawn great attention. The spherical viewing range of 360 degrees video/image accounts for huge data, which pose the challenges to 360 degrees video/image processing in solving the bottleneck of storage, transmission, etc. Accordingly, the recent years have witnessed the explosive emergence of works on 360 degrees video/image processing. In this article, we review the state-of-the-art works on 360 degrees video/image processing from the aspects of perception, assessment and compression. First, this article reviews both datasets and visual attention modelling approaches for 360 degrees video/image. Second, we survey the related works on both subjective and objective visual quality assessment (VQA) of 360 degrees video/image. Third, we overview the compression approaches for 360 degrees video/image, which either utilize the spherical characteristics or visual attention models. Finally, we summarize this overview article and outlook the future research trends on 360 degrees video/image processing.
引用
收藏
页码:5 / 26
页数:22
相关论文
共 50 条
  • [21] State-of-the-art of friction stir processing
    Savolainen, Kati
    Mononen, Jukka
    Hanninen, Hannu
    STEEL RESEARCH INTERNATIONAL, 2006, 77 (05) : 370 - 376
  • [22] Introduction to the Issue on Perception-Driven 360° Video Processing
    Xu, Mai
    Borji, Ali
    Zhu, Ce
    Delp, Edward
    Mrak, Marta
    Le Callet, Patrick
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2020, 14 (01) : 2 - 4
  • [23] State-of-the-art cryogenic machining and processing
    Shokrani, A.
    Dhokia, V.
    Munoz-Escalona, P.
    Newman, S. T.
    INTERNATIONAL JOURNAL OF COMPUTER INTEGRATED MANUFACTURING, 2013, 26 (07) : 616 - 648
  • [24] NETWORKS FOR IMAGE COMMUNICATION - STATE-OF-THE-ART
    MEYEREBRECHT, D
    RADIOLOGE, 1994, 34 (06): : 309 - 316
  • [25] State-of-the-Art Image Sensors and Signal Processing in NASA's Space Telescopes
    Loose, Markus
    IEEE SIGNAL PROCESSING MAGAZINE, 2010, 27 (01) : 128 - 126
  • [26] CMOS image sensors: State-of-the-art
    Themissen, Albert J. P.
    SOLID-STATE ELECTRONICS, 2008, 52 (09) : 1401 - 1406
  • [27] IMAGE SEGMENTATION (STATE-OF-THE-ART SURVEY)
    BORISENKO, VI
    ZLATOPOLSKII, AA
    MUCHNIK, IB
    AUTOMATION AND REMOTE CONTROL, 1987, 48 (07) : 837 - 879
  • [28] ENDOSCOPIC IMAGE MANIPULATION - STATE-OF-THE-ART
    FUJINO, MA
    KAWAI, T
    MOROZUMI, A
    YAMAMOTO, Y
    IKEDA, M
    SUZUKI, H
    ENDOSCOPY, 1992, 24 : 516 - 521
  • [29] State-of-the-Art in Perception Technologies for Collaborative Robots
    Ding, Xiaoxuan
    Guo, Janli
    Ren, Zijie
    Deng, Pan
    IEEE SENSORS JOURNAL, 2022, 22 (18) : 17635 - 17645
  • [30] State-of-the-art image and video quality assessment with a metric based on an intrinsically non-linear neural summation model
    Luna, Raul
    Zabaleta, Itziar
    Bertalmio, Marcelo
    FRONTIERS IN NEUROSCIENCE, 2023, 17