based on a multi-depth output network

被引:3
|
作者
Sang, Qingbing [1 ,2 ]
Su, Chenfei [1 ,2 ]
Zhu, Lingying [1 ,2 ]
Liu, Lixiong [3 ]
Wu, Xiaojun [1 ,2 ]
Bovik, Alan C. [4 ]
机构
[1] Jiangnan Univ, Sch Artificial Intelligence & Comp Sci, Wuxi, Jiangsu, Peoples R China
[2] Jiangsu Prov Engn Lab Pattern Recognit & Computat, Wuxi, Jiangsu, Peoples R China
[3] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing, Peoples R China
[4] Univ Texas Austin, Lab Image & Video Engn, Austin, TX 78712 USA
基金
中国国家自然科学基金;
关键词
no-reference; image quality assessment; multi-depth output convolutional neural network; ensemble learning; IMAGE QUALITY ASSESSMENT; NATURAL SCENE STATISTICS;
D O I
10.1117/1.JEI.30.4.043007
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
When deep convolutional neural networks perform feature extraction, the features computed at each layer express different abstractions of visual information. The earlier layers extract highly compact low-level features such as bandpass and directional primitives, whereas deeper layers extract structural features of increasing abstraction, similar to contours, shapes, and edges, becoming less effable as the depth increases. We propose a different kind of end-to-end no-reference (NR) image quality assessment (IQA) model, which is defined as a multi-depth output convolutional neural network (MoNET). It accomplishes this by mapping both shallow and deep features to perceived quality. MoNET delivers three outputs that express shallow (lower-level) and deep (high-level) features, and maps them to subjective quality scores. The multiple outputs are combined into a single, final quality score. MoNET does this by combining the responses of three learning machines, so it may be viewed as a form of ensemble learning. The experimental results on three public image quality databases show that our proposed model achieves better performance than other state-of-the-art NR IQA algorithms. (c) 2021 SPIE and IS&T [DOI: 10.1117/1.JEI.30.4.043007]
引用
收藏
页数:17
相关论文
共 50 条
  • [1] MULTI-DEPTH DILATED NETWORK FOR FASHION LANDMARK DETECTION
    Kai, Zeng
    Feng, Jun
    Sutcliffe, Richard
    Wang Xiaoyu
    Bu Qirong
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2019, : 60 - 65
  • [2] A multi-depth convolutional neural network for SAR image classification
    Xia, Jingfan
    Yang, Xuezhi
    Jia, Lu
    REMOTE SENSING LETTERS, 2018, 9 (12) : 1138 - 1147
  • [3] Multi-depth branch network for efficient image super-resolution
    Tian, Huiyuan
    Zhang, Li
    Li, Shijian
    Yao, Min
    Pan, Gang
    IMAGE AND VISION COMPUTING, 2024, 144
  • [4] Depth of field extended integral imaging based on multi-depth fitting fusion
    Yang, Le
    Liu, Li
    OPTICS COMMUNICATIONS, 2024, 555
  • [5] Depth estimation of multi-depth objects based on computational ghost imaging system
    Zhang, Wenwen
    Yu, Daquan
    Han, Yongcheng
    He, Weiji
    Chen, Qian
    He, Ruiqing
    OPTICS AND LASERS IN ENGINEERING, 2022, 148
  • [6] Depth of field extended integral imaging based on multi-depth fitting fusion
    Yang, Le
    Liu, Li
    Optics Communications, 555
  • [7] MULTI-DEPTH SOIL GAS SURVEYING
    ZDEB, TF
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 1986, 192 : 100 - ENVR
  • [8] Multi-Depth Fusion Network for Whole-Heart CT Image Segmentation
    Ye, Chengqin
    Wang, Wei
    Zhang, Shanzhuo
    Wang, Kuanquan
    IEEE ACCESS, 2019, 7 : 23421 - 23429
  • [9] Deep neural network for multi-depth hologram generation and its training strategy
    Lee, Juhyun
    Jeong, Jinsoo
    Cho, Jaebum
    Yoo, Dongheon
    Lee, Byounghyo
    Lee, Byoungho
    OPTICS EXPRESS, 2020, 28 (18) : 27137 - 27154
  • [10] Honeycomb acoustic liner based on embedded apertures and multi-depth cavities
    Qiu, Sheng
    Ding, Hua
    Lu, Tongwei
    Liu, Shanshan
    Qian, Pei
    Wang, Nengyin
    Li, Yong
    CHINESE SCIENCE BULLETIN-CHINESE, 2023, 68 (26): : 3482 - 3490