based on a multi-depth output network

被引:3
|
作者
Sang, Qingbing [1 ,2 ]
Su, Chenfei [1 ,2 ]
Zhu, Lingying [1 ,2 ]
Liu, Lixiong [3 ]
Wu, Xiaojun [1 ,2 ]
Bovik, Alan C. [4 ]
机构
[1] Jiangnan Univ, Sch Artificial Intelligence & Comp Sci, Wuxi, Jiangsu, Peoples R China
[2] Jiangsu Prov Engn Lab Pattern Recognit & Computat, Wuxi, Jiangsu, Peoples R China
[3] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing, Peoples R China
[4] Univ Texas Austin, Lab Image & Video Engn, Austin, TX 78712 USA
基金
中国国家自然科学基金;
关键词
no-reference; image quality assessment; multi-depth output convolutional neural network; ensemble learning; IMAGE QUALITY ASSESSMENT; NATURAL SCENE STATISTICS;
D O I
10.1117/1.JEI.30.4.043007
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
When deep convolutional neural networks perform feature extraction, the features computed at each layer express different abstractions of visual information. The earlier layers extract highly compact low-level features such as bandpass and directional primitives, whereas deeper layers extract structural features of increasing abstraction, similar to contours, shapes, and edges, becoming less effable as the depth increases. We propose a different kind of end-to-end no-reference (NR) image quality assessment (IQA) model, which is defined as a multi-depth output convolutional neural network (MoNET). It accomplishes this by mapping both shallow and deep features to perceived quality. MoNET delivers three outputs that express shallow (lower-level) and deep (high-level) features, and maps them to subjective quality scores. The multiple outputs are combined into a single, final quality score. MoNET does this by combining the responses of three learning machines, so it may be viewed as a form of ensemble learning. The experimental results on three public image quality databases show that our proposed model achieves better performance than other state-of-the-art NR IQA algorithms. (c) 2021 SPIE and IS&T [DOI: 10.1117/1.JEI.30.4.043007]
引用
收藏
页数:17
相关论文
共 50 条
  • [31] Modeling of multi-depth slanted airgun source for deghosting
    Hong-Lei Shen
    Thomas Elboth
    Gang Tian
    Zhi Lin
    Applied Geophysics, 2014, 11 : 405 - 417
  • [32] Looking in Depth: Targeting by Eye and Controller Input for Multi-Depth Target Placement
    Fernandes, Ajoy S.
    Murdison, T. Scott
    Proulx, Michael J.
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2024,
  • [33] FAST ALGORITHM BASED ON SOLE-AND MULTI-DEPTH MEASUREMENTS FOR HEVC INTRA CODING
    He, Gang
    Hu, Jing
    Li, Yunsong
    Yu, Wenxin
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 1131 - 1135
  • [34] Enhancing Soil Measurements with a Multi-Depth Sensor for IoT-based Smart Irrigation
    Torre-Neto, Andre
    Cotrim, Jeferson Rodrigues
    Kleinschmidt, Joao Henrique
    Kamienski, Carlos
    Visoli, Marcos Cezar
    PROCEEDINGS OF 2020 IEEE INTERNATIONAL WORKSHOP ON METROLOGY FOR AGRICULTURE AND FORESTRY (METROAGRIFOR), 2020, : 78 - 82
  • [35] Novel multi-depth microfluidic chip for single cell analysis
    Sun, Yue
    Yin, Xue-Feng
    JOURNAL OF CHROMATOGRAPHY A, 2006, 1117 (02) : 228 - 233
  • [36] Multi-depth Graph Convolutional Networks for Fake News Detection
    Hu, Guoyong
    Ding, Ye
    Qi, Shuhan
    Wang, Xuan
    Liao, Qing
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING (NLPCC 2019), PT I, 2019, 11838 : 698 - 710
  • [37] Terahertz dispersion using multi-depth phase modulation grating
    Yang, Qiu-jie
    Huang, Jing-guo
    Xiao, Zhen-yang
    Huang, Zhi-ming
    Shu, Rong
    He, Zhi-ping
    OPTICS EXPRESS, 2019, 27 (09) : 12732 - 12747
  • [38] Laser display system for multi-depth screen projection scenarios
    La Torre, J. Pablo
    Mayes, Nathan
    Riza, Nabeel A.
    APPLIED OPTICS, 2017, 56 (32) : 9023 - 9029
  • [39] A new approach to multiaxial fatigue life prediction: A multi-dimensional multi-scale composite neural network with multi-depth
    Pan, Rui
    Gao, Jianxiong
    Meng, Lingchao
    Heng, Fei
    Yang, Haojin
    ENGINEERING FRACTURE MECHANICS, 2024, 310
  • [40] Chromatic confocal microscopy for multi-depth imaging of epithelial tissue
    Olsovsky, Cory
    Shelton, Ryan
    Carrasco-Zevallos, Oscar
    Applegate, Brian E.
    Maitland, Kristen C.
    BIOMEDICAL OPTICS EXPRESS, 2013, 4 (05): : 732 - 740