Deep multi-label learning for image distortion identification

被引:13
|
作者
Liang, Dong [1 ]
Gao, Xinbo [1 ]
Lu, Wen [1 ]
He, Lihuo [1 ]
机构
[1] Xidian Univ, Sch Elect Engn, Video & Image Proc Syst Lab, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Image distortion identification; Multi-label learning; Convolutional neural network; Multi-task learning; Deep learning; QUALITY ASSESSMENT; CLASSIFICATION;
D O I
10.1016/j.sigpro.2020.107536
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Image Distortion Identification is important for image processing system enhancement, image distortion correction and image quality assessment. Although images may suffer various number of distortions while going through different systems, most of the previous researches of image distortion identification were focus on identifying single distortion in image. In this paper, we proposed a CNN-based multi-label learning model (called MLLNet) to identify distortions for different scenarios, including images having no distortion, single distortion and multiple distortions. Concretely, we transform the multi-label classification for image distortion identification to a number of multi-class classifications and use a deep multi-task CNN model to train all associated classifiers simultaneously. For unseen image, we use the trained CNN model to predict a number of classifications at same time and fuse them to final multi-label classification. The extensive experiments demonstrate that the propose algorithm can achieve good performance on several databases. Moreover, the network architecture of the CNN model can make flexible adjustment according to the different requirements. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Deep Multi-Instance Multi-Label Learning for Image Annotation
    Guo, Hai-Feng
    Han, Lixin
    Su, Shoubao
    Sun, Zhou-Bao
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2018, 32 (03)
  • [2] Deep Semantic Dictionary Learning for Multi-label Image Classification
    Zhou, Fengtao
    Huang, Sheng
    Xing, Yun
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 3572 - 3580
  • [3] Multi-label Garbage Image Classification Based on Deep Learning
    Yan, Kang
    Si, Wenyu
    Hang, Jin
    Zhou, Hong
    Zhu, Quanyin
    2020 19TH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS FOR BUSINESS ENGINEERING AND SCIENCE (DCABES 2020), 2020, : 150 - 153
  • [4] Multi-Label Learning with Deep Forest
    Yang, Liang
    Wu, Xi-Zhu
    Jiang, Yuan
    Zhou, Zhi-Hua
    ECAI 2020: 24TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, 325 : 1634 - 1641
  • [5] Deep Metric Learning for Multi-Label and Multi-Object Image Retrieval
    Mojoo, Jonathan
    Kurita, Takio
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2021, E104D (06) : 873 - 880
  • [6] Deep Extreme Multi-label Learning
    Zhang, Wenjie
    Yan, Junchi
    Wang, Xiangfeng
    Zha, Hongyuan
    ICMR '18: PROCEEDINGS OF THE 2018 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, 2018, : 100 - 107
  • [7] A multi-label Hyperspectral image classification method with deep learning features
    Wang, Cong
    Zhang, Peng
    Zhang, Yanning
    Zhang, Lei
    Wei, Wei
    8TH INTERNATIONAL CONFERENCE ON INTERNET MULTIMEDIA COMPUTING AND SERVICE (ICIMCS2016), 2016, : 127 - 131
  • [8] Reconstruction Regularized Deep Metric Learning for Multi-Label Image Classification
    Li, Changsheng
    Liu, Chong
    Duan, Lixin
    Gao, Peng
    Zheng, Kai
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (07) : 2294 - 2303
  • [9] Multi-Label Human Activity Recognition on Image Using Deep Learning
    Nikolaev, Pavel
    PROCEEDINGS OF THE 7TH SCIENTIFIC CONFERENCE ON INFORMATION TECHNOLOGIES FOR INTELLIGENT DECISION MAKING SUPPORT (ITIDS 2019), 2019, 166 : 141 - 145
  • [10] MULTI-LABEL DEEP ACTIVE LEARNING WITH LABEL CORRELATION
    Ranganathan, Hiranmayi
    Venkateswara, Hemanth
    Chakraborty, Shayok
    Panchanathan, Sethuraman
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 3418 - 3422