Deep multi-label learning for image distortion identification

被引:13
|
作者
Liang, Dong [1 ]
Gao, Xinbo [1 ]
Lu, Wen [1 ]
He, Lihuo [1 ]
机构
[1] Xidian Univ, Sch Elect Engn, Video & Image Proc Syst Lab, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Image distortion identification; Multi-label learning; Convolutional neural network; Multi-task learning; Deep learning; QUALITY ASSESSMENT; CLASSIFICATION;
D O I
10.1016/j.sigpro.2020.107536
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Image Distortion Identification is important for image processing system enhancement, image distortion correction and image quality assessment. Although images may suffer various number of distortions while going through different systems, most of the previous researches of image distortion identification were focus on identifying single distortion in image. In this paper, we proposed a CNN-based multi-label learning model (called MLLNet) to identify distortions for different scenarios, including images having no distortion, single distortion and multiple distortions. Concretely, we transform the multi-label classification for image distortion identification to a number of multi-class classifications and use a deep multi-task CNN model to train all associated classifiers simultaneously. For unseen image, we use the trained CNN model to predict a number of classifications at same time and fuse them to final multi-label classification. The extensive experiments demonstrate that the propose algorithm can achieve good performance on several databases. Moreover, the network architecture of the CNN model can make flexible adjustment according to the different requirements. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Deep Co-Image-Label Hashing for Multi-Label Image Retrieval
    Shen, Xiaobo
    Dong, Guohua
    Zheng, Yuhui
    Lan, Long
    Tsang, Ivor
    Sun, Quan-Sen
    IEEE Transactions on Multimedia, 2022, 24 : 1116 - 1126
  • [22] Deep Co-Image-Label Hashing for Multi-Label Image Retrieval
    Shen, Xiaobo
    Dong, Guohua
    Zheng, Yuhui
    Lan, Long
    Tsang, Ivor
    Sun, Quan-Sen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 1116 - 1126
  • [23] Multi-Label Active Learning with Label Correlation for Image Classification
    Ye, Chen
    Wu, Jian
    Sheng, Victor S.
    Zhao, Pengpeng
    Cui, Zhiming
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 3437 - 3441
  • [24] Multi-label Iterated Learning for Image Classification with Label Ambiguity
    Rajeswar, Sai
    Rodriguez, Pau
    Singhal, Soumye
    Vazquez, David
    Courville, Aaron
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 4773 - 4783
  • [25] Image multi-label learning algorithm based on label correlation
    Huang, Mengyue
    Zhao, Ping
    2021 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS AND COMPUTER ENGINEERING (ICCECE), 2021, : 606 - 609
  • [26] Deep hashing for multi-label image retrieval: a survey
    Josiane Rodrigues
    Marco Cristo
    Juan G. Colonna
    Artificial Intelligence Review, 2020, 53 : 5261 - 5307
  • [27] Deep hashing for multi-label image retrieval: a survey
    Rodrigues, Josiane
    Cristo, Marco
    Colonna, Juan G.
    ARTIFICIAL INTELLIGENCE REVIEW, 2020, 53 (07) : 5261 - 5307
  • [28] Mineral Identification Based on Multi-Label Image Classification
    Wu, Baokun
    Ji, Xiaohui
    He, Mingyue
    Yang, Mei
    Zhang, Zhaochong
    Chen, Yan
    Wang, Yuzhu
    Zheng, Xinqi
    MINERALS, 2022, 12 (11)
  • [29] Multi-view multi-label learning for image annotation
    Zou, Fuhao
    Liu, Yu
    Wang, Hua
    Song, Jingkuan
    Shao, Jie
    Zhou, Ke
    Zheng, Sheng
    MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (20) : 12627 - 12644
  • [30] Multi-view multi-label learning for image annotation
    Fuhao Zou
    Yu Liu
    Hua Wang
    Jingkuan Song
    Jie Shao
    Ke Zhou
    Sheng Zheng
    Multimedia Tools and Applications, 2016, 75 : 12627 - 12644