An Attention Mechanism and Ensemble Learning based on Dermoscopic Image Classification

被引:0
|
作者
Huang, Shanchuan [1 ]
Lei, Hongwei [2 ]
Yang, Jinzhu [3 ]
Jiang, Tao [4 ]
Jin, Liuhan [1 ]
Yao, Yudong [5 ]
Grzegorzek, Marcin [6 ,7 ]
Li, Chen [1 ,3 ]
机构
[1] Northeastern Univ, Coll Med & Biol Informat Engn, Microscop Image & Med Image Anal Grp, Shenyang, Peoples R China
[2] Northeastern Univ, Coll Informat Sci & Engn, Shenyang, Peoples R China
[3] Minist Educ, Key Lab Intelligent Comp Med Image, Shenyang, Liaoning, Peoples R China
[4] Chengdu Univ Tradit Chinese Med, Sch Intelligent Med, Chengdu, Peoples R China
[5] Stevens Inst Technol, Dept Elect & Comp Engn, Hoboken, NJ USA
[6] Univ Lubeck, Inst Med Informat, Lubeck, Germany
[7] German Res Ctr Artificial Intelligence, Lubeck, Germany
基金
中国国家自然科学基金;
关键词
Skin cancer; Image classification; Attention mechanism; Ensemble learning; Late fusion; MELANOMA; MUTATIONS; FREQUENCY; DIAGNOSIS; NEVI;
D O I
10.2352/J.ImagingSci.Technol.2024.68.4.040403
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Skin tumors have become one of the most common diseases worldwide. Usually, benign skin tumors are not harmful to human health, but malignant skin tumors are highly likely to develop into skin cancer, which is life-threatening. Dermoscopy is currently the most effective method of diagnosing skin tumors. However, the complexity of skin tumor cells makes doctors' diagnoses subject to error. Therefore, it is essential to use computers for assisted diagnosis, thereby improving the diagnostic accuracy of skin tumors. In this paper, we propose Deep-skin, a model for dermoscopic image classification, which is based on both attention mechanism and ensemble learning. Considering the characteristics of dermoscopic images, we suggest embedding different attention mechanisms on top of Inception-V3 to obtain more potential features. We then improve the classification performance by late fusion of the different models. To demonstrate the effectiveness of Deep-skin, we conduct experiments and evaluations on the publicly available dataset Skin Cancer: Malignant vs. Benign and compare the performance of Deep-skin with other classification models. The experimental results indicate that Deep-skin performs well on the dataset in comparison to other models, achieving a maximum accuracy of 87.8%. In the future, we intend to investigate better classification models for automatic diagnosis of skin tumors. Such models can potentially assist physicians and patients in clinical settings.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] An ensemble model with attention based mechanism for image captioning
    Al Badarneh, Israa
    Hammo, Bassam H.
    Al-Kadi, Omar
    COMPUTERS & ELECTRICAL ENGINEERING, 2025, 123
  • [2] Deep Learning Based Mineral Image Classification Combined With Visual Attention Mechanism
    Liu, Yang
    Zhang, Zelin
    Liu, Xiang
    Wang, Lei
    Xia, Xuhui
    IEEE ACCESS, 2021, 9 : 98091 - 98109
  • [3] EAML: ensemble self-attention-based mutual learning network for document image classification
    Bakkali, Souhail
    Ming, Zuheng
    Coustaty, Mickael
    Rusinol, Marcal
    INTERNATIONAL JOURNAL ON DOCUMENT ANALYSIS AND RECOGNITION, 2021, 24 (03) : 251 - 268
  • [4] EAML: ensemble self-attention-based mutual learning network for document image classification
    Souhail Bakkali
    Zuheng Ming
    Mickaël Coustaty
    Marçal Rusiñol
    International Journal on Document Analysis and Recognition (IJDAR), 2021, 24 : 251 - 268
  • [5] Image Classification of Wheat Rust Based on Ensemble Learning
    Pan, Qian
    Gao, Maofang
    Wu, Pingbo
    Yan, Jingwen
    AbdelRahman, Mohamed A. E.
    SENSORS, 2022, 22 (16)
  • [6] Generative Adversarial Networks Based on Collaborative Learning and Attention Mechanism for Hyperspectral Image Classification
    Feng, Jie
    Feng, Xueliang
    Chen, Jiantong
    Cao, Xianghai
    Zhang, Xiangrong
    Jiao, Licheng
    Yu, Tao
    REMOTE SENSING, 2020, 12 (07)
  • [7] Weakly Supervised Image Classification Based on Attention Mechanism
    Cheng, Xiaohui
    Liu, Pengfei
    Chen, Shouxue
    PROCEEDINGS OF 2020 IEEE 2ND INTERNATIONAL CONFERENCE ON CIVIL AVIATION SAFETY AND INFORMATION TECHNOLOGY (ICCASIT), 2020, : 630 - 634
  • [8] Deep Ensemble Learning for Skin Lesion Classification from Dermoscopic Images
    Shahin, Ahmed H.
    Kamal, Ahmed
    Elattar, Mustafa A.
    2018 9TH CAIRO INTERNATIONAL BIOMEDICAL ENGINEERING CONFERENCE (CIBEC), 2018, : 150 - 153
  • [9] PolSAR image classification based on polarimetric decomposition and ensemble learning
    Xiao Y.
    Wang B.
    Jiang Q.
    Wen Y.
    Nongye Gongcheng Xuebao/Transactions of the Chinese Society of Agricultural Engineering, 2020, 36 (16): : 134 - 141
  • [10] Lung Nodule Image Classification Based on Ensemble Machine Learning
    Mao Keming
    Deng Zhuofu
    JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS, 2016, 6 (07) : 1679 - 1685