Deep Learning Based Mineral Image Classification Combined With Visual Attention Mechanism

被引:30
|
作者
Liu, Yang [1 ]
Zhang, Zelin [1 ,2 ]
Liu, Xiang [2 ]
Wang, Lei [2 ]
Xia, Xuhui [2 ]
机构
[1] Wuhan Univ Sci & Technol, Sch Resource & Environm Engn, Hubei Key Lab Efficient Utilizat & Agglomerat Met, Wuhan 430081, Peoples R China
[2] Wuhan Univ Sci & Technol, Key Lab Met Equipment & Control Technol, Wuhan 430081, Peoples R China
基金
中国国家自然科学基金;
关键词
Image classification; Minerals; Ores; Feature extraction; Visualization; Task analysis; Sorting; Deep learning; visual attention mechanism; mineral image classification; Grad-CAM; MACHINE; ROCK;
D O I
10.1109/ACCESS.2021.3095368
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mineral image classification technology based on machine vision is an efficient system for ore sorting. With the development of artificial intelligence and computer technology, the deep learning-based mineral image classification system is gradually applied to ore sorting. However, there is a bottleneck in improving classification accuracy, and the feature extraction ability of the CNNs model is relatively limited for multi-category mineral image classification tasks. Therefore, four visual attention blocks are designed and embedded in the existing CNNs model, and new mineral image classification models based on the visual attention mechanism and CNNs are proposed. Then, referring to the building strategies of the different depth ResNet, we build various CNNs model embedding with attention blocks for mineral image classification and visualize the models by Grad-CAM to observe the change in classification weight distributions and classification weight values. Finally, by using the confusion matrices, this experiment systematically evaluates the classification performance of the proposed models and analyzes the misjudgment rate.
引用
收藏
页码:98091 / 98109
页数:19
相关论文
共 50 条
  • [1] Risky-Driving-Image Recognition Based on Visual Attention Mechanism and Deep Learning
    Song, Wei
    Zhang, Guangde
    SENSORS, 2022, 22 (15)
  • [2] Efficient image segmentation based on deep learning for mineral image classification
    Liu, Yang
    Zhang, Zelin
    Liu, Xiang
    Wang, Lei
    Xia, Xuhui
    ADVANCED POWDER TECHNOLOGY, 2021, 32 (10) : 3885 - 3903
  • [3] An Attention Mechanism and Ensemble Learning based on Dermoscopic Image Classification
    Huang, Shanchuan
    Lei, Hongwei
    Yang, Jinzhu
    Jiang, Tao
    Jin, Liuhan
    Yao, Yudong
    Grzegorzek, Marcin
    Li, Chen
    JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY, 2024, 68 (04)
  • [4] Digital Image Steganalysis Based on Visual Attention and Deep Reinforcement Learning
    Hu, Donghui
    Zhou, Shengnan
    Shen, Qiang
    Zheng, Shuli
    Zhou, Zhongqiu
    Fan, Yuqi
    IEEE ACCESS, 2019, 7 : 25924 - 25935
  • [5] Medical Image Classification Algorithm Based on Visual Attention Mechanism-MCNN
    An, Fengping
    Li, Xiaowei
    Ma, Xingmin
    OXIDATIVE MEDICINE AND CELLULAR LONGEVITY, 2021, 2021
  • [6] Hyperspectral Image Classification Based on Clustering Dimensionality Reduction and Visual Attention Mechanism
    Zeng Chaoping
    Ju Lijun
    Zhang Jianchen
    LASER & OPTOELECTRONICS PROGRESS, 2019, 56 (21)
  • [7] Deep Reinforcement Learning With Visual Attention for Vehicle Classification
    Zhao, Dongbin
    Chen, Yaran
    Lv, Le
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2017, 9 (04) : 356 - 367
  • [8] An image caption model based on attention mechanism and deep reinforcement learning
    Bai, Tong
    Zhou, Sen
    Pang, Yu
    Luo, Jiasai
    Wang, Huiqian
    Du, Ya
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [9] Hyperspectral image classification based on spatial pyramid attention mechanism combined with ResNet
    Liu, He
    Song, Yingluo
    Hu, Longxiang
    Liu, Guohui
    Wang, Kan
    Wang, Aili
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (06) : 833 - 843
  • [10] Learning Partial Correlation based Deep Visual Representation for Image Classification
    Rahmanl, Saimunur
    Koniuszt, Piotr
    Wang, Lei
    Zhou, Luping
    Moghadam, Peyman
    Sun, Changming
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 6231 - 6240