Graphic image classification method based on an attention mechanism and fusion of multilevel and multiscale deep features

被引:7
|
作者
Liu, Shan [1 ]
Zhang, Qi [2 ]
Huang, Lingling [3 ]
机构
[1] Xijing Univ, Xian 710123, Shaanxi, Peoples R China
[2] Xian Univ Posts & Telecommun, Dept Sch Elect Engn, Xian 710061, Shaanxi, Peoples R China
[3] Xian Acad Fine Arts, Dept Publ Art Dept, Xian 710065, Shaanxi, Peoples R China
关键词
Image; Privacy information; Attention mechanism; Private image classification;
D O I
10.1016/j.comcom.2023.07.001
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The paper explores the issue of privacy breaches caused by sharing and publishing images on social media platforms, which is becoming increasingly serious. While existing deep learning-based methods have achieved remarkable results in private image classification, they only consider single-level and single-scale features and neglect the problem of multilevel and multiscale features. To address this limitation, the paper proposes a novel graphic image classification method that fuses multilevel and multiscale deep features. The proposed method employs a multibranch convolutional neural network to extract multilevel features, which are then processed by a multilevel pooling layer to obtain multiscale features. Additionally, two feature fusion methods based on attention mechanism, Privacy-MSML (Privacy Multi-Scale Multi-Level) and Privacy-MLMS (Privacy Multi Level Multi-Scale), are designed to fuse the multilevel and multiscale features for image classification. Both methods utilize Bi-LSTM and a self-attention mechanism to capture feature dependencies. The experimental results on public datasets demonstrate that the proposed methods effectively fuse multilevel and multiscale features, leading to a significant improvement in classification performance, which highlights the innovative contribution of the paper in addressing the issue of multilevel and multiscale features in private image classification.
引用
收藏
页码:230 / 238
页数:9
相关论文
共 50 条
  • [1] A dual attention driven multiscale-multilevel feature fusion approach for hyperspectral image classification
    Farooque, Ghulam
    Xiao, Liang
    Sargano, Allah Bux
    Abid, Fazeel
    Hadi, Fazal
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (04) : 1151 - 1178
  • [2] A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network
    Li, Mingtian
    Lu, Yu
    Cao, Shixian
    Wang, Xinyu
    Xie, Shanjuan
    SENSORS, 2023, 23 (06)
  • [3] Zero-Shot Image Classification Method Based on Attention Mechanism and Semantic Information Fusion
    Wang, Yaru
    Feng, Lilong
    Song, Xiaoke
    Xu, Dawei
    Zhai, Yongjie
    SENSORS, 2023, 23 (04)
  • [4] Apple Variety Classification Method Based on Fusion Attention Mechanism
    Geng L.
    Huang Y.
    Guo Y.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2022, 53 (06): : 304 - 310and369
  • [5] Image Dehazing Based on Deep Multiscale Fusion Network and Continuous Memory Mechanism
    Li, Qiang
    Xie, Zhihua
    Zong, Sha
    Liu, Guodong
    INTELLIGENT COMPUTING METHODOLOGIES, PT III, 2022, 13395 : 409 - 422
  • [6] A Multiscale Spatiotemporal Fusion Network Based on an Attention Mechanism
    Huang, Zhiqiang
    Li, Yujia
    Bai, Menghao
    Wei, Qing
    Gu, Qian
    Mou, Zhijun
    Zhang, Liping
    Lei, Dajiang
    REMOTE SENSING, 2023, 15 (01)
  • [7] A Feature Fusion Network for PolSAR Image Classification Based on Physical Features and Deep Features
    Hua, Wenqiang
    Hou, Qianjin
    Jin, Xiaomin
    Liu, Lin
    Sun, Nan
    Meng, Zhe
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [8] Hyperspectral Image Classification with a Multiscale Fusion-Evolution Graph Convolutional Network Based on a Feature-Spatial Attention Mechanism
    Jing, Haoyu
    Wang, Yuanyuan
    Du, Zhenhong
    Zhang, Feng
    REMOTE SENSING, 2022, 14 (11)
  • [9] Multiscale Attention Feature Fusion Based on Improved Transformer for Hyperspectral Image and LiDAR Data Classification
    Wang, Aili
    Lei, Guilong
    Dai, Shiyu
    Wu, Haibin
    Iwahori, Yuji
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 4124 - 4140
  • [10] Multiscale feature learning and attention mechanism for infrared and visible image fusion
    Li Gao
    DeLin Luo
    Song Wang
    Science China Technological Sciences, 2024, 67 : 408 - 422