Graphic image classification method based on an attention mechanism and fusion of multilevel and multiscale deep features

被引:7
|
作者
Liu, Shan [1 ]
Zhang, Qi [2 ]
Huang, Lingling [3 ]
机构
[1] Xijing Univ, Xian 710123, Shaanxi, Peoples R China
[2] Xian Univ Posts & Telecommun, Dept Sch Elect Engn, Xian 710061, Shaanxi, Peoples R China
[3] Xian Acad Fine Arts, Dept Publ Art Dept, Xian 710065, Shaanxi, Peoples R China
关键词
Image; Privacy information; Attention mechanism; Private image classification;
D O I
10.1016/j.comcom.2023.07.001
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The paper explores the issue of privacy breaches caused by sharing and publishing images on social media platforms, which is becoming increasingly serious. While existing deep learning-based methods have achieved remarkable results in private image classification, they only consider single-level and single-scale features and neglect the problem of multilevel and multiscale features. To address this limitation, the paper proposes a novel graphic image classification method that fuses multilevel and multiscale deep features. The proposed method employs a multibranch convolutional neural network to extract multilevel features, which are then processed by a multilevel pooling layer to obtain multiscale features. Additionally, two feature fusion methods based on attention mechanism, Privacy-MSML (Privacy Multi-Scale Multi-Level) and Privacy-MLMS (Privacy Multi Level Multi-Scale), are designed to fuse the multilevel and multiscale features for image classification. Both methods utilize Bi-LSTM and a self-attention mechanism to capture feature dependencies. The experimental results on public datasets demonstrate that the proposed methods effectively fuse multilevel and multiscale features, leading to a significant improvement in classification performance, which highlights the innovative contribution of the paper in addressing the issue of multilevel and multiscale features in private image classification.
引用
收藏
页码:230 / 238
页数:9
相关论文
共 50 条
  • [41] Text-to-image generation method based on self-supervised attention and image features fusion
    Liao, Yonghui
    Zhang, Haitao
    Jin, Haibo
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (02) : 180 - 191
  • [42] Remote Sensing Data Detection Based on Multiscale Fusion and Attention Mechanism
    Huang, Min
    Cheng, Cong
    De Luca, Gennaro
    MOBILE INFORMATION SYSTEMS, 2021, 2021
  • [43] FADN: Features Attention with Deep Networks for Remote-Image Classification
    Zhang, Yuhang
    Ren, Hongshuai
    Yang, Wensi
    Lv, Jingya
    Xu, Cheng-Zhong
    Ye, Kejiang
    2019 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE BIG DATA AND INTELLIGENT SYSTEMS (HPBD&IS), 2019, : 79 - 84
  • [44] Remote sensing data detection based on multiscale fusion and attention mechanism
    Huang, Min
    Cheng, Cong
    De Luca, Gennaro
    Mobile Information Systems, 2021, 2021
  • [45] Multilevel Attention and Multiscale Feature Fusion Network for Author Classification of Chinese Ink-Wash Paintings
    Jiang, Wei
    Meng, Xianglian
    Xi, Ji
    DISCRETE DYNAMICS IN NATURE AND SOCIETY, 2022, 2022
  • [46] Deep Attention-Based Imbalanced Image Classification
    Wang, Lituan
    Zhang, Lei
    Qi, Xiaofeng
    Yi, Zhang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (08) : 3320 - 3330
  • [47] Deep Learning Integrated with Multiscale Pixel and Object Features for Hyperspectral Image Classification
    Zhang, Meng
    Hong, Liang
    2018 10TH IAPR WORKSHOP ON PATTERN RECOGNITION IN REMOTE SENSING (PRRS), 2018,
  • [48] Hyperspectral Image Classification Based on Multiscale Hybrid Networks and Attention Mechanisms
    Pan, Haizhu
    Zhao, Xiaoyu
    Ge, Haimiao
    Liu, Moqi
    Shi, Cuiping
    REMOTE SENSING, 2023, 15 (11)
  • [49] Attention-Based Multiscale Sequential Network for PolSAR Image Classification
    Hua, Wenqiang
    Wang, Xinlei
    Zhang, Cong
    Jin, Xiaomin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [50] Chinese News Classification Based on ERNIE and Attention Fusion Features
    Zhu, Siju
    He, Chengwan
    2023 THE 6TH INTERNATIONAL CONFERENCE ON ROBOT SYSTEMS AND APPLICATIONS, ICRSA 2023, 2023, : 134 - 138