A self-supervised anomalous machine sound detection model based on spectrogram decomposition and parallel sub-network

被引:0
|
作者
Zhang, Tao [1 ]
Kong, Lingguo [1 ]
Zhao, Xin [1 ]
Li, Donglei [1 ]
Geng, Yanzhang [1 ]
Ding, Biyun [2 ]
Wang, Chao [1 ]
机构
[1] Tianjin Univ, Sch Elect Informat Engn, 92 Weijin Rd, Tianjin 300072, Peoples R China
[2] Nanchang Hangkong Univ, Sch Informat Engn, 696 Fenghe South Ave, Nanchang 330063, Jiangxi, Peoples R China
关键词
Anomalous sound detection; Audio signal processing; Self-supervised learning; Acoustic feature extraction; Domain shift;
D O I
10.1007/s10489-025-06366-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anomalous Sound Detection (ASD) has research significance and application prospect industrial automation. Most existing models of ASD have limited ability to effectively utilize machine sound features, leading to reduced stability against sound anomalies and domain shift variations. To address the above issues, we propose a self-supervised ASD model based on spectrogram decomposition and parallel sub-network in this paper. Firstly, we decompose the spectrogram along the time and frequency dimensions to balance feature size and information integrity. This approach emphasizes the temporal and frequency variations in the feature map, facilitating a better understanding of the factors that affect machine sounds under domain shift conditions. Secondly, we design a pair of parallel training sub-networks. The parallel sub-networks employ self-attention mechanisms and shared gradients to effectively capture changes in features across both time and frequency dimensions. This approach improves model stability against anomalies and domain shifts. Finally, the anomaly scores of sub-network branches are fused as anomalous detection results. The performance of the proposed model is validated on DCASE2022 Task2 dataset. The Area under the Receiver Operating Characteristic Curve (AUC) and partial AUC (pAUC) of our model reached 72.89% and 64.83%. The results confirm the effectiveness of the proposed model, achieving better performance.
引用
收藏
页数:18
相关论文
共 46 条
  • [31] Self-Supervised Multi-Granularity Graph Attention Network for Vision-Based Driver Fatigue Detection
    Huang, Yiming
    Liu, Chunsheng
    Chang, Faliang
    Lu, Yansha
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (04): : 3067 - 3080
  • [32] SEL-Net: A Self-Supervised Learning-Based Network for PolSAR Image Runway Region Detection
    Han, Ping
    Peng, Yanwen
    Cheng, Zheng
    Liao, Dayu
    Han, Binbin
    REMOTE SENSING, 2023, 15 (19)
  • [33] Towards Advanced Wildfire Analysis: A Siamese Network-Based Change Detection Approach through Self-Supervised Learning
    Valsamis, Dimitris
    Oikonomidis, Alexandros
    Chatzichristaki, Chrysoula
    Moumtzidou, Anastasia
    Gialampoukidis, Ilias
    Vrochidis, Stefanos
    Kompatsiaris, Ioannis
    2024 INTERNATIONAL CONFERENCE ON CONTENT-BASED MULTIMEDIA INDEXING, CBMI, 2024, : 242 - 248
  • [34] Noise-based self-supervised anomaly detection in washing machines using a deep neural network with operational information
    Shul, Yusun
    Yi, Wonjun
    Choi, Jihoon
    Kang, Dong-Soo
    Choi, Jung-Woo
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2023, 189
  • [35] Self-Supervised Heterogeneous Graph Neural Network Model Based on Collaborative Contrastive Learning of Topology Information and Attribute Information
    Li, Chao
    Sun, Guoyi
    Yan, Yeyu
    Duan, Hua
    Zeng, Qingtian
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2023, 36 (04): : 287 - 299
  • [36] Self-supervised motor imagery EEG recognition model based on 1-D MTCNN-LSTM network
    Hu, Cunlin
    Ye, Ye
    Xie, Nenggang
    JOURNAL OF NEURAL ENGINEERING, 2024, 21 (03)
  • [37] SLIP: Self-Supervised Learning Based Model Inversion and Poisoning Detection-Based Zero-Trust Systems for Vehicular Networks
    Khowaja, Sunder Ali
    Nkenyereye, Lewis
    Khowaja, Parus
    Dev, Kapal
    Niyato, Dusit
    IEEE WIRELESS COMMUNICATIONS, 2024, 31 (02) : 50 - 57
  • [38] Towards a generalized machine learning model for Raman spectroscopy-based liquid biopsy in cancer screening using self-supervised learning
    Gu, Yifei
    Chiu, Kwan Lun
    Munoz-Jaramillo, Andres
    Birkeland, Andrew C.
    Navas-Moreno, Maria
    Carney, Randy
    CLINICAL CANCER RESEARCH, 2024, 30 (21)
  • [39] Electric Motor Bearing Fault Noise Detection via Mel-Spectrum-Based Contrastive Self-Supervised Transformer Model
    Zhang, Xiaotian
    Liu, Yunshu
    Gong, Chao
    Nie, Yu
    Rodriguez, Jose
    IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2024, 60 (06) : 8755 - 8765
  • [40] Fast Real-Time Brain Tumor Detection Based on Stimulated Raman Histology and Self-Supervised Deep Learning Model
    Wang, Zijun
    Han, Kaitai
    Liu, Wu
    Wang, Zhenghui
    Shi, Chaojing
    Liu, Xi
    Huang, Mengyuan
    Sun, Guocheng
    Liu, Shitou
    Guo, Qianjin
    JOURNAL OF IMAGING INFORMATICS IN MEDICINE, 2024, 37 (03): : 1160 - 1176