Speech Enhancement Performance Based on the MANNER Network Using Feature Fusion

被引:0
|
作者
Wang, Shijie [1 ]
Li, Ji [2 ]
Shao, Lei [2 ]
Liu, Hongli [2 ]
Zhu, Lihua [2 ]
Zhu, Xiaochen [1 ]
机构
[1] Tianjin Univ Technol, Sch Elect Engn & Automat, Tianjin 300384, Peoples R China
[2] Tianjin Key Lab New Energy Power Convers Transmiss, Tianjin 300384, Peoples R China
基金
中国国家自然科学基金;
关键词
speech enhancement; feature fusion; attention mechanisms; U-Net; MANNER;
D O I
10.3390/electronics12081768
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The problems that the multi-view attention network for noise erasure (MANNER) cannot take into account are the local and global features in the speech enhancement of long sequences. An attention and feature fusion MANNER (AF-MANNER) network is proposed, which improves the multi-view attention (MA) module in MANNER and replaces the global and local attention in the module. AF-MANNER also designs the feature-weighted fusion module to fuse the features of flash attention and neighborhood attention to enhance the feature expression of the network. The final ablation studies show that this network exhibits a good performance in speech enhancement and that its structure is valuable for improving the intelligibility and perceptual quality of speech.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Speech emotion classification using attention based network and regularized feature selection
    Akinpelu, Samson
    Viriri, Serestina
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [42] Speech Emotion Recognition Using Global-Aware Cross-Modal Feature Fusion Network
    Li, Feng
    Luo, Jiusong
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, ICIC 2023, PT II, 2023, 14087 : 211 - 221
  • [43] Fusion Network Based on Progressive Nested Feature
    Sun J.
    Wang J.
    Tang C.
    Wu X.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2023, 36 (01): : 70 - 80
  • [44] Feature fusion network based on strip pooling
    Wang, Gaihua
    Zhai, Qianyu
    SCIENTIFIC REPORTS, 2021, 11 (01)
  • [45] Feature fusion network based on strip pooling
    Gaihua Wang
    Qianyu Zhai
    Scientific Reports, 11
  • [46] Siamese Network Tracking Based on Feature Enhancement
    Huang, Dandan
    Yang, Mingting
    Duan, Jin
    Yu, Siyu
    Liu, Zhi
    IEEE ACCESS, 2023, 11 : 37705 - 37713
  • [47] Monaural Speech Enhancement Based on Spectrogram Decomposition for Convolutional Neural Network-sensitive Feature Extraction
    Shi, Hao
    Wang, Longbiao
    Li, Sheng
    Dang, Jianwu
    Kawahara, Tatsuya
    INTERSPEECH 2022, 2022, : 221 - 225
  • [48] Global feature fusion generative adversarial network for underwater image enhancement
    Liu, Chunyou
    Qi, Ping
    Tang, Zhibin
    ELECTRONICS LETTERS, 2024, 60 (22)
  • [49] LAFFNet: A Lightweight Adaptive Feature Fusion Network for Underwater Image Enhancement
    Yang, Hao-Hsiang
    Huang, Kuan-Chih
    Chen, Wei-Ting
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 685 - 692
  • [50] AMFENet: An Adaptive Multiscale Feature Fusion Enhancement Network for Sinkhole Detection
    Zhu, Guodong
    Niu, Yunyun
    Ruan, Long
    Zhang, Xiaohao
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5