Deep attention based music genre classification

被引:46
|
作者
Yu, Yang [1 ]
Luo, Sen [2 ]
Liu, Shenglan [2 ]
Qiao, Hong [3 ]
Liu, Yang [2 ]
Feng, Lin [2 ]
机构
[1] Dalian Univ Technol, Sch Comp Sci & Technol, Dalian 116024, Peoples R China
[2] Dalian Univ Technol, Sch Innovat & Enterpreneurship, Dalian 116024, Peoples R China
[3] Chinese Acad Sci, State Key Lab Management & Control Complex Syst, Inst Automat, Beijing 100190, Peoples R China
关键词
Music genre classification; Deep neural networks; Serial attention; Parallelized attention; FEATURES; NETWORKS;
D O I
10.1016/j.neucom.2019.09.054
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As an important component of music information retrieval, music genre classification attracts great attentions these years. Benefitting from the outstanding performance of deep neural networks in computer vision, some researchers apply CNN on music genre classification tasks with audio spectrograms as input instead, which has similarities with RGB images. These methods are based on a latent assumption that spectrums with different temporal steps have equal importance. However, it goes against the theory of processing bottleneck in psychology as well as our observation from audio spectrograms. By considering the differences of spectrums, we propose a new model incorporating with attention mechanism based on Bidirectional Recurrent Neural Network. Furthermore, two attention-based models (serial attention and parallelized attention) are implemented in this paper. Comparing with serial attention, parallelized attention is more flexible and gets better results in our experiments. Especially, the CNN-based parallelized attention models with taking STFT spectrograms as input outperform the previous work. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:84 / 91
页数:8
相关论文
共 50 条
  • [21] MUSIC GENRE CLASSIFICATION BASED ON MULTIPLE CLASSIFIER FUSION
    Wang, Lei
    Huang, Shen
    Wang, Shijin
    Liang, Jiaen
    Xu, Bo
    ICNC 2008: FOURTH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, VOL 5, PROCEEDINGS, 2008, : 580 - 583
  • [22] Parallel attention of representation global time–frequency correlation for music genre classification
    Zhifang Wen
    Aibin Chen
    Guoxiong Zhou
    Jizheng Yi
    Weixiong Peng
    Multimedia Tools and Applications, 2024, 83 : 10211 - 10231
  • [23] Music Features based on Hu Moments for Genre Classification
    Lopes, Renia
    Chapaneri, Santosh
    Jayaswal, Deepak
    2017 2ND INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS, COMPUTING AND IT APPLICATIONS (CSCITA), 2017, : 22 - 27
  • [24] Music Genre Classification Based on Functional Data Analysis
    Shen, Jiahong
    Xiao, Guangrun
    IEEE ACCESS, 2024, 12 : 185482 - 185491
  • [25] Ensemble of deep learning, visual and acoustic features for music genre classification
    Nanni, Loris
    Costa, Yandre M. G.
    Aguiar, Rafael L.
    Silla, Carlos N., Jr.
    Brahnam, Sheryl
    JOURNAL OF NEW MUSIC RESEARCH, 2018, 47 (04) : 383 - 397
  • [26] Music genre classification using deep neural networks and data augmentation
    Ba, Thanh Chu
    Le, Thuy Dao Thi
    Trinh, Van Loan
    ENTERTAINMENT COMPUTING, 2025, 53
  • [27] Jazz Music Sub-Genre Classification Using Deep Learning
    Quinto, Rene Josiah M.
    Atienza, Rowel O.
    Tiglao, Nestor Michael C.
    TENCON 2017 - 2017 IEEE REGION 10 CONFERENCE, 2017, : 3111 - 3116
  • [28] Robustness of musical features on deep learning models for music genre classification
    Singh, Yeshwant
    Biswas, Anupam
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 199
  • [29] Jazz music sub-genre classification using deep learning
    Quinto, Rene Josiah M.
    Atienza, Rowel O.
    Tiglao, Nestor Michael C.
    IEEE Region 10 Annual International Conference, Proceedings/TENCON, 2017, 2017-December : 3111 - 3116
  • [30] Deep Neural Networks with Depthwise Separable Convolution for Music Genre Classification
    Liang, Yunming
    Zhou, Yi
    Wan, Tongtang
    Shu, Xiaofeng
    2019 2ND IEEE INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND SIGNAL PROCESSING (ICICSP), 2019, : 267 - 270