Artist Similarity Based on Heterogeneous Graph Neural Networks

被引:0
|
作者
da Silva, Angelo Cesar Mendes [1 ]
Silva, Diego Furtado [1 ]
Marcacini, Ricardo Marcondes [1 ]
机构
[1] Univ Sao Paulo, Inst Math & Comp Sci, BR-13566590 Sao Carlos, SP, Brazil
基金
巴西圣保罗研究基金会;
关键词
Task analysis; Music; Graph neural networks; Data models; Topology; Feature extraction; Speech processing; Artist similarity; artist representation; heterogeneous graph; graph neural networks; musical data representation;
D O I
10.1109/TASLP.2024.3437170
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Music streaming platforms rely on recommending similar artists to maintain user engagement, with artists benefiting from these suggestions to boost their popularity. Another important feature is music information retrieval, allowing users to explore new content. In both scenarios, performance depends on how to compute the similarity between musical content. This is a challenging process since musical data is inherently multimodal, containing textual and audio data. We propose a novel graph-based artist representation that integrates audio, lyrics features, and artist relations. Thus, a multimodal representation on a heterogeneous graph is proposed, along with a network regularization process followed by a GNN model to aggregate multimodal information into a more robust unified representation. The proposed method explores this final multimodal representation for the task of artist similarity as a link prediction problem. Our method introduces a new importance matrix to emphasize related artists in this multimodal space. We compare our approach with other strong baselines based on combining input features, importance matrix construction, and GNN models. Experimental results highlight the superiority of multimodal representation through the transfer learning process and the value of the importance matrix in enhancing GNN models for artist similarity.
引用
收藏
页码:3717 / 3729
页数:13
相关论文
共 50 条
  • [31] ReGNN: A ReRAM-based Heterogeneous Architecture for General Graph Neural Networks
    Liu, Cong
    Liu, Haikun
    Jin, Hai
    Liao, Xiaofei
    Zhang, Yu
    Duan, Zhuohui
    Xu, Jiahong
    Li, Huize
    PROCEEDINGS OF THE 59TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC 2022, 2022, : 469 - 474
  • [32] Globally Enhanced Heterogeneous Temporal Graph Neural Networks Based on Contrastive Learning
    Jiao P.
    Liu H.
    Lü L.
    Gao M.
    Zhang J.
    Liu D.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2023, 60 (08): : 1808 - 1821
  • [33] A Traffic Flow Prediction Framework Based on Clustering and Heterogeneous Graph Neural Networks
    Luo, Lei
    Han, Shiyuan
    Li, Zhongtao
    Yang, Jun
    Yang, Xixin
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, ICIC 2023, PT II, 2023, 14087 : 58 - 69
  • [34] DiffMG: Differentiable Meta Graph Search for Heterogeneous Graph Neural Networks
    Ding, Yuhui
    Yao, Quanming
    Zhao, Huan
    Zhang, Tong
    KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 279 - 288
  • [35] Heterogeneous Graph Neural Network Model Based on Edge Feature Generation and Meta-Graph Similarity for Feature Extraction
    Qian, Chengyuan
    IEEE ACCESS, 2025, 13 : 49672 - 49682
  • [36] Code Similarity Prediction Model for Industrial Management Features Based on Graph Neural Networks
    Li, Zhenhao
    Lei, Hang
    Ma, Zhichao
    Zhang, Fengyun
    ENTROPY, 2024, 26 (06)
  • [37] Multilayer biological network alignment based on similarity computation via Graph Neural Networks
    Cinaglia, Pietro
    JOURNAL OF COMPUTATIONAL SCIENCE, 2024, 78
  • [38] Aspect sentiment analysis with heterogeneous graph neural networks
    Lu, Guangquan
    Li, Jiecheng
    Wei, Jian
    INFORMATION PROCESSING & MANAGEMENT, 2022, 59 (04)
  • [39] FedHGN: A Federated Framework for Heterogeneous Graph Neural Networks
    Fu, Xinyu
    King, Irwin
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 3705 - 3713
  • [40] Distance Information Improves Heterogeneous Graph Neural Networks
    Shi, Chuan
    Ji, Houye
    Lu, Zhiyuan
    Tang, Ye
    Li, Pan
    Yang, Cheng
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (03) : 1030 - 1043