Artist Similarity Based on Heterogeneous Graph Neural Networks

被引:0
|
作者
da Silva, Angelo Cesar Mendes [1 ]
Silva, Diego Furtado [1 ]
Marcacini, Ricardo Marcondes [1 ]
机构
[1] Univ Sao Paulo, Inst Math & Comp Sci, BR-13566590 Sao Carlos, SP, Brazil
基金
巴西圣保罗研究基金会;
关键词
Task analysis; Music; Graph neural networks; Data models; Topology; Feature extraction; Speech processing; Artist similarity; artist representation; heterogeneous graph; graph neural networks; musical data representation;
D O I
10.1109/TASLP.2024.3437170
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Music streaming platforms rely on recommending similar artists to maintain user engagement, with artists benefiting from these suggestions to boost their popularity. Another important feature is music information retrieval, allowing users to explore new content. In both scenarios, performance depends on how to compute the similarity between musical content. This is a challenging process since musical data is inherently multimodal, containing textual and audio data. We propose a novel graph-based artist representation that integrates audio, lyrics features, and artist relations. Thus, a multimodal representation on a heterogeneous graph is proposed, along with a network regularization process followed by a GNN model to aggregate multimodal information into a more robust unified representation. The proposed method explores this final multimodal representation for the task of artist similarity as a link prediction problem. Our method introduces a new importance matrix to emphasize related artists in this multimodal space. We compare our approach with other strong baselines based on combining input features, importance matrix construction, and GNN models. Experimental results highlight the superiority of multimodal representation through the transfer learning process and the value of the importance matrix in enhancing GNN models for artist similarity.
引用
收藏
页码:3717 / 3729
页数:13
相关论文
共 50 条
  • [1] Similarity-based Heterogeneous Neural Networks
    Belanche Munoz, Lluis A.
    Valdes Ramos, Julio Jose
    ENGINEERING LETTERS, 2007, 14 (02)
  • [2] Graph-Based Similarity of Deep Neural Networks☆
    Chen, Zuohui
    Lu, Yao
    Hu, JinXuan
    Xuan, Qi
    Wang, Zhen
    Yang, Xiaoniu
    NEUROCOMPUTING, 2025, 614
  • [3] Vessel Trajectory Similarity Computation Based on Heterogeneous Graph Neural Network
    Luo, Sizhe
    Zeng, Weiming
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (07)
  • [4] Deep Heterogeneous Graph Neural Networks via Similarity Regularization Loss and Hierarchical Fusion
    Xiong, Zhilong
    Cai, Jia
    2022 IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS, ICDMW, 2022, : 759 - 768
  • [5] HGK-GNN: Heterogeneous Graph Kernel based Graph Neural Networks
    Long, Qingqing
    Xu, Lingjun
    Fang, Zheng
    Song, Guojie
    KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 1129 - 1138
  • [6] Session-based Recommendation with Heterogeneous Graph Neural Networks
    Xu, Lei
    Xi, Wu-Dong
    Wang, Chang-Dong
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [7] Graph Neural Networks for Heterogeneous Trust based Social Recommendation
    Mandal, Supriyo
    Maiti, Abyayananda
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [8] A histogram-based approach to calculate graph similarity using graph neural networks
    Kajla, Nadeem Iqbal
    Missen, Malik Muhammad Saad
    Coustaty, Mickael
    Badar, Hafiz Muhammad Sanaullah
    Pasha, Maruf
    Belbachir, Faiza
    PATTERN RECOGNITION LETTERS, 2024, 186 : 286 - 291
  • [9] Heterogeneous graph neural networks with denoising for graph embeddings
    Dong, Xinrui
    Zhang, Yijia
    Pang, Kuo
    Chen, Fei
    Lu, Mingyu
    KNOWLEDGE-BASED SYSTEMS, 2022, 238
  • [10] Heterogeneous Graph Structure Learning for Graph Neural Networks
    Zhao, Jianan
    Wang, Xiao
    Shi, Chuan
    Hu, Binbin
    Song, Guojie
    Ye, Yanfang
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 4697 - 4705