Artist Similarity Based on Heterogeneous Graph Neural Networks

被引:0
|
作者
da Silva, Angelo Cesar Mendes [1 ]
Silva, Diego Furtado [1 ]
Marcacini, Ricardo Marcondes [1 ]
机构
[1] Univ Sao Paulo, Inst Math & Comp Sci, BR-13566590 Sao Carlos, SP, Brazil
基金
巴西圣保罗研究基金会;
关键词
Task analysis; Music; Graph neural networks; Data models; Topology; Feature extraction; Speech processing; Artist similarity; artist representation; heterogeneous graph; graph neural networks; musical data representation;
D O I
10.1109/TASLP.2024.3437170
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Music streaming platforms rely on recommending similar artists to maintain user engagement, with artists benefiting from these suggestions to boost their popularity. Another important feature is music information retrieval, allowing users to explore new content. In both scenarios, performance depends on how to compute the similarity between musical content. This is a challenging process since musical data is inherently multimodal, containing textual and audio data. We propose a novel graph-based artist representation that integrates audio, lyrics features, and artist relations. Thus, a multimodal representation on a heterogeneous graph is proposed, along with a network regularization process followed by a GNN model to aggregate multimodal information into a more robust unified representation. The proposed method explores this final multimodal representation for the task of artist similarity as a link prediction problem. Our method introduces a new importance matrix to emphasize related artists in this multimodal space. We compare our approach with other strong baselines based on combining input features, importance matrix construction, and GNN models. Experimental results highlight the superiority of multimodal representation through the transfer learning process and the value of the importance matrix in enhancing GNN models for artist similarity.
引用
收藏
页码:3717 / 3729
页数:13
相关论文
共 50 条
  • [41] Poincare Heterogeneous Graph Neural Networks for Sequential Recommendation
    Guo, Naicheng
    Liu, Xiaolei
    Li, Shaoshuai
    Ma, Qiongxu
    Gao, Kaixin
    Han, Bing
    Zheng, Lin
    Guo, Sheng
    Guo, Xiaobo
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2023, 41 (03)
  • [42] Exploring Multiple Hypergraphs for Heterogeneous Graph Neural Networks
    Wang, Ying
    Li, Yingji
    Wu, Yue
    Wang, Xin
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 236
  • [43] Datasets and Interfaces for Benchmarking Heterogeneous Graph Neural Networks
    Liu, Yijian
    Zhang, Hongyi
    Yang, Cheng
    Li, Ao
    Ji, Yugang
    Zhang, Luhao
    Li, Tao
    Yang, Jinyu
    Zhao, Tianyu
    Yang, Juan
    Huang, Hai
    Shi, Chuan
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 5346 - 5350
  • [44] Heterogeneous Graph Neural Networks for Malicious Account Detection
    Liu, Ziqi
    Chen, Chaochao
    Yang, Xinxing
    Zhou, Jun
    Li, Xiaolong
    Song, Le
    CIKM'18: PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2018, : 2077 - 2085
  • [45] Interpretable Graph Neural Networks for Heterogeneous Tabular Data
    Alkhatib, Amr
    Bostrom, Henrik
    DISCOVERY SCIENCE, DS 2024, PT I, 2025, 15243 : 310 - 324
  • [46] Amalgamating Knowledge from Heterogeneous Graph Neural Networks
    Jing, Yongcheng
    Yang, Yiding
    Wang, Xinchao
    Song, Mingli
    Tao, Dacheng
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 15704 - 15713
  • [47] DialGNN: Heterogeneous Graph Neural Networks for Dialogue Classification
    Yan, Yan
    Zhang, Bo-Wen
    Min, Peng-hao
    Ding, Guan-wen
    Liu, Jun-yuan
    NEURAL PROCESSING LETTERS, 2024, 56 (02)
  • [48] Multimodal Recipe Recommendation with Heterogeneous Graph Neural Networks
    Ouyang, Ruiqi
    Huang, Haodong
    Ou, Weihua
    Liu, Qilong
    ELECTRONICS, 2024, 13 (16)
  • [49] Heterogeneous Graph Neural Networks for Software Effort Estimation
    Phan, Hung
    Jannesari, Ali
    PROCEEDINGS OF THE16TH ACM/IEEE INTERNATIONAL SYMPOSIUM ON EMPIRICAL SOFTWARE ENGINEERING AND MEASUREMENT, ESEM 2022, 2022, : 103 - 113
  • [50] Similarity-navigated graph neural networks for node classification
    Zou, Minhao
    Gan, Zhongxue
    Cao, Ruizhi
    Guan, Chun
    Leng, Siyang
    INFORMATION SCIENCES, 2023, 633 : 41 - 69