ComposeInStyle: Music composition with and without Style Transfer

被引:13
|
作者
Mukherjee, Sreetama [1 ]
Mulimani, Manjunath [2 ]
机构
[1] Microsoft R&D Pvt Ltd, Hyderabad 500033, India
[2] Manipal Acad Higher Educ, Manipal Inst Technol, Dept Comp Sci & Engn, Manipal 576104, Karnataka, India
关键词
Music composer classification; Style transfer; Generative Adversarial Networks (GAN); Hybrid model; Musical Instrument Digital Interface (MIDI); Piano rolls; FEATURES;
D O I
10.1016/j.eswa.2021.116195
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Every music composition has a composer at the core of its building block, molding it into a style of their own. The creative compositional style of a composer varies dynamically with every composer which is perishable and inimitable but cannot be preserved. This paper proposes a hybrid style transfer model which is an end -to-end approach to transfer style, compose as well as evaluate the style transfer accuracy in the domain of the target music composer. The paper focuses on 3 composer maestros Liszt, Chopin and Schubert taken from the Maestro dataset. The main step of music composer style transfer is accomplished in 3 systematic steps, training composer classifiers according to feature sets, generating a model of a composition in a particular composer's style from noise, and finally style transfer and its evaluation. The 3 steps are interconnected in a way that each step is the building block for the next step. The GAN architecture of the style transfer step is built out of the GAN architecture of the second step. The compositions generated from each architecture is finally evaluated by the common pre-trained classifier of the first step. The highest accuracy obtained is 80% for composer classification using the maestro dataset, 77.27% for the classification of the generated style transferred version of a composition into the target composer class using the pre-trained classifiers.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] ComposeInStyle: Music composition with and without Style Transfer[Formula presented]
    Mukherjee, Sreetama
    Mulimani, Manjunath
    Expert Systems with Applications, 2022, 191
  • [2] Exploring Music Style Transfer and Innovative Composition using Deep Learning Algorithms
    He, Sujie
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (05) : 1000 - 1007
  • [3] THE TONGAN LAKALAKA - MUSIC COMPOSITION AND STYLE
    SHUMWAY, LV
    ETHNOMUSICOLOGY, 1981, 25 (03) : 467 - 479
  • [4] A Style-Specific Music Composition Neural Network
    Jin, Cong
    Tie, Yun
    Bai, Yong
    Lv, Xin
    Liu, Shouxun
    NEURAL PROCESSING LETTERS, 2020, 52 (03) : 1893 - 1912
  • [5] A Style-Specific Music Composition Neural Network
    Cong Jin
    Yun Tie
    Yong Bai
    Xin Lv
    Shouxun Liu
    Neural Processing Letters, 2020, 52 : 1893 - 1912
  • [6] Make Your Favorite Music Curative: Music Style Transfer for Anxiety Reduction
    Hu, Zhejing
    Liu, Yan
    Chen, Gong
    Zhong, Sheng-hua
    Zhang, Aiwei
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 1189 - 1197
  • [8] Style Transformer: Unpaired Text Style Transfer without Disentangled Latent Representation
    Dai, Ning
    Liang, Jianze
    Qiu, Xipeng
    Huang, Xuanjing
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 5997 - 6007
  • [9] Singability-enhanced lyric generator with music style transfer
    Chang, Jia-Wei
    Hung, Jason C.
    Lin, Kuan-Cheng
    COMPUTER COMMUNICATIONS, 2021, 168 : 33 - 53
  • [10] Music performance style transfer for learning expressive musical performance
    Zhe Xiao
    Xin Chen
    Li Zhou
    Signal, Image and Video Processing, 2024, 18 : 889 - 898