ComposeInStyle: Music composition with and without Style Transfer

被引:13
|
作者
Mukherjee, Sreetama [1 ]
Mulimani, Manjunath [2 ]
机构
[1] Microsoft R&D Pvt Ltd, Hyderabad 500033, India
[2] Manipal Acad Higher Educ, Manipal Inst Technol, Dept Comp Sci & Engn, Manipal 576104, Karnataka, India
关键词
Music composer classification; Style transfer; Generative Adversarial Networks (GAN); Hybrid model; Musical Instrument Digital Interface (MIDI); Piano rolls; FEATURES;
D O I
10.1016/j.eswa.2021.116195
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Every music composition has a composer at the core of its building block, molding it into a style of their own. The creative compositional style of a composer varies dynamically with every composer which is perishable and inimitable but cannot be preserved. This paper proposes a hybrid style transfer model which is an end -to-end approach to transfer style, compose as well as evaluate the style transfer accuracy in the domain of the target music composer. The paper focuses on 3 composer maestros Liszt, Chopin and Schubert taken from the Maestro dataset. The main step of music composer style transfer is accomplished in 3 systematic steps, training composer classifiers according to feature sets, generating a model of a composition in a particular composer's style from noise, and finally style transfer and its evaluation. The 3 steps are interconnected in a way that each step is the building block for the next step. The GAN architecture of the style transfer step is built out of the GAN architecture of the second step. The compositions generated from each architecture is finally evaluated by the common pre-trained classifier of the first step. The highest accuracy obtained is 80% for composer classification using the maestro dataset, 77.27% for the classification of the generated style transferred version of a composition into the target composer class using the pre-trained classifiers.
引用
收藏
页数:21
相关论文
共 50 条
  • [41] FORM AND STYLE IN PERSIAN MUSIC
    FARHAT, H
    WORLD OF MUSIC, 1978, 20 (02): : 109 - 118
  • [42] Music visualization in style and structure
    Ohmi, K.
    JOURNAL OF VISUALIZATION, 2007, 10 (03) : 257 - 258
  • [43] KODALY,ZOLTAN STYLE OF MUSIC
    BONIS, F
    OSTERREICHISCHE MUSIK ZEITSCHRIFT, 1982, 37 (12): : 665 - 674
  • [44] STATISTICS, STRUCTURE, AND STYLE IN MUSIC
    Krumhansl, Carol Lynne
    MUSIC PERCEPTION, 2015, 33 (01): : 20 - 31
  • [45] THE SOUND OF MUSIC, EXTERNALIST STYLE
    Kersten, Luke
    Wilson, Robert A.
    AMERICAN PHILOSOPHICAL QUARTERLY, 2016, 53 (02) : 139 - 154
  • [46] Sarangi style in Hindustani music
    Davies, Morgan
    ETHNOMUSICOLOGY FORUM, 2022, 31 (03) : 449 - 451
  • [47] MEMORY FOR COMPOSITIONAL STYLE IN MUSIC
    KRUMHANSL, CL
    BULLETIN OF THE PSYCHONOMIC SOCIETY, 1989, 27 (06) : 514 - 514
  • [48] MAKING MUSIC CHICAGO STYLE
    BEUTTLER, B
    DOWN BEAT, 1985, 52 (09): : 11 - 11
  • [49] Music criticism without music?
    Kovacs, Adorjan F.
    NEUE ZEITSCHRIFT FUR MUSIK, 2011, (03): : 30 - 31
  • [50] SELF-SUPERVISED VQ-VAE FOR ONE-SHOT MUSIC STYLE TRANSFER
    Cifka, Ondrej
    Ozerov, Alexey
    Simsekli, Umut
    Richard, Gael
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 96 - 100