Groove2Groove: One-Shot Music Style Transfer With Supervision From Synthetic Data

被引:22
|
作者
Cifka, Ondrej [1 ]
Simsekli, Umut [1 ]
Richard, Gael [1 ]
机构
[1] Inst Polytech Paris, Telecom Paris, Informat Proc & Commun Lab LTCI, F-91120 Palaiseau, France
基金
欧盟地平线“2020”;
关键词
Music; Task analysis; Speech processing; Training; Neural networks; Supervised learning; Instruments; Style transfer; symbolic music; synthetic data; deep learning; recurrent neural networks;
D O I
10.1109/TASLP.2020.3019642
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Style transfer is the process of changing the style of an image, video, audio clip or musical piece so as to match the style of a given example. Even though the task has interesting practical applications within the music industry, it has so far received little attention from the audio and music processing community. In this article, we present Groove2Groove, a one-shot style transfer method for symbolic music, focusing on the case of accompaniment styles in popular music and jazz. We propose an encoder-decoder neural network for the task, along with a synthetic data generation scheme to supply it with parallel training examples. This synthetic parallel data allows us to tackle the style transfer problem using end-to-end supervised learning, employing powerful techniques used in natural language processing. We experimentally demonstrate the performance of the model on style transfer using existing and newly proposed metrics, and also explore the possibility of style interpolation.
引用
收藏
页码:2638 / 2650
页数:13
相关论文
共 34 条
  • [31] One-shot photochemical synthesis of 5-(thiophen-3-yl)pyrano[2,3-c]chromen-2(3H)-ones from 3-propynyloxy-chromenones: a case of an intramolecular Paterno–Buchi reaction
    Pooja Jindal
    Rimpy Bhatia
    Sadhika Khullar
    Sanjay K. Mandal
    Ramesh C. Kamboj
    Photochemical & Photobiological Sciences, 2014, 13 : 488 - 491
  • [32] One-shot photochemical synthesis of 5-(thiophen-3-yl) pyrano[2,3-c] chromen-2(3H)-ones from 3-propynyloxy-chromenones: a case of an intramolecular Paterno-Buchi reaction
    Jindal, Pooja
    Bhatia, Rimpy
    Khullar, Sadhika
    Mandal, Sanjay K.
    Kamboj, Ramesh C.
    PHOTOCHEMICAL & PHOTOBIOLOGICAL SCIENCES, 2014, 13 (03) : 488 - 491
  • [33] ONE YEAR DATA FROM A PHASE 2B TRIAL OF AMT-061 (AAV5-PADUA HFIX VARIANT), AN ENHANCED VECTOR FOR GENE TRANSFER IN ADULTS WITH SEVERE OR MODERATE-SEVERE HEMOPHILIA B
    Pipe, S. W.
    Miesbach, W.
    Giermasz, A.
    Castaman, G.
    Key, N. S.
    Lattimore, S.
    Leebeek, F. W.
    Recht, M.
    Gomez, E.
    Long, A.
    Gut, R.
    Von Drygalski, A.
    HAEMOPHILIA, 2020, 26 : 25 - 26
  • [34] One Year Data from a Phase 2b Trial of AMT-061 (AAV5-Padua hFIX variant), an Enhanced Vector for Gene Transfer in Adults with Severe or Moderate-Severe Hemophilia B
    Pipe, Steven
    Giermasz, Adam
    Castaman, Giancarlo
    Key, Nigel S.
    Lattimore, Susan U.
    Leebeek, Frank
    Miesbach, Wolfgang
    Recht, Michael
    Gomez, Esteban
    Long, Alison
    Gut, Robert
    von Drygalski, Annette
    BLOOD, 2019, 134