Groove2Groove: One-Shot Music Style Transfer With Supervision From Synthetic Data

被引:22
|
作者
Cifka, Ondrej [1 ]
Simsekli, Umut [1 ]
Richard, Gael [1 ]
机构
[1] Inst Polytech Paris, Telecom Paris, Informat Proc & Commun Lab LTCI, F-91120 Palaiseau, France
基金
欧盟地平线“2020”;
关键词
Music; Task analysis; Speech processing; Training; Neural networks; Supervised learning; Instruments; Style transfer; symbolic music; synthetic data; deep learning; recurrent neural networks;
D O I
10.1109/TASLP.2020.3019642
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Style transfer is the process of changing the style of an image, video, audio clip or musical piece so as to match the style of a given example. Even though the task has interesting practical applications within the music industry, it has so far received little attention from the audio and music processing community. In this article, we present Groove2Groove, a one-shot style transfer method for symbolic music, focusing on the case of accompaniment styles in popular music and jazz. We propose an encoder-decoder neural network for the task, along with a synthetic data generation scheme to supply it with parallel training examples. This synthetic parallel data allows us to tackle the style transfer problem using end-to-end supervised learning, employing powerful techniques used in natural language processing. We experimentally demonstrate the performance of the model on style transfer using existing and newly proposed metrics, and also explore the possibility of style interpolation.
引用
收藏
页码:2638 / 2650
页数:13
相关论文
共 34 条
  • [21] Explore Efficient Local Features from RGB-D Data for One-Shot Learning Gesture Recognition
    Wan, Jun
    Guo, Guodong
    Li, Stan Z.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (08) : 1626 - 1639
  • [22] Adaptive Local Spatiotemporal Features from RGB-D Data for One-Shot Learning Gesture Recognition
    Lin, Jia
    Ruan, Xiaogang
    Yu, Naigong
    Yang, Yee-Hong
    SENSORS, 2016, 16 (12)
  • [23] One-Shot Accurate Cylinder Pose Estimation From Point Cloud Data With Density-Based Geometric Clustering
    Ohashi, Ayato
    Naruse, Keitaro
    2024 IEEE INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS, AIM 2024, 2024, : 1651 - 1656
  • [24] MEASUREMENTS OF PARTICLE-TO-GAS HEAT-TRANSFER COEFFICIENTS FROM ONE-SHOT THERMAL RESPONSES IN PACKED-BEDS
    SHEN, J
    KAGUEI, S
    WAKAO, N
    CHEMICAL ENGINEERING SCIENCE, 1981, 36 (08) : 1283 - 1286
  • [25] ODAL: A one-shot distributed algorithm to perform logistic regressions on electronic health records data from multiple clinical sites
    Duan, Rui
    Boland, Mary Regina
    Moore, Jason H.
    Chen, Yong
    PACIFIC SYMPOSIUM ON BIOCOMPUTING 2019, 2019, : 30 - 41
  • [26] Dehydrogenative synthesis of N-functionalized 2-aminophenols from cyclohexanones and amines: Molecular complexities via one-shot assembly
    Xu, Biping
    Liu, Xiaojie
    Deng, Lei
    Shang, Yaping
    Jie, Xiaoming
    Su, Weiping
    SCIENCE ADVANCES, 2024, 10 (18):
  • [27] An exploratory study of one-shot learning using siamese convolutional neural network for histopathology image classification in breast cancer from few data examples
    Cano, Fabian
    Cruz-Roa, Angel
    15TH INTERNATIONAL SYMPOSIUM ON MEDICAL INFORMATION PROCESSING AND ANALYSIS, 2020, 11330
  • [28] Better localized predictions with Out-of-Scope information and Explainable AI: One-Shot SAR backscatter nowcast framework with data from neighboring region
    Li, Zhouyayan
    Demir, Ibrahim
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2024, 207 : 92 - 103
  • [29] Robust inference and model selection for data from one-shot devices under cyclic accelerated life-tests with an application to a test of CSP solder joints
    Balakrishnan, Narayanaswamy
    Castilla, Elena
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART O-JOURNAL OF RISK AND RELIABILITY, 2025,
  • [30] Task2Sim: Towards Effective Pre-training and Transfer from Synthetic Data
    Mishra, Samarth
    Panda, Rameswar
    Phoo, Cheng Perng
    Chen, Chun-Fu
    Karlinsky, Leonid
    Saenko, Kate
    Saligrama, Venkatesh
    Feris, Rogerio S.
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 9184 - 9194