Convolutional Neural Networks and Transfer Learning Applied to Automatic Composition of Descriptive Music

被引：0

作者：

Martin-Gomez, Lucia ^{[1
]}

Perez-Marcos, Javier ^{[1
]}

Navarro-Caceres, Maria ^{[1
]}

Rodriguez-Gonzalez, Sara ^{[1
]}

机构：

[1] Univ Salamanca, BISITE Digital Innovat Hub, Edificio Multiusos I D I, Salamanca 37007, Spain

来源：

DISTRIBUTED COMPUTING AND ARTIFICIAL INTELLIGENCE | 2019年 / 801卷

关键词：

Descriptive music; Automatic composition; Image; Video; Transfer learning; Convolutional neural networks;

D O I：

10.1007/978-3-319-99608-0_31

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Visual and musical arts has been strongly interconnected throughout history. The aim of this work is to compose music on the basis of the visual characteristics of a video. For this purpose, descriptive music is used as a link between image and sound and a video fragment of film Fantasia is deeply analyzed. Specially, convolutional neural networks in combination with transfer learning are applied in the process of extracting image descriptors. In order to establish a relationship between the visual and musical information, Naive Bayes, Support Vector Machine and Random Forest classifiers are applied. The obtained model is subsequently employed to compose descriptive music from a new video. The results of this proposal are compared with those of an antecedent work in order to evaluate the performance of the classifiers and the quality of the descriptive musical composition.

引用

页码：275 / 282

页数：8

共 50 条

[31] Convolutional Neural Networks for Automatic State-Time Feature Extraction in Reinforcement Learning Applied to Residential Load Control
Claessens, Bert J.
Vrancx, Peter
Ruelens, Frederik
IEEE TRANSACTIONS ON SMART GRID, 2018, 9 (04) : 3259 - 3269
[32] Deep Convolutional Neural Networks with Transfer Learning for Visual Sentiment Analysis
Devi, K. Usha Kingsly
Gomathi, V
NEURAL PROCESSING LETTERS, 2023, 55 (04) : 5087 - 5120
[33] Using Convolutional Neural Networks and Transfer Learning for Bone Age Classification
Zhou, Jianlong
Li, Zelin
Zhi, Weiming
Liang, Bin
Moses, Daniel
Dawes, Laughlin
2017 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING - TECHNIQUES AND APPLICATIONS (DICTA), 2017, : 17 - 22
[34] Lesion classification in mammograms using convolutional neural networks and transfer learning
Perre, Ana C.
Alexandre, Luis A.
Freire, Luis C.
COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING-IMAGING AND VISUALIZATION, 2019, 7 (5-6): : 550 - 556
[35] Filter Pruning for Efficient Transfer Learning in Deep Convolutional Neural Networks
Reinhold, Caique
Roisenberg, Mauro
ARTIFICIAL INTELLIGENCEAND SOFT COMPUTING, PT I, 2019, 11508 : 191 - 202
[36] Wearable Seizure Detection using Convolutional Neural Networks with Transfer Learning
Page, Adam
Shea, Colin
Mohsenin, Tinoosh
2016 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2016, : 1086 - 1089
[37] AutoTune: Automatically Tuning Convolutional Neural Networks for Improved Transfer Learning
Basha, S. H. Shabbeer
Vinakota, Sravan Kumar
Pulabaigari, Viswanath
Mukherjee, Snehasis
Dubey, Shiv Ram
NEURAL NETWORKS, 2021, 133 : 112 - 122
[38] Application of Transfer Learning for Object Recognition Using Convolutional Neural Networks
Diaz Salazar, Nicolas
Lopez Sotelo, Jesus Alfonso
Salazar Gomez, Gustavo Andres
2018 IEEE 1ST COLOMBIAN CONFERENCE ON APPLICATIONS IN COMPUTATIONAL INTELLIGENCE (COLCACI), 2018,
[39] Classification and transfer learning of sleep spindles based on convolutional neural networks
Liang, Jun
Belkacem, Abdelkader Nasreddine
Song, Yanxin
Wang, Jiaxin
Ai, Zhiguo
Wang, Xuanqi
Guo, Jun
Fan, Lingfeng
Wang, Changming
Ji, Bowen
Wang, Zengguang
FRONTIERS IN NEUROSCIENCE, 2024, 18
[40] Transfer Learning with Convolutional Neural Networks for Cider Apple Varieties Classification
Garcia Cortes, Silverio
Menendez Diaz, Agustin
Oliveira Prendes, Jose Alberto
Bello Garcia, Antonio
AGRONOMY-BASEL, 2022, 12 (11):

← 1 2 3 4 5 →