Grants and Contributions:

Title:
Music-visual feature mapping and deep tagging
Agreement Number:
EGP
Agreement Value:
$25,000.00
Agreement Date:
Mar 7, 2018 -
Organization:
Natural Sciences and Engineering Research Council of Canada
Location:
British Columbia, CA
Reference Number:
GC-2017-Q4-01809
Agreement Type:
Grant
Report Type:
Grants and Contributions
Additional Information:

Grant or Award spanning more than one fiscal year (2017-2018 to 2018-2019).

Recipient's Legal Name:
Tzanetakis, George (University of Victoria)
Program:
Engage Grants for universities
Program Purpose:

Apollo Music Store is a Montreal based company that specializes on licensing and distributing digitally music.x000D
They represented hundreds of artists and more than 75% of them are Canadian. The goal of this project is tox000D
improve the user experience of Apollo customers who are trying to find specific kinds of music for advertising,x000D
games and other applications. Two main objectives will be pursued. The first is to explore how tox000D
automatically associate and adjust stock video with music tracks based on audio and visual feature extractionx000D
and mapping. The second objective is to use deep learning techniques to build software that automatically tagsx000D
the music with descriptive keywords. Deep learning has been shown to be very effective in a variety ofx000D
machine learning tasks. Data augmentation and semi-supervised learning are techniques used to train deepx000D
neural networks when the amount of labeled data is limited. Apollo Music will provide access to their digitalx000D
catalog as well as existing meta-data their curators have provided about the tracks. The research group ofx000D
Dr.Tzanetakis has a strong international presence in Music Information Retrieval and Machine Learning.x000D
which are research areas that will contribute ideas, concepts, and algorithms to the project. Two PhD studentsx000D
with complementary experience in computer vision/deep learning/audio signal processing and gesturex000D
recognition/human-computer interaction will be funded through the project and work with the designers andx000D
engineers at Apollo Music Store.