Welcome to the portal with supporting material for MuseSync!

MuseSync was a response to the 2012 ACM Multimedia Grand Challenge on Automatic Music Video Generation. In this, the challenge was posed to auto-suggest cool soundtracks for user-generated web videos.

In our response to the challenge, we built a system which uses automated multimedia content analysis techniques inspired by findings from music psychology and musicology, and give an important role to the intended narrative of the video. We connect the narrative to best practices in professional movies by using knowledge from collaborative web resources.

The full MuseSync pipeline could be visualized as follows:

MuseSync pipeline

For the further background of the MuseSync system, please consult our extended abstract:

Our supplementary material is split up into several parts: