MediaEval and Open Science
The MediaEval Multimedia Benchmark is a community-driven initiative made possible by time and effort devoted by members of the community. The multimedia access and retrieval tasks offered by the MediaEval benchmark are all organized by members of the community, who design and distribute data sets, evaluate results and produce a yearly workshop proceedings. The MediaEval community also includes all the researchers that carry out the tasks: developing algorithms and presenting results at the workshop.
The MediaEval community is an open community, in the sense that any member of the larger research community is welcome to contribute to the benchmarking effort. We strive to spread the benefits of benchmarking as widely as possible. MediaEval's goals are for this reason aligned with the goals of Open Science (also referred to as Open Research).
Open Science is scientific research that is carried out in the spirit of the free and open software movement. The dedication of the MediaEval benchmark to Open Science includes open access publishing of workshop proceedings and also making data sets and code available to the community whenever possible.
Open Access workshop proceedings include:
Martha Larson, Bogdan Ionescu, Mats Sjöberg, Xavier Anguera, Johann Poignant, Michael Riegler, Maria Eskevich, Claudia Hauff, Richard Sutcliffe, Gareth J.F. Jones, Yi-Hsuan Yang, Mohammad Soleymani, Symeon Papadopoulos (eds.), Proceedings of the MediaEval 2015 Multimedia Benchmark Workshop, Wurzen, Germany, September 14-15, 2015, CEUR-WS.org, online http://ceur-ws.org/Vol-1436.
Martha Larson, Bogdan Ionescu, Xavier Anguera, Maria Eskevich, Pavel Korshunov, Markus Schedl, Mohammad Soleymani, Georgios Petkos, Richard Sutcliffe, Jaeyoung Choi, Gareth J.F. Jones (eds.) Working Notes Proceedings for the MediaEval 2014 Workshop, Barcelona, Catalunya, Spain, October 16-17, 2014, CEUR-WS.org, online http://ceur-ws.org/Vol-1263
Martha Larson, Xavier Anguera, Timo Reuter, Gareth J.F. Jones, Bogdan Ionescu, Markus Schedl, Tomas Piatrik, Claudia Hauff, Mohammad Soleymani (eds). 2013. Working Notes Proceedings of the MediaEval 2013 Multimedia Benchmark Workshop, Barcelona, Spain, October 18-19, 2013. http://ceur-ws.org/Vol-1043
Martha Larson, Sebastian Schmiedeke, Pascal Kelm, Adam Rae, Vasileios Mezaris, Tomas Piatrik, Mohammad Soleymani, Florian Metze, and Gareth J.F. Jones (eds.): Working Notes Proceedings of the MediaEval 2012 Workshop, Pisa, Italy, October 4-5, 2012, CEUR-WS.org, online ceur-ws.org/Vol-927.
Martha Larson, Adam Rae, Claire-Helene Demarty, Christoph Koflerm, Florian Metze, Raphael Troncy, Vasileios Mezaris, and Gareth J.F. Jones (eds.): Working Notes Proceedings of the MediaEval 2011 Workshop, Pisa, Italy, September 1-2, 2011, CEUR-WS.org, online ceur-ws.org/Vol-807.
For public data releases see:
MediaEval Datasets
Example data set published on the Open Science Framework:
Crowdsoring Timed Comments about Music: https://osf.io/h92g8/
Task with public software releases include:
Person Discovery in Broadcast TV 2015
Placing Task 2012