VideOlympics: Real-Time Evaluation of Multimedia Retrieval Systems by Cees Snoek, Marcel Worring, Ork de Rooij, Koen van de Sande, Rong Yan, and Alex Hauptmann has now been published in IEEE MultiMedia. Demo sessions of multimedia retrieval systems are ideal venues to disseminate scientific results. Existing demo sessions, however, fail to engage the audience fully. We argue that real-time evaluation of several multimedia retrieval systems in a single showcase increases impact. We highlight the requirements for such a focused effort and share our experience in organizing the VideOlympics: a real-time evaluation showcase of present day video search engines. We produced a video trailer of the event (in collaboration with Fabchannel), which gives a multimedia impression of the first VideOlympics as recorded on July 10, 2007 at Beeld en Geluid, the Dutch national broadcast archive.

We organize another VideOlympics at CIVR 2008.