Publications

Technical Demonstrations

  1. Spencer Cappallo, Thomas Mensink, and Cees G. M. Snoek, "Query-by-Emoji Video Search," in Proceedings of the ACM International Conference on Multimedia, Brisbane, Australia, 2015.
    @INPROCEEDINGS{CappalloACM15,
      author = {Spencer Cappallo and Thomas Mensink and Cees G. M. Snoek},
      title = {Query-by-Emoji Video Search},
      booktitle = {Proceedings of the {ACM} International Conference on Multimedia},
      pages = {},
      month = {October},
      year = {2015},
      address = {Brisbane, Australia},
      pdf = {http://isis-data.science.uva.nl/cgmsnoek/pub/cappallo-emoji2video-mm2015.pdf},
      demo = {http://www.emoji2video.com},
      abstract = { This technical demo presents Emoji2Video, a query-by-emoji interface for exploring video collections. Ideogram-based video search and representation presents an opportunity for an intuitive, visual interface and concise non-textual summary of video contents, in a form factor that is ideal for small screens. The demo allows users to build search strings comprised of ideograms which are used to query a large dataset of YouTube videos. The system returns a list of the top-ranking videos for the user query along with an emoji summary of the video contents so that users may make an informed decision whether to view a video or refine their search terms. The ranking of the videos is done in a zero-shot, multi-modal manner that employs an embedding space to exploit semantic relationships between user-selected ideograms and the video's visual and textual content. }
    }
  2. Amirhossein Habibian, Masoud Mazloom, and Cees G. M. Snoek, "On-the-Fly Video Event Search by Semantic Signatures," in Proceedings of the ACM International Conference on Multimedia Retrieval, Glasgow, UK, 2014.
    @INPROCEEDINGS{HabibianICMR14c,
      author = {Amirhossein Habibian and Masoud Mazloom and Cees G. M. Snoek},
      title = {On-the-Fly Video Event Search by Semantic Signatures},
      booktitle = {Proceedings of the {ACM} International Conference on Multimedia Retrieval},
      month = {April},
      year = {2014},
      pages = {},
      address = {Glasgow, UK},
      pdf = {http://isis-data.science.uva.nl/cgmsnoek/pub/habibian-on-the-fly-icmr14.pdf},
      abstract = { In this technical demonstration, we showcase an event search engine that facilities instant access to an archive of web video. Different from many search engines which rely on high dimensional low-level visual features to represent videos, we rely on our proposed semantic signature. We extract semantic signature as the detection scores obtained by applying a vocabulary of 1,346 concept detectors on videos. The semantic signatures are compact, semantic and effective, as we will demonstrate for on-the-fly event retrieval using only a few positive examples. In addition, we will show how the signatures provide a crude interpretation on why a certain video has been retrieved. }
    }
  3. Svetlana Kordumova, Christoph Kofler, Dennis C. Koelma, Bouke Huurnink, Bauke Freiburg, Joris Kleinveld, Manuel van Rijn, Marco van Deursen, Martha Larson, and Cees G. M. Snoek, "SocialZap: Catch-up on Interesting Television Fragments Discovered from Social Media," in Proceedings of the ACM International Conference on Multimedia Retrieval, Glasgow, UK, 2014.
    @INPROCEEDINGS{KordumovaICMR14,
      author = {Svetlana Kordumova and Christoph Kofler and Dennis C. Koelma and Bouke Huurnink and Bauke Freiburg and Joris Kleinveld and Manuel van Rijn and Marco van Deursen and Martha Larson and Cees G. M. Snoek},
      title = {SocialZap: Catch-up on Interesting Television Fragments Discovered from Social Media},
      booktitle = {Proceedings of the {ACM} International Conference on Multimedia Retrieval},
      month = {April},
      year = {2014},
      pages = {},
      address = {Glasgow, UK},
      pdf = {http://isis-data.science.uva.nl/cgmsnoek/pub/kordumova-socialzap-icmr14.pdf},
      abstract = { In this paper we present SocialZap, a multimedia search engine that finds the most interesting fragments, zap points, in a television broadcast based on microblog posts and socially tagged photos. The main novelty of SocialZap is the fully-automatic transfer of the learned viewers interest from textual posts to the visual channel, without the need for any manual effort in the process. Once SocialZap finds the zap points, users can easily browse through a television broad- cast and directly watch the interesting fragments. Thus, SocialZap adds social experience to watching television. }
    }
  4. Amirhossein Habibian and Cees G. M. Snoek, "Video2Sentence and Vice Versa," in Proceedings of the ACM International Conference on Multimedia, Barcelona, Spain, 2013.
    @INPROCEEDINGS{HabibianACM13,
      author = {Amirhossein Habibian and Cees G. M. Snoek},
      title = {Video2Sentence and Vice Versa},
      booktitle = {Proceedings of the {ACM} International Conference on Multimedia},
      month = {October},
      year = {2013},
      pages = {},
      address = {Barcelona, Spain},
      pdf = {http://isis-data.science.uva.nl/cgmsnoek/pub/habibian-video2sentence-mm13.pdf},
      abstract = { In this technical demonstration, we showcase a multimedia search engine that retrieves a video from a sentence, or a sentence from a video. The key novelty is our machine translation capability that exploits a cross-media representation for both the visual and textual modality using concept vocabularies. We will demonstrate the translations using arbitrary web videos and sentences related to everyday events. What is more, we will provide an automatically generated explanation, in terms of concept detectors, on why a particular video or sentence has been retrieved as the most likely translation. }
    }
  5. Koen E. A. van de Sande, Cees G. M. Snoek, and Harro M. G. Stokman, "Euvision Technologies: Mining for Images," in IEEE Vision Industry and Entrepreneur Workshop at CVPR, Portland, USA, 2013.
    @INPROCEEDINGS{SandeVIEW13,
      author = {Koen E. A. van de Sande and Cees G. M. Snoek and Harro M. G. Stokman},
      title = {Euvision Technologies: Mining for Images},
      booktitle = {IEEE Vision Industry and Entrepreneur Workshop at CVPR},
      month = {June},
      year = {2013},
      pages = {},
      address = {Portland, USA},
      pdf = {},
      demo = {http://www.euvt.eu},
      abstract = { }
    }
  6. Cees G. M. Snoek, Bauke Freiburg, Johan Oomen, and Roeland Ordelman, "Crowdsourcing Rock N’ Roll Multimedia Retrieval," in Proceedings of the ACM International Conference on Multimedia, Firenze, Italy, 2010.
    @INPROCEEDINGS{SnoekACM10a,
      author = {Cees G. M. Snoek and Bauke Freiburg and Johan Oomen and Roeland Ordelman},
      title = {Crowdsourcing Rock N' Roll Multimedia Retrieval},
      booktitle = {Proceedings of the {ACM} International Conference on Multimedia},
      month = {October},
      year = {2010},
      pages = {},
      address = {Firenze, Italy},
      pdf = {http://isis-data.science.uva.nl/cgmsnoek/pub/snoek-crowdsourcing-acm2010.pdf},
      demo = {http://www.hollandsglorieoppinkpop.nl/html/technologie.html},
      abstract = { In this technical demonstration, we showcase a multimedia search engine that facilitates semantic access to archival rock n' roll concert video. The key novelty is the crowdsourcing mechanism, which relies on online users to improve, extend, and share, automatically detected results in video fragments using an advanced timeline-based video player. The user-feedback serves as valuable input to further improve automated multimedia retrieval results, such as automatically detected concepts and automatically transcribed interviews. The search engine has been operational online to harvest valuable feedback from rock n' roll enthusiasts. }
    }
  7. Cees G. M. Snoek, "The MediaMill Search Engine Video," in Proceedings of the ACM International Conference on Multimedia, Firenze, Italy, 2010.
    @INPROCEEDINGS{SnoekACM10b,
      author = {Cees G. M. Snoek},
      title = {The {MediaMill} Search Engine Video},
      booktitle = {Proceedings of the {ACM} International Conference on Multimedia},
      month = {October},
      year = {2010},
      pages = {},
      address = {Firenze, Italy},
      pdf = {http://isis-data.science.uva.nl/cgmsnoek/pub/snoek-mediamill-video.pdf},
      demo = {http://www.youtube.com/watch?v=IPq_LanED60},
      abstract = { In this video demonstration, we advertise the MediaMill video search engine, a system that facilitates semantic access to video based on a large lexicon of visual concept detectors and interactive video browsers. With an ultimate aim to disseminate video retrieval research to a non-technical audience, we explain the need for a visual video retrieval solution, summarize the MediaMill technology, and hint at future perspectives. }
    }
  8. Ork de Rooij, Cees G. M. Snoek, and Marcel Worring, "MediaMill: Guiding the User to Results using the ForkBrowser," in Proceedings of the ACM International Conference on Image and Video Retrieval, Santorini, Greece, 2009.
    @INPROCEEDINGS{RooijCIVR09,
      author = {Ork de Rooij and Cees G. M. Snoek and Marcel Worring},
      title = {{MediaMill}: Guiding the User to Results using the {ForkBrowser}},
      booktitle = {Proceedings of the {ACM} International Conference on Image and Video Retrieval},
      pages = {},
      month = {July},
      year = {2009},
      address = {Santorini, Greece},
      pdf = {http://isis-data.science.uva.nl/cgmsnoek/pub/rooij-guiding-forkbrowser-civr2009.pdf},
      abstract = { In this technical demonstration we showcase the MediaMill Semantic Video Search Engine. It allows usage of multiple query methods embedded into a single browsing environment while guiding the user to better results by using a novel active learning strategy. This allows for fast and effective search trough large video collections. }
    }
  9. Ork de Rooij, Cees G. M. Snoek, and Marcel Worring, "MediaMill: Fast and Effective Video Search using the ForkBrowser," in Proceedings of the ACM International Conference on Image and Video Retrieval, Niagara Falls, Canada, 2008, pp. 561-561.
    @INPROCEEDINGS{RooijCIVR08b,
      author = {Ork de Rooij and Cees G. M. Snoek and Marcel Worring},
      title = {{MediaMill}: Fast and Effective Video Search using the {ForkBrowser}},
      booktitle = {Proceedings of the {ACM} International Conference on Image and Video Retrieval},
      pages = {561--561},
      month = {July},
      year = {2008},
      address = {Niagara Falls, Canada},
      pdf = {http://isis-data.science.uva.nl/cgmsnoek/pub/rooij-forkbrowser-civr2008.pdf},
      abstract = { In this technical demonstration we showcase the MediaMill ForkBrowser for video retrieval. It embeds multiple query methods into a single browsing environment. We show that users can switch query methods on demand without the need to adapt to a different interface. This allows for fast and effective search trough large video collections. }
    }
  10. Cees G. M. Snoek, Richard van Balen, Dennis C. Koelma, Arnold W. M. Smeulders, and Marcel Worring, "Analyzing Video Concept Detectors Visually," in Proceedings of the IEEE International Conference on Multimedia & Expo, Hannover, Germany, 2008, pp. 1603-1604.
    @INPROCEEDINGS{SnoekICME08,
      author = {Cees G.M. Snoek and Richard van Balen and Dennis C. Koelma and Arnold W.M. Smeulders and Marcel Worring},
      title = {Analyzing Video Concept Detectors Visually},
      booktitle = {Proceedings of the {IEEE} International Conference on Multimedia \& Expo},
      pages = {1603--1604},
      month = {June},
      year = {2008},
      address = {Hannover, Germany},
      pdf = {http://isis-data.science.uva.nl/cgmsnoek/pub/snoek-demo-icme2008.pdf},
      abstract = { In this demonstration we showcase an interactive analysis tool for researchers working on concept-based video retrieval. By visualizing intermediate concept detection analysis stages, the tool aids in understanding the success and failure of video concept detection methods. We demonstrate the tool on the domain of pop concert video. }
    }
  11. Ork de Rooij, Cees G. M. Snoek, and Marcel Worring, "MediaMill: Semantic Video Search using the RotorBrowser," in Proceedings of the ACM International Conference on Image and Video Retrieval, Amsterdam, The Netherlands, 2007, p. 649.
    @INPROCEEDINGS{RooijCIVR07,
      author = {Ork de Rooij and Cees G. M. Snoek and Marcel Worring},
      title = {{MediaMill}: Semantic Video Search using the {RotorBrowser}},
      booktitle = {Proceedings of the {ACM} International Conference on Image and Video Retrieval},
      pages = {649},
      month = {July},
      year = {2007},
      address = {Amsterdam, The Netherlands},
      pdf = {http://isis-data.science.uva.nl/cgmsnoek/pub/rooij-rotorbrowser-civr2007.pdf},
      abstract = { In this technical demonstration we showcase the current version of the MediaMill system, a search engine that facilitates access to news video archives at a semantic level. The core of the system is a thesaurus of 500 automatically detected semantic concepts. To handle such a large thesaurus in retrieval, an engine is developed which automatically selects a set of relevant concepts based on a textual query, and an novel user interface which uses multi dimensional browsing to visualize the result set. }
    }
  12. Ork de Rooij, Cees G. M. Snoek, and Marcel Worring, "MediaMill: Video Query on demand using the RotorBrowser," in Proceedings of the IEEE International Conference on Multimedia & Expo, Beijing, China, 2007, p. 6.
    @INPROCEEDINGS{RooijICME07,
      author = {Ork de Rooij and Cees G. M. Snoek and Marcel Worring},
      title = {{MediaMill}: Video Query on demand using the {RotorBrowser}},
      booktitle = {Proceedings of the {IEEE} International Conference on Multimedia \& Expo},
      pages = {6},
      month = {July},
      year = {2007},
      address = {Beijing, China},
      pdf = {http://isis-data.science.uva.nl/cgmsnoek/pub/rooij-rotorbrowser-icme2007.pdf},
      abstract = { In this technical demonstration we showcase the RotorBrowser, A visualization within MediaMill system which uses query exploration as the basis for search in video archives. }
    }
  13. Cees G. M. Snoek, Marcel Worring, Bouke Huurnink, Jan C. van Gemert, Koen E. A. van de Sande, Dennis C. Koelma, and Ork de Rooij, "MediaMill: Video Search using a Thesaurus of 500 Machine Learned Concepts," in Proceedings of the 1st International Conference on Semantic and Digital Media Technologies, Athens, Greece, 2006.
    @INPROCEEDINGS{SnoekSAMT06,
      author = {Cees G. M. Snoek and Marcel Worring and Bouke Huurnink and Jan C. van Gemert and Koen E. A. van de Sande and Dennis C. Koelma and Ork de Rooij},
      title = {{MediaMill}: Video Search using a Thesaurus of 500 Machine Learned Concepts},
      booktitle = {Proceedings of the 1st International Conference on Semantic and Digital Media Technologies},
      month = {December},
      year = {2006},
      pages = {},
      address = {Athens, Greece},
      pdf = {http://isis-data.science.uva.nl/cgmsnoek/pub/snoek-demo-samt2006.pdf},
      abstract = { In this technical demonstration we showcase the current version of the MediaMill system, a search engine that facilitates access to news video archives at a semantic level. The core of the system is a thesaurus of 500 automatically detected semantic concepts. To handle such a large thesaurus in retrieval, an engine is developed which automatically selects a set of relevant concepts based on the textual query and userspecified example images. The result set can be browsed easily to obtain the final result for the query. }
    }
  14. Marcel Worring, Cees G. M. Snoek, Bouke Huurnink, Jan C. van Gemert, Dennis Koelma, and Ork de Rooij, "The MediaMill Large-lexicon Concept Suggestion Engine," in Proceedings of the ACM International Conference on Multimedia, Santa Barbara, USA, 2006, pp. 785-786.
    @INPROCEEDINGS{WorringACM06,
      author = {Marcel Worring and Cees G. M. Snoek and Bouke Huurnink and Jan C. van Gemert and Dennis Koelma and Ork de Rooij},
      title = {The {MediaMill} Large-lexicon Concept Suggestion Engine},
      booktitle = {Proceedings of the {ACM} International Conference on Multimedia},
      month = {October},
      year = {2006},
      pages = {785--786},
      address = {Santa Barbara, USA},
      pdf = {http://isis-data.science.uva.nl/cgmsnoek/pub/worring-demo-acm2006.pdf},
      abstract = { In this technical demonstration we show the current version of the MediaMill system, a search engine that facilitates access to news video archives at a semantic level. The core of the system is a lexicon of 436 automatically detected semantic concepts. To handle such a large lexicon in retrieval, an engine is developed which automatically selects a set of relevant concepts based on the textual query and example images. The result set can be browsed easily to obtain the final result for the query. }
    }
  15. Marcel Worring, Cees G. M. Snoek, Ork de Rooij, Giang. P. Nguyen, Richard van Balen, and Dennis C. Koelma, "MediaMill: Advanced Browsing in News Video Archives," in Proceedings of the International Conference on Image and Video Retrieval, CIVR 2006, Tempe, Arizona, July 13-15, 2006, Heidelberg, Germany, 2006, pp. 533-536.
    @INPROCEEDINGS{WorringCIVR06,
      author = {Marcel Worring and Cees G. M. Snoek and Ork de Rooij and Giang. P. Nguyen and Richard van Balen and Dennis C. Koelma},
      title = {{MediaMill}: Advanced Browsing in News Video Archives},
      booktitle = {Proceedings of the International Conference on Image and Video Retrieval, CIVR 2006, Tempe, Arizona, July 13-15, 2006},
      editor = {H. Sundaram and others},
      series = {LNCS},
      volume = {4071},
      pages = {533--536},
      publisher = {Springer-Verlag},
      address = {Heidelberg, Germany},
      month = {July},
      year = 2006, pdf = {http://isis-data.science.uva.nl/cgmsnoek/pub/worring-demo-civr2006.pdf},
      abstract = { In this paper we present our Mediamill video search engine. The basis for the engine is a semantic indexing process which derives a lexicon of 101 concepts. To support the user in navigating the collection, the system defines a visual similarity space, a semantic similarity space, a semantic thread space, and browsers to explore them. It extends upon [1] with improved browsing tools. The search system is evaluated within the TRECVID benchmark [2]. We obtain a top-3 result for 19 out of 24 search topics. In addition, we obtain the highest mean average precision of all search participants. }
    }
  16. Cees G. M. Snoek, Marcel Worring, Jan van Gemert, Jan-Mark Geusebroek, Dennis Koelma, Giang P. Nguyen, Ork de Rooij, and Frank Seinstra, "MediaMill: Exploring News Video Archives based on Learned Semantics," in Proceedings of the ACM International Conference on Multimedia, Singapore, 2005, pp. 225-226.
    Best technical demonstration award
    @INPROCEEDINGS{SnoekACM05b,
      author = {Cees G. M. Snoek and Marcel Worring and Jan van Gemert and Jan-Mark Geusebroek and Dennis Koelma and Giang P. Nguyen and Ork de Rooij and Frank Seinstra},
      title = {{MediaMill}: Exploring News Video Archives based on Learned Semantics},
      booktitle = {Proceedings of the {ACM} International Conference on Multimedia},
      pages = {225--226},
      month = {November},
      year = {2005},
      address = {Singapore},
      pdf = {http://isis-data.science.uva.nl/cgmsnoek/pub/snoek-demo-acm2005.pdf},
      demo = {http://isis-data.science.uva.nl/cgmsnoek/index.php/demonstrations/mediamill/},
      note = {Best technical demonstration award},
      abstract = { In this technical demonstration we showcase the MediaMill system. A search engine that facilitates access to news video archives at a semantic level. The core of the system is an unprecedented lexicon of 100 automatically detected semantic concepts. Based on this lexicon we demonstrate how users can obtain highly relevant retrieval results using query-by-concept. In addition, we show how the lexicon of concepts can be exploited for novel applications using advanced semantic visualizations. Several aspects of the MediaMill system are evaluated as part of our TRECVID 2005 efforts. }
    }
  17. Cees G. M. Snoek, Dennis Koelma, Jeroen van Rest, Nellie Schipper, Frank J. Seinstra, Andrew Thean, and Marcel Worring, "MediaMill: Searching Multimedia Archives based on Learned Semantics," in Proceedings of the IEEE International Conference on Multimedia & Expo, Amsterdam, The Netherlands, 2005.
    @INPROCEEDINGS{SnoekICME05b,
      author = {Cees G. M. Snoek and Dennis Koelma and Jeroen van Rest and Nellie Schipper and Frank J. Seinstra and Andrew Thean and Marcel Worring},
      title = {{MediaMill}: Searching Multimedia Archives based on Learned Semantics},
      booktitle = {Proceedings of the {IEEE} International Conference on Multimedia \& Expo},
      pages = {},
      month = {July},
      year = {2005},
      address = {Amsterdam, The Netherlands},
      pdf = {},
      demo = {http://isis-data.science.uva.nl/cgmsnoek/index.php/demonstrations/mediamill/},
      abstract = { Video is about to conquer the Internet. Real-time delivery of video content is technically possible to any desktop and mobile device, even with modest connections. The main problem hampering massive (re)usage of video content today is the lack of effective content based tools that provide semantic access. In this contribution we discuss systems for both video analysis and video retrieval that facilitate semantic access to video sources. Both systems were evaluated in the 2004 TRECVID benchmark as top performers in their task. }
    }
  18. Cees G. M. Snoek and Marcel Worring, "Goalgle: A Soccer Video Search Engine," in Proceedings of the IEEE International Conference on Multimedia & Expo, Baltimore, USA, 2003.
    @INPROCEEDINGS{SnoekICME03b,
      author = {Cees G. M. Snoek and Marcel Worring},
      title = {Goalgle: A Soccer Video Search Engine},
      booktitle = {Proceedings of the {IEEE} International Conference on Multimedia \& Expo},
      pages = {},
      month = {July},
      year = {2003},
      address = {Baltimore, USA},
      pdf = {http://isis-data.science.uva.nl/cgmsnoek/pub/goalgle.pdf},
      demo = {http://www.goalgle.com/},
      abstract = { \textit{Goalgle} is a prototype search engine for soccer video. Browsing and retrieval functionality is provided by means of a web based interface. This interface allows users to jump to video segments from a collection of prerecorded and analyzed soccer matches based on queries on specific players, events, matches, and/or text. In this contribution we discuss the system architecture and functionality of the \textit{Goalgle} soccer video search engine. }
This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author’s copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Comments are closed.