Personal Details

Name

• Prof. dr. Cees G.M. Snoek

Office

• Video & Image Sense Lab
  Informatics Institute
  University of Amsterdam
  Science Park 904
  P.O. Box 94323
  1098 GH Amsterdam
  The Netherlands

Contact

• E: cgmsnoek AT uva DOT nl
  T: +31-(0)20-525-7528
  F: +31-(0)20-525-7490
  W: http://www.CeesSnoek.info

Education

Doctorate

• January 2001 – October 2005
  Computer Science, University of Amsterdam.
  Title of thesis: The Authoring Metaphor to Machine Understanding of Multimedia.
  Advisors: prof. dr. ir. Arnold W.M. Smeulders and dr. Marcel Worring.

Master’s

• September 1996 – October 2000
  Business Information Systems, University of Amsterdam.
  Title of thesis: Camera Distance Classification: Indexing Video Shots based on Visual Features.
  Advisor: dr. Jeroen Vendrig.

Miscellaneous

• April 2012 – June 2013
  Junior ambassadors class, offered by the Dean of the Faculty of Science, University of Amsterdam.
• March 2010 – May 2010
  Science Correspondence Course. SCW – Dutch Foundation for Science Correspondence.
• January 2009 – November 2009
  Professionalism, offered to VENI laureates by the Rector Magnificus of the University of Amsterdam.
• October 2008 – June 2009
  Certificate Programme in Learning & Teaching in Higher Education, University of Amsterdam.
  Through a seven-sessions course I have demonstrated, documented, and passed the Dutch university-level teaching program (In Dutch: Basiskwalificatie onderwijs, BKO).
• January 2008 – December 2008
  Various professional workshops on topics like media training, intellectual property rights, and introduction to leadership.

Professional Appointments

Academic Research

• January 2018 – present
  Full Professor, University of Amsterdam, the Netherlands.
• July 2013 – December 2017
  Associate Professor, University of Amsterdam, the Netherlands.
• July 2011 – June 2013
  Assistant Professor, University of Amsterdam, the Netherlands.
• August 2010 – February 2011
  Fulbright Junior Scholar at Jitendra Malik’s lab, U.C. Berkeley, Berkeley, CA, USA.
• January 2009 – December 2012
  VENI research fellow, University of Amsterdam, the Netherlands.
• January 2005 – December 2008
  Postdoctoral researcher, University of Amsterdam, the Netherlands.
• April-October 2003
  Visiting researcher at Informedia, Carnegie Mellon University, Pittsburgh, PA, USA.
• January 2001 – December 2004
  Doctorate research, University of Amsterdam, the Netherlands.

Public-Private Research

• November 2019 – present
  Scientific Director, Atlas Lab with TomTom.
• October 2019 – present
  Scientific Director, AIM Lab with Inception Institute of Artificial Intelligence.
• April 2018 – present
  Co-Founder, Innovation Center for Artificial Intelligence.
• May 2015 – present
  Scientific Director, QUVA Lab with Qualcomm Technologies.

Industry Research

• April 2018 – present
  Chief Scientific Officer, Kepler Vision Technologies.
• June 2016 – December 2017
  Principal Engineer/Manager, Qualcomm Technologies.
• September 2014 – May 2016
  Principal Engineer, Qualcomm Technologies.
• July 2011 – September 2014
  Head of R&D, Euvision Technologies.

Research Management

• June 2019 – present
  Management Team, Advanced School for Computing and Imaging.

Education Management

• June 2018 – present
  Director Master Artificial Intelligence, University of Amsterdam.
• April 2018 – April 2019
  Coordinator Honours Program Bachelor Artificial Intelligence, University of Amsterdam.
• March 2014 – September 2014
  Member Examinations Board Information Studies, University of Amsterdam.

Professional Service

Associate Editorship

• 2021
• Computer Vision and Image Understanding
• IEEE Transactions on Pattern Analysis and Machine Intelligence

• 2020
• Computer Vision and Image Understanding
• IEEE Transactions on Pattern Analysis and Machine Intelligence

• 2019-2017
• ACM Transactions on Multimedia

• 2016
• ACM Transactions on Multimedia
• IEEE MultiMedia

• 2015-2012
• IEEE MultiMedia
• IEEE Transactions on Multimedia

• 2011
• IEEE MultiMedia

Organization

• 2021
• Area Chair, Conference on Computer Vision and Pattern Recognition.

• 2020
• Area Chair, European Conference on Computer Vision.
• Brave New Ideas Chair, ACM International Conference on Multimedia.
• Co-Organizer, CVPR Workshop on ActivityNet
• Track Chair, International Conference on Pattern Recognition.

• 2019
• Area Chair, International Conference on Computer Vision.
• Area Chair, ACM International Conference on Multimedia.
• Area Chair, British Machine Vision Conference.
• Co-Organizer, CVPR Workshop on ActivityNet.
• Program Chair: International Conference on Image Analysis and Processing.
• Tutorial Chair, ACM International Conference on Multimedia Retrieval.

• 2018
• Area Chair, British Machine Vision Conference.
• Co-Organizer, CVPR Workshop on ActivityNet.

• 2017
• Program Co-Chair, ACM International Conference on Multimedia Retrieval.
• Co-Organizer, CVPR Workshop on ActivityNet.
• Area Chair, ACM International Conference on Multimedia.
• Area Chair, British Machine Vision Conference.
• Area Chair, International Conference on Computer Vision.

• 2016
• General Co-Chair, ACM International Conference on Multimedia.
• Co-Organizer, CVPR Workshop on ActivityNet.
• Demo Chair, ACM International Conference on Multimedia Retrieval.

• 2015
• Program Co-Chair, ACM International Conference on Multimedia Retrieval.
• Doctoral Symposium Co-Chair, ACM International Conference on Multimedia.
• Area Chair, ACM International Conference on Multimedia.

• 2014
• General Co-Chair, Netherlands Conference on Computer Vision.
• Program Co-Chair, Pacific-Rim Conference on Multimedia.
• Tutorial Co-Chair, ACM International Conference on Multimedia Retrieval.
• Area Chair, ACM International Conference on Multimedia.
• Area Chair, IEEE International Conference on Multimedia & Expo.
• Area Chair, IEEE International Conference on Image Processing.

• 2013
• Area Chair, IEEE International Conference on Multimedia & Expo.
• Co-Organizer, IST/SPIE (Electronic Imaging), Multimedia Content Access: Algorithms and Systems.
• Program Co-Chair, ACM International Conference on Internet Multimedia Computing and Services.
• Demo Chair, ACM International Conference on Multimedia Retrieval.

• 2012
• Area Chair, ACM International Conference on Multimedia.
• Co-Organizer, Video Browser Showdown at International Conference on MultiMedia Modeling.
• Co-Organizer, Special session on Socio-Video Semantics, ACM International Conference on Multimedia Retrieval.
• Co-Organizer, IST/SPIE (Electronic Imaging), Multimedia Content Access: Algorithms and Systems.
• Co-Organizer, Workshop on Web-scale Vision and Social Media at European Conference on Computer Vision.
• Co-Organizer, Workshop on Socially-Aware Multimedia at ACM International Conference on Multimedia.
• Guest-editor, Computer Vision and Image Understanding, special issue on Learning from Multiple Evidences for Large Scale Multimedia Analysis.
• Demo Chair, International Conference on MultiMedia Modeling.
• Demo Chair, ACM International Conference on Multimedia Retrieval.

• 2011
• Area Chair, ACM International Conference on Multimedia.
• Co-Organizer, IST/SPIE (Electronic Imaging), Multimedia Content Access: Algorithms and Systems.
• Demo Chair, ACM International Conference on Multimedia Retrieval.

• 2010
• Program Co-Chair, International Workshop on Content-Based Multimedia Indexing.
• Co-Chair, Multimedia Grand Challenge at ACM Multimedia.
• Co-Organizer, Workshop on Multimedia Data Mining at ACM SIGKDD conference on Knowledge Discovery and Data Mining.
• Co-Organizer, IST/SPIE (Electronic Imaging), Multimedia Content Access: Algorithms and Systems.

• 2009
• Co-Organizer, VideOlympics Video Retrieval Showcase Event at ACM International Conference on Image and Video Retrieval.
• Co-Organizer, Workshop on Internet Multimedia Mining at IEEE International Conference on Data Mining.
• Publicity Chair, ACM International Conference on Internet Multimedia Computing and Services.

• 2008
• Co-Organizer, VideOlympics Video Retrieval Showcase Event at ACM International Conference on Image and Video Retrieval.
• Co-Organizer, Special session on Challenges in Interactive Video Search, ACM International Conference on Image and Video Retrieval.

• 2007
• Co-Organizer, VideOlympics Video Retrieval Showcase Event at ACM International Conference on Image and Video Retrieval.
• Local Chair, ACM International Conference on Image and Video Retrieval.

Program Committee Member

• 2020
• IEEE International Conference on Computer Vision and Pattern Recognition
• Conference on Neural Information Processing Systems
• British Machine Vision Conference.

• 2019
• IEEE International Conference on Computer Vision and Pattern Recognition

• 2018
• IEEE International Conference on Computer Vision and Pattern Recognition
• European Conference on Computer Vision
• ACM International Conference on Multimedia
• ACM International Conference on Multimedia Retrieval
• Conference on Neural Information Processing Systems

• 2017
• IEEE International Conference on Computer Vision and Pattern Recognition

• 2016
• IEEE International Conference on Computer Vision and Pattern Recognition
• Conference on Neural Information Processing Systems

• 2015
• IEEE International Conference on Computer Vision
• IEEE International Conference on Computer Vision and Pattern Recognition
• International Joint Conference on Artificial Intelligence

• 2014
• European Conference on Computer Vision
• IEEE International Conference on Computer Vision and Pattern Recognition
• CVPR Workshop on Web-scale Vision and Social Media

• 2013
• ACM International Conference on Multimedia
• IEEE International Conference on Computer Vision and Pattern Recognition
• International MultiMedia Modeling Conference
• ACM SIGIR Conference
• IEEE International Workshop on Multimedia Signal Processing
• Pacific-Rim Conference on Multimedia
• CVPR Workshop on Language for Vision
• ICCV Workshop on Action Recognition with Large Number of Classes
• ICCV Workshop on Large-Scale Video Search and Mining

• 2012
• European Conference on Computer Vision
• IEEE International Conference on Computer Vision and Pattern Recognition
• International Conference on Multimedia and Ubiquitous Engineering
• International MultiMedia Modeling Conference
• International Workshop on Large-Scale Video Search and Mining
• International Workshop on Image Analysis for Multimedia Interactive Services
• Workshop on Social Media Applications in News and Entertainment

• 2011
• ACM International Conference on Multimedia Retrieval
• IEEE International Conference on Computer Vision
• IEEE International Conference on Computer Vision and Pattern Recognition
• IEEE International Conference on Multimedia & Expo
• IEEE International Conference on Multimedia and Ubiquitous Engineering
• International ACM Workshop on Social Media
• International MultiMedia Modeling Conference
• International Workshop on Content-Based Multimedia Indexing
• Pacific-Rim Conference on Multimedia
• Dutch ICT.open conference

• 2010
• ACM International Conference on Multimedia
• ACM International Conference on Multimedia Information Retrieval
• ACM SIGIR Conference
• European Conference on Computer Vision
• IEEE International Conference on Computer Vision and Pattern Recognition
• IEEE International Conference on Image Processing
• IEEE International Conference on Pattern Recognition
• International MultiMedia Modeling Conference
• International Conference on Internet Multimedia Computing and Service
• International Conference on Embedded and Multimedia Computing
• SIGMM Workshop on Social Media
• Workshop on Very-Large-Scale Multimedia Corpus, Mining and Retrieval
• Dutch Conference of the Advanced School for Computing and Imaging

• 2009
• ACM International Conference on Internet Multimedia Computing and Service
• ACM International Conference on Multimedia
• ACM International Conference on Image and Video Retrieval
• ACM SIGIR Conference
• IEEE International Conference on Computer Vision
• IEEE International Conference on Computer Vision and Pattern Recognition
• IEEE International Conference on Image Processing
• International MultiMedia Modeling Conference
• International Conference on Digital Information Management
• International Conference on Semantic And digital Media Technologies
• SIGMM Workshop on Social Media
• IEEE International Workshop on Data Semantics for Multimedia Systems and Applications
• IJCAI Workshop on Cross-Media Information Access and Mining
• IADIS International Conference on Visual Communication
• Dutch Conference of the Advanced School for Computing and Imaging

• 2008
• ACM International Conference on Multimedia
• ACM International Conference on Image and Video Retrieval
• IEEE International Conference on Image Processing
• International MultiMedia Modeling Conference
• International Conference on Semantic And digital Media Technologies
• IADIS International Conference on Visual Communication
• Visual Information Processing Workshop
• Dutch Conference of the Advanced School for Computing and Imaging

• 2007
• ACM International Conference on Multimedia
• International MultiMedia Modeling Conference
• IEEE Workshop on Motion & Video Computing
• Belgian-Dutch Benelearn Conference

• 2006
• IEEE International Conference on Multimedia & Expo

• 2005
• IEEE International Conference on Multimedia & Expo

Reviewer International Journals

• ACM Computing Surveys
• ACM Transactions on Information Systems
• ACM Transactions on Intelligent Systems and Technology
• ACM Transactions on Multimedia Computing, Communications and Applications
• Applied Ontology
• Artificial Intelligence
• Computer Vision and Image Understanding
• EURASIP Journal on Image and Video Processing
• IEEE Computer
• IEEE Computer Graphics and Applications
• IEEE Intelligent Systems
• IEEE Multimedia
• IEEE Pervasive Computing
• IEEE Signal Processing Letters
• IEEE Transactions on Circuits and Systems for Video Technology
• IEEE Transactions on Image Processing
• IEEE Transactions on Multimedia
• IEEE Transactions on Pattern Analysis and Machine Intelligence
• Image and Vision Computing
• Information Retrieval
• Information Sciences
• International Journal of Computer Vision
• International Journal of Systems Science
• Journal of Electronic Imaging
• Journal of Web Semantics
• Machine Vision and Applications
• Multimedia Systems
• Multimedia Tools and Applications
• Pattern Recognition
• Pattern Recognition Letters
• Proceedings of the IEEE
• Signal, Image and Video Processing
• Signal Processing
• The Computer Journal
• The Visual Computer

Proposal and Project Reviewer

• ERC Consolidator Grant 2019
• NWO TTW Vidi 2017 committee
• ERC Consolidator Grant 2017
• STW Vidi 2016 committee
• NWO TOP 2016 committee
• ERC Starting Grant 2016
• ERC Consolidator Grant 2015
• STW Veni 2015 committee
• European Commission – FP7 project review
• Czech Science Foundation
• Portuguese Foundation for Science and Technology
• Qatar National Research Fund
• The Austrian Science Fund
• Fulbright Graduate Student Scholarships 2014 committee
• Fulbright Graduate Student Scholarships 2013 committee

Professional Memberships

International

• ACM: Association for Computing Machinery, Senior Member
• ACM SIGMM: ACM Special Interest Group Multimedia
• ELLIS: European Laboratory for Learning and Intelligent Systems, Member
• IEEE: Institute of Electrical and Electronics Engineers, Senior Member

National

• ASCI: Advanced School for Computing and Imaging
• NVPHBV: Dutch Association for Pattern Recognition and Image Processing

Educational Activities

International Professional Tutorials

• Unseen Video Understanding. IPM, Iran, 2020.
• Unseen Video Understanding. Large Scale Holistic Video Understanding Tutorial @ CVPR, 2020.
• Activity Understanding, International Conference on Image Processing Theory, Tools and Application, 2019.
• Video Recognition and Retrieval at the TRECVID Benchmark, European Conference on Computer Vision, 2018.
• Image Tag Assignment, Refinement and Retrieval, ICIAP, 2017.
• Zero-shot learning for computer vision, IEEE Conference on Computer Vision and Pattern Recognition, 2017.
• Video Indexing, Search, Detection, and Description with Focus on TRECVID, International Conference on Multimedia Retrieval, 2017.
• Zero-shot learning for vision and multimedia, European Conference on Computer Vision, 2016.
• Image Tag Assignment, Refinement and Retrieval, IEEE Conference on Computer Vision and Pattern Recognition, 2016.
• Basics of Neural Networks, Deep Learning Summer School on Integrating Vision and Language, 2016.
• Image Tag Assignment, Refinement and Retrieval, ACM Multimedia, 2015.
• What happens where in video?, International Computer Vision Summer School, 2015.
• Internet Video Search, European Conference on Computer Vision, 2012.
• Internet Video Search, ACM International Conference on Multimedia, 2011.
• Video Search Engines, ACM International Conference on Multimedia, 2010.
• Video Search Engines, Summer School on Multimedia Semantics, 2010.
• Video Search Engines, IEEE Conference on Computer Vision and Pattern Recognition, 2010.
• Interactive Video Retrieval, AERFAI Summer School on Pattern Recognition and Machine Learning in Multimedia Systems, 2010.
• Video Search Engines, IEEE Signal Processing Society, Tunisia, 2009.
• Coloring Visual Search, IEEE International Conference on Computer Vision, 2009.
• Video Analysis and Retrieval, International Summer School on Multimedia Semantics, 2009.
• Video Search Engines, IEEE Conference on Computer Vision and Pattern Recognition, 2009.
• Concept-based Video Retrieval, Pacific-Rim Symposium on Image and Video Technology, 2009.
• Semantic Indexing and Retrieval of Video, IEEE International Conference on Pattern Recognition, 2008.
• Concept-based Video Retrieval, Summer School on Image Processing, 2008.
• Semantic Indexing and Retrieval of Video, IEEE International Conference on Multimedia & Expo, 2008.
• Semantic Indexing and Retrieval of Video, Swiss School of the 3eme cycle romand in Informatics, 2007.
• Concept-based Video Indexing and Retrieval, International Summer School on Multimedia Semantics Analysis, Annotation, Retrieval and Applications, 2007.
• Semantic Indexing and Retrieval of Video, International Conference on Semantic and Digital Media Technologies, 2006.
• Semantic Indexing and Retrieval of Video, ACM International Conference on Multimedia, 2006.

University Courses

• Computer Vision by Learning. Advanced School for Computing and Imaging, 2019.
• Computer Vision by Learning. Advanced School for Computing and Imaging, 2017.
• Advanced Topics in Computer Vision. University of Amsterdam, 2014.
• Computer Vision by Learning. Advanced School for Computing and Imaging, 2014.
• Visual Search Engines. University of Amsterdam, 2014.
• Multimedia Information Systems. University of Amsterdam, 2013.
• Multimedia Retrieval. Advanced School for Computing and Imaging, 2011.
• Text Mining and Collective Intelligence. Amsterdam University College, 2011.
• Visual Search Engines. University of California at Berkeley, 2010.
• Text Mining for Business Applications. University of Amsterdam, 2010.
• Intelligent Multimedia Systems. University of Amsterdam, 2009.
• Personalized Information Delivery. University of Amsterdam, 2008.
• Multimedia Retrieval. Advanced School for Computing and Imaging, 2007.
• Personalized Information Delivery. University of Amsterdam, 2007.
• Personalized Information Delivery. University of Amsterdam, 2006.

Post-Doctoral Supervision

• Hazel Doughty, 2020-
• Amir Ghodrati, 2017-2019
  Amir is currently at Qualcomm AI Research, Netherlands.
• Pascal Mettes, 2017-2019
  Pascal is currently an Assistant Professor at University of Amsterdam.
• Zhenyang Li, 2016-2018
  Zhenyang is currently at Baidu, China.
• Thomas Mensink, 2013-2016
  Thomas was awarded a VENI in 2015 and is currently at Google AI, Netherlands.
• Mihir Jain, 2014-2016
  Mihir is currently at Qualcomm AI Research, Netherlands.
• Jan van Gemert, 2013-2015
  Jan is currently an Associate Professor at Delft University of Technology.
• Koen E.A. van de Sande, 2011-2014.
  Koen is currently at Kepler Vision Technologies, Netherlands.
• Xirong Li, 2011-2012.
  Xirong is currently an Associate Professor at Renmin University of China.

Ph.D. Thesis Supervision

• QUVA Lab vacancy, 2021-2025.
• QUVA Lab vacancy, 2021-2025.
• QUVA Lab vacancy, 2021-2025.
• Sarah Rastegar, 2020-2024.
• Duy Kien Nguyen, 2020-2024.
• Aritra Bhowmik, 2020-2024.
• Zehao Xiao, 2020-2024.
• Yingjun Du, 2020-2024.
• Mohammad Mehdi Derakhshani, 2020-2024.
• Yunhua Zhang, 2019-2023.
• Fida Mohammad Thoker, 2019-2023.
• David Zhang, 2019-2023.
• Tao Hu, 2018-2022.
• Zenglin Shi, 2018-2022.
• Shuo Chen, 2018-2022.
• Jiaojiao Zhao, 2017-2021.
• William Thong, 2016-2020.
• Tom Runia, Recurrent Motion in Vision, 2016-2020.
  Tom is currently at Apple, Switzerland.
• Kirill Gavrilyuk, 2015-2019.
• Shuai Liao, 2015-2019.
• Spencer Cappallo, Predicting Visual Trends, 2013-2017.
  Spencer is currently at Replicant, Canada.
• Pascal Mettes, Objects for Spatio-Temporal Activity Recognition in Videos, 2013-2017.
  Pascal is currently an Assistant Professor at the University of Amsterdam.
• Zhenyang Li, Exploring Locality for Visual Recognition, 2012-2016.
  Zhenyang is currently at Baidu, China.
• Svetlana Kordumova, Learning to Search for Images without Annotations, 2011-2015. Lana is founding CEO of Pixyle.ai and an Assistant Professor at Goce Delčev University of Štip.
• Amirhossein Habibian, Storytelling Machines for Video Search, 2011-2015.
  Amir is currently at Qualcomm AI Research, Netherlands.
• Masoud Mazloom, In Search of Video Event Semantics, 2011-2015.
  Masoud is currently at ABN-AMRO, Netherlands.
• Efstratios Gavves, Nuances in Visual Recognition, 2008-2012.
  Stratis is currently an Associate Professor at the University of Amsterdam and recipient of an ERC Starting Grant.
• Xirong Li, Content-Based Visual Search Learned from Social Media, 2007-2011.
  Xirong is recipient of the SIGMM Best Ph.D. Thesis Award 2013.
  Xirong is currently an Associate Professor at Renmin University of China.

International Visitors

• Pengwan Yang, Peking University, 2020.
• Teng Long, University of Electronic Science and Technology of China, 2019.
• Federico Landi, Università di Modena e Reggio Emilia, Italy, 2018.
• Mihir Jain, Inria, France, 2013.
• Yu-Gang Jiang, Fudan University, China, 2011.

Industry Interns

• Victor Escorcia, KAUST, Saudi Arabia, 2017.
• Joe Yue-Hei Ng, University of Maryland, College Park, USA, 2016.
• Eren Golge, Bilkent University, Turkey, 2015.

Member of the Ph.D. Committee

• Wendy Shang, University of Amsterdam, January 2021.
• Ali Diba, KU Leuven, 2020.
• Noureldien Hussein, University of Amsterdam, 2020.
• Tom Runia, Recurrent Motion in Vision, University of Amsterdam, 2020.
• Noortje Seijdel, Object Recognition Put in Context, University of Amsterdam, 2020.
• Harrie Oosterhuis, Learning from User Interactions with Rankings, University of Amsterdam, November 2020.
• Dan Li, Effective Collection Construction for IR Evaluation and Optimization, University of Amsterdam, November 2020.
• Praveen Dakwale, Exploring Strategies for Effective Utilization of Training Data for Machine Translation, University of Amsterdam, October 2020.
• Peter O’Connor, Biologically Plausible Deep Learning, University of Amsterdam, September 2020.
• David Semedo, Bridging Vision and Language over Time with Neural Cross-modal Embeddings, NOVA University of Lisbon, July 2020.
• Nuno Cruz Garcia, Learning with Privileged Information using Multimodal Data, Universita di Genova, November 2019.
• Davide Moltisanti, On the Impact of Action Boundaries for Video Recognition, University of Bristol, November 2019.
• Jun Xiao, Improving Application Timing Predictability and Caching Performance on Multi-core Systems, University of Amsterdam, October 2019.
• Kyriacos Shiarlis, Detaching the strings: Practical algorithms for Learning from Demonstration, University of Amsterdam, September 2019.
• Fabian Caba, Understanding Human Activities at Large Scale. King Abdullah University of Science and Technology, March 2019.
• Guilhem Chéron, Structured modeling and recognition of human actions in video. École Normale Supérieure de Paris/Inria, December 2018.
• Riste Gligorov, Serious Games in Audio-Visual Collections. Vrije University Amsterdam, November 2018.
• Fabian Flohr, Vulnerable Road User Detection and Orientation Estimation for Context-Aware Automated Driving, University of Amsterdam, 2018.
• Spencer Cappallo, Predicting Visual Trends, University of Amsterdam, 2018.
• Joern Jacobsen, Structured Convolutional Networks. University of Amsterdam, 2018.
• Wenjie Pei, Models for Supervised Learning on Sequence Data. Delft University of Technology, 2018.
• Maaike de Boer, Semantic Mapping in Video Retrieval. Radboud University Nijmegen, 2017.
• Alessio Bazzica, Music Information Retrieval beyond Audio. Delft University of Technology, 2017.
• Zhenyang Li, Exploring Locality for Visual Recognition. University of Amsterdam, December 2017.
• Pascal Mettes, Objects for Spatio-Temporal Activity Recognition in Videos. University of Amsterdam, December 2017.
• Maurice Peemen, Improving the Efficiency of Deep Convolutional Neural Networks. Eindhoven University of Technology, 2017.
• Ork de Rooij, Interactive Content-Based Visualizations for Multimedia Search. University of Amsterdam, 2017.
• Jan Zahálka, The Machine in Mulimedia Analytics. University of Amsterdam, July 2017.
• Ali Sharif Razavian, Convolutional Network Representation for Visual Recognition. Royal Institute of Technology (KTH), January 2017.
• Ran Tao, Visual Instance Search from One Example. University of Amsterdam, January 2017.
• Silvia-Laura Pintea, Continuous Learning in Computer Vision. University of Amsterdam, January 2017.
• Sezer Karaoglu. Recognition and Detection of Objects Using Visual and Textual Cues. University of Amsterdam, December 2016.
• Svetlana Kordumova, Learning to Search for Images without Annotations. University of Amsterdam, November 2016.
• Amirhossein Habibian, Storytelling Machines for Video Search. University of Amsterdam, September 2016.
• Masoud Mazloom, In Search of Video Event Semantics. University of Amsterdam, September 2016.
• Daan Odijk, Context & Semantics in News & Web Search. University of Amsterdam, June 2016.
• Fares Alnajar, Automatic Age and Gaze Estimation under Uncontrolled Conditions. University of Amsterdam, January 2016.
• Andrej Mikulik, Large-Scale Content-Based Sub-Image Search. Czech Technical University in Prague, July 2015.
• Dan Oneata, Robust and efficient models for action recognition and localization. Universite de Grenoble/Inria, July 2015.
• Ben van Werkhoven, Scientific Supercomputing with Graphics Processing Units, VU University Amsterdam, October 2014.
• Efstratios Gavves, Nuances in Visual Recognition, University of Amsterdam, September 2014.
• Zhigang Ma, From Concepts to Events: A Progressive Process for Multimedia Content Analysis, University of Trento, December 2013.
• Stevan Rudinac, Advancing the Relevance Criteria for Video Search and Visual Summarization, Delft University of Technology, May 2013.
• Simon Carter, Exploration and Exploitation of Multilingual Data for Statistical Machine Translation, University of Amsterdam, December 2012.
• Xirong Li, Content-Based Visual Search Learned from Social Media, University of Amsterdam, March 2012.
• Koen van de Sande, Invariant Color Descriptors for Efficient Object Recognition, University of Amsterdam, December 2011.
• Jasper Uijlings, The What and Where in Visual Object Recognition, University of Amsterdam, December 2011.
• Bouke Huurnink, Search in Audiovisual Broadcast Archives, University of Amsterdam, November 2010.

M.Sc. Thesis Supervision

• M. van Rijn, Face Anonymisation in Face Detector Training Data, September 2020.
• A. Gansekoele, The Fisher-Watson Detector for Out-of-Distribution and Adversarial Detection, July 2020.
• T. van Dijk, Ball-I3D: Localizing Footballs from Player Coordinates, October 2019.
• E. Machielse, Video Summarizaton by Learning from a Direct Ground-truth, September 2019.
• J. Verhagen, PixelLink++: Adversarial Detection of Text in the Wild, July 2019.
• M. Nagel, Meta Fisher Vectors for generative encoding of visual streams, January 2015.
• B. van de Poel, Evaluating Visual Representations for Video Event Retrieval, December 2012.
• E.A. van Beijsterveldt, Searching Television Fragments Using Micro-Blogs, September 2012.
• D. Modolo, Towards Semantic Representations for Event Detection and Segmentation, December 2011.
• J. Steggink, Adding Semantics to Image Region Annotations with the Name-It-Game, June 2009.
• A. Setz, Can Social Tagged Images Aid Concept-Based Video Search?, April 2009.
• R. Nijdam, A Performance Evaluation of Concept-Based Video Genre Classification Components, October 2007.
• J. Damman, Using a Category System in an Online Annotation Game, September 2007.
• T. van Dijk, The Potential of Social Tagged Data for Visual Indexing, July 2007.
• K.E.A. van de Sande, Coloring Concept Detection in Video using Interest Regions, April 2007.
• L. van der Zande, On the Effectiveness of Query-Concept-Dependent Video Search, June 2006.
• J. Edens, Towards Combining Automatic, Semi-automatic, and Manual Annotation for Semantic Narrowcast Video Retrieval, June 2006.
• A. Algoe, People Annotation in Frequent-Face Videos, October 2004.

B.Sc. Thesis Supervision

• J. Rots, Detecting explosive ATM attacks, July 2019.
• H. Scholtens, A Text-Based Framework for Generic Person X Annotation in Broadcast News Video, August 2005.

Invited Presentations

International

• MM Workshop on Human-centric Multimedia Analysis, Seattle, October 2020.
• SRI International, New Jersey, September 2020.
• Huawei International Video Intelligence Forum, Dublin, Ireland, September 2020.
• Samsung AI Center Cambridge, UK, June 2020.
• Bilkent University, Ankara, Turkey, November 2019.
• Qualcomm, Seoul, Korea, November 2019.
• ICCV Workshop on Learning Concepts – Zero-Shot, One-Shot, Few-Shot and Beyond, Seoul, Korea, October 2019.
• ICCV Workshop on Video Retrieval Methods and Their Limits, Seoul, Korea, October 2019.
• ICCV Workshop on Large-Scale Video Understanding, Seoul, Korea, October 2019.
• ICCV Workshop on Multi-modal video analysis, Seoul, Korea, October 2019.
• ICCV Workshop Toward Human-Level Video Story Understanding, October 2019.
• BMVA Symposium on Video Understanding, London, UK, September 2019.
• CVPR Workshop on Multi-modal learning from videos, Long Beach, USA, June 2019.
• Facebook AI Video Summit, Los Angeles, USA, June 2019.
• Huawei, Shenzhen, China, May 2019.
• IIT-PAVIS, Genoa, Italy, May 2019.
• Holland Innovation Seminar, Singapore, February 2019.
• WACV Workshop on Human Activity Detection in Multi-Camera, Continuous, Long-Duration Video, Hawaii, USA, January 2019.
• International Conference on Big Scientific Data Management, Beijing, China, November 2018.
• Renmin University, Beijing, China, November 2018.
• CVPR Workshop on Video Understanding, Salt Lake City, USA, June 2018.
• Qualcomm, San Diego, USA, June 2018.
• Machines Can See Conference, Moscow, Russia, June 2018.
• EuropeanaTech Conference, Rotterdam, the Netherlands, May 2018.
• Qualcomm Innovation Fellowship, Amsterdam, the Netherlands, May 2018.
• University of Bristol, Bristol, UK, November 2017.
• CVPR Workshop on Brave New Motion, Honolulu, USA, July 2017.
• Frontiers of Video Technology Workshop, San Jose, USA, July 2017.
• Royal Institute of Technology (KTH), Stockholm, Sweden, January 2017.
• ECCV Workshop on Storytelling with Images and Videos, Amsterdam, The Netherlands, October 2016.
• CVPR Workshop on Deep Vision, Las Vegas, USA, June 2016.
• Cannes Lions International Festival of Creativity, Cannes, France, June 2016.
• Blippar, London, UK, April 2016.
• ICCV Workshop on Web-scale Vision and Social Media, Santiago, Chile, December 2015.
• MM Workshop on Human-Centered Event Understanding from Multimedia, Brisbane, Australia, October 2015.
• SIGMM Multimedia Frontier Workshop, Brisbane, Australia, October 2015.
• Re.Work Deep Learning Summit, London, UK, September 2015.
• Inria-LEAR, Grenoble, France, July 2015.
• Qualcomm, San Diego, USA, October 2014.
• ECCV Workshop on THUMOS Challenge: Action Recognition with a Large Number of Classes, Zürich, Switzerland, September 2014.
• ECCV Workshop on Visual surveillance and Re-identification, Zürich, Switzerland, September 2014.
• ICMR Workshop on Social Events in Web Multimedia, Glasgow, UK, April 2014.
• VRT Media Fast Forward event, Brussels, Belgium, November 2013.
• MM Workshop on Event-based Media Integration and Processing, Barcelona, Spain, October 2013.
• MMC Seminar: Changing Sceneries, Changing Roles, Hilversum, May 2013.
• Center for Machine Perception, Czech Technical University, Prague, April 2013.
• ECCV Workshop on Information fusion in computer vision for concept recognition, Firenze, Italy, October 2012.
• International Workshop on Digital Media Analysis, Search and Management, La Jolla, USA, February 2012.
• Audio-Visual Search Cluster meeting, Brussels, December 2011.
• International Workshop on Computer Vision Applications, Eindhoven, March 2011.
• Gracenote, Emeryville, USA, February 2011.
• Google Inc., Mountain View, USA, October 2010.
• U.C. Berkeley, Berkeley, USA, September 2010.
• Akiira Media Systems, Palo Alto, USA, June 2010.
• FXPAL, Palo Alto, USA, January 2010.
• K.U. Leuven, Leuven, Belgium, May 2009.
• National Institute of Informatics, Tokyo, Japan, January 2009.
• Schloss Dagstuhl, Dagstuhl, Germany, June 2008.
• Glasgow University, Glasgow, UK, July 2007.
• Tsinghua University, Beijing, China, July 2007.
• Fraunhofer Institute for Computer Graphics, Darmstadt, Germany. October, 2005.
• University of Dortmund, Dortmund, Germany, March, 2004.
• Carnegie Mellon University, Pittsburgh, USA, October 2003.

National

• NVPHBV, Amsterdam, November 2019.
• Gemeente Edam-Volendam, November 2019.
• SPUI25, Amsterdam, May 2019.
• Thalia Symposium, Radboud University, March 2019.
• SPUI25, Amsterdam, March 2019.
• Gemeente Amsterdam, February 2019.
• SNIC, SingularIT, Haarlem, November 2018.
• Business Cluster Semiconductors Netherlands, Heteren, July 2018.
• French Tech Amsterdam, May 2018.
• Innovation Center for Artificial Intelligence, Amsterdam, April 2018.
• MAGNIMS workshop, Amsterdam, April 2018.
• University of Amsterdam, Amsterdam, February 2018.
• Eindhoven University of Technology, Eindhoven, January 2018.
• Radboud University, Nijmegen, December 2017.
• Eindhoven University of Technology, Eindhoven, October 2017.
• VOGIN-IP, Amsterdam, March 2017.
• Institute Quantivision Conference, February 2017.
• Schiphol GMI overleg, Schiphol, October 2016.
• ICT.OPEN, Apeldoorn, March 2016.
• Cross Media Cafe ‘Video Formats’, Hilversum, February 2016.
• National eScience Symposium, Amsterdam, October 2015.
• AWTI, NIKHEF Amsterdam, June 2015.
• SEA: Search Engines Amsterdam, Universiteit van Amsterdam, May 2015.
• Barlaeus Lecture, Universiteit van Amsterdam, December 2013.
• ICT.OPEN, Eindhoven, November 2013.
• ASCI.OPEN, Eindhoven, November 2013.
• Landelijke videodag, Nederlands Forensisch Instituut, The Hague, June 2013.
• DAS workshop, Delft, February 2013.
• NWO Chemistry & Physical Sciences, The Hague, January 2013.
• Delft University of Technology, Delft, October 2012.
• Faculty Colloquium, Amsterdam, October 2012.
• ZiuZ Gebruikersdag, Sint Nicolaasga, May 2012.
• Amsterdam Image Statistics & Neural Processing Meeting, Amsterdam, March 2012.
• Afscheidsseminar Eric Sieverts, Amsterdam, January 2012.
• TNO, Delft, August 2011.
• Fulbright Award Ceremony, Amsterdam, June 2011.
• NWO Bessensap, Den Haag, June 2011.
• Symposium on Future Directions for Indexing and Retrieving Visual Media, Amsterdam, November 2010.
• Landelijke videodag, Nederlands Forensisch Instituut, The Hague, June 2010.
• ICTDelta, Rotterdam, March 2010.
• Leidsche Flesch, Leiden University, Leiden, February 2010.
• Bètapartners education conference, Amsterdam, January 2010.
• Society of the Query conference, Amsterdam, November 2009.
• Cross Media Cafe ‘Media & Uitvinders’, Hilversum, October 2009.
• CWI, Amsterdam, April 2009.
• Delft University of Technology, Delft, February 2009.
• Delft University of Technology, Delft, May 2008.
• CWI, Amsterdam, November 2004.
• TNO, Delft, April 2003.
• Nederlands Genootschap voor Informatica, Amsterdam, April 2002.

Grants and Prizes

Grants

• PI of NWO Open Technology project: Real-Time Video Surveillance Search. December 2019.
• Co-PI of IARPA DIVA project TARDIS-V: Multi-Layer Compositional Activity Understanding using Joint Visual and Semantic Inference. November 2017.
• WP leader of NWO Perspectief on Efficient Deep Learning project: Deep Learning for Video Analysis and Surveillance. November 2017.
• Co-PI of QUVA Lab, Toeslag Topconsortia voor Kennis en Innovatie, December 2015.
• Co-PI of QUVA Lab, the public-private partnership between Qualcomm Technologies Inc. and the University of Amsterdam. May 2015.
• Co-PI of Digging into Data proposal: Digging Archaeology Data: Image Search and Markup (DADAISM). January 2014.
• PI of NWO Big Grid proposal: VideoSCOUD: Video Search on the Cloud. October 2012.
• PI of NWO Innovational Research Incentives Scheme (“VIDI”) proposal: STORY: Searching for the events told by video content. June 2012.
• WP leader of FES COMMIT sub-grant proposal: Socially-Enriched Access to Linked Cultural Media. October 2010.
• Co-PI of IARPA Aladdin SESAME: Video Search with Speed and Accuracy for Multimedia Events. October 2010.
• PI of Fulbright Junior Scholar proposals: Visual Search Engines (teaching) and Shaping Visual Semantics for Video Search (research), both executed at U.C. Berkeley, CA, USA. April 2010.
• PI of NWO-NCF proposal: VideoSUPER: Video Search by Understanding Multiple Keyframes. June 2009.
• PI of MultimediaN Idea-competition proposal: De PinkPop Teletijdmachine. May 2009.
• PI of NWO Innovational Research Incentives Scheme (“VENI”) proposal: SEARCHER: Substituting Experts by Amateurs for Concept-based Video Retrieval. August 2008.
• Co-PI of Dutch/Flemish IM-Pact proposal: BeeldCanon: Videobeelden Categoriseren van Atomium tot Zaanse Schans. March 2008.
• Co-PI of Muscle Showcase proposal: Image and Video Retrieval Evaluation Showcases. December 2006.

Awards

• 2020, SIGMM test of time paper award, honourable mention.
• 2020, outstanding reviewer, NeurIPS.
• 2019, outstanding reviewer, CVPR.
• 2017, best performer, NIST TRECVID multimedia event detection task.
• 2017, best performer, NIST TRECVID ad-hoc video search task.
• 2017, ITE Niwa-Takayanagi Best Paper Award.
• 2016, best performer, NIST TRECVID video to text task.
• 2016, best performer, NIST TRECVID multimedia event detection task.
• 2016, best entry, ACM Multimedia Grand Challenge.
• 2016, outstanding reviewer, CVPR.
• 2016, best paper award, ACM ICMR.
• 2015, runner-up, ImageNet 200 object detection task.
• 2015, best performer, NIST TRECVID multimedia event detection task.
• 2015, best performer, NIST TRECVID localization task.
• 2015, best performer, NIST TRECVID semantic indexing task.
• 2015, outstanding reviewer, CVPR.
• 2014, best paper award, ACM Multimedia.
• 2014, best performer, THUMOS action classification challenge.
• 2014, best performer, NIST TRECVID semantic indexing task.
• 2013, best paper award, ASCI.
• 2013, best performer, ImageNet 200 object detection task.
• 2013, best performer, all four NIST TRECVID semantic indexing tasks.
• 2012, Netherlands prize for ICT-Research.
• 2012, best paper award, ASCI.
• 2012, best poster award, ASCI.
• 2012, best performer, Pascal VOC classification with localization.
• 2012, runner-up, NIST TRECVID video concept detection.
• 2012, runner-up, NIST TRECVID video event detection.
• 2012, IEEE Transactions on Multimedia Prize Paper.
• 2012, NWO VIDI.
• 2012, best paper runner-up, ACM ICMR.
• 2011, best performer, ImageNet classification with localization.
• 2011, runner-up, NIST TRECVID video concept detection.
• 2010, best performer, NIST TRECVID video concept detection.
• 2010, best paper award, ASCI.
• 2010, best paper award, ACM CIVR.
• 2010, best paper runner-up, ACM CIVR.
• 2010, Fulbright Junior Scholar.
• 2009, best performer, NIST TRECVID video concept detection.
• 2009, best performer, NIST TRECVID video interactive retrieval.
• 2008, best performer, NIST TRECVID video concept detection.
• 2008, best performer, NIST TRECVID video interactive retrieval.
• 2008, NWO VENI.
• 2005, best performer, NIST TRECVID video interactive retrieval.
• 2005, best technical demonstration, ACM Multimedia.
• 2004, best performer, NIST TRECVID video concept detection.
• 2004, best performer, NIST TRECVID video interactive retrieval.
• 2001, best regional master thesis, Nederlands Genootschap voor Informatica.

Publications

Summary

• Total: 200+ publications (40+ journals)
• Google Scholar H-index: 45+
• Google Scholar citations: 12500+

Five Selected

• Xirong Li, Cees G. M. Snoek, and Marcel Worring. Learning Social Tag Relevance by Neighbor Voting. IEEE Transactions on Multimedia, 11(7):1310-1322, November 2009.
• Koen E. A. van de Sande, Theo Gevers, and Cees G. M. Snoek. Evaluating Color Descriptors for Object and Scene Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(9):1582-1596, September 2010.
• Amirhossein Habibian, Thomas Mensink, and Cees G. M. Snoek. VideoStory: A New Multimedia Embedding for Few-Example Recognition and Translation of Events. In Proceedings of the ACM International Conference on Multimedia, Orlando, Florida, USA, 2014.
• Kirill Gavrilyuk, Amir Ghodrati, Zhenyang Li, and Cees G. M. Snoek. Actor and Action Video Segmentation from a Sentence. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, USA, 2018.
• Pascal Mettes, Elise van der Pol, and Cees G. M. Snoek. Hyperspherical Prototype Networks. In Conference on Neural Information Processing Systems, Vancouver, Canada, 2019.

Patents

• Several granted, a dozen pending.