January 2001 – October 2005
Computer Science, University of Amsterdam.
Title of thesis: The Authoring Metaphor to Machine Understanding of Multimedia.
Advisors: prof. dr. ir. Arnold W.M. Smeulders and dr. Marcel Worring.
Master’s
September 1996 – October 2000
Business Information Systems, University of Amsterdam.
Title of thesis: Camera Distance Classification: Indexing Video Shots based on Visual Features.
Advisor: dr. Jeroen Vendrig.
Professional Appointments
Academic Research
January 2018 – present Full Professor, University of Amsterdam, the Netherlands.
July 2013 – December 2017 Associate Professor, University of Amsterdam, the Netherlands.
July 2011 – June 2013 Assistant Professor, University of Amsterdam, the Netherlands.
August 2010 – February 2011 Fulbright Junior Scholar at Jitendra Malik’s lab, U.C. Berkeley, Berkeley, CA, USA.
January 2009 – December 2012 VENI research fellow, University of Amsterdam, the Netherlands.
January 2005 – December 2008 Postdoctoral researcher, University of Amsterdam, the Netherlands.
April-October 2003 Visiting researcher at Informedia, Carnegie Mellon University, Pittsburgh, PA, USA.
January 2001 – December 2004 Doctorate research, University of Amsterdam, the Netherlands.
Public-Private Research
November 2019 – present Scientific Director, Atlas Lab with TomTom.
October 2019 – present Scientific Director, AIM Lab with Inception Institute of Artificial Intelligence.
April 2018 – present Co-Founder, Innovation Center for Artificial Intelligence.
May 2015 – present Scientific Director, QUVA Lab with Qualcomm Technologies.
Industry Research
April 2018 – present Chief Scientific Officer, Kepler Vision Technologies.
June 2016 – December 2017 Principal Engineer/Manager, Qualcomm Technologies.
September 2014 – May 2016 Principal Engineer, Qualcomm Technologies.
July 2011 – September 2014 Head of R&D, Euvision Technologies.
Research Management
June 2019 – present Management Team, Advanced School for Computing and Imaging.
Education Management
June 2018 – present Director Master Artificial Intelligence, University of Amsterdam.
April 2018 – April 2019 Coordinator Honours Program Bachelor Artificial Intelligence, University of Amsterdam.
March 2014 – September 2014 Member Examinations Board Information Studies, University of Amsterdam.
Professional Service
Associate Editorship
2023-2020
IEEE Transactions on Pattern Analysis and Machine Intelligence
Computer Vision and Image Understanding
2019-2017
ACM Transactions on Multimedia
2016
ACM Transactions on Multimedia
IEEE MultiMedia
2015-2012
IEEE MultiMedia
IEEE Transactions on Multimedia
2011
IEEE MultiMedia
Organization
2022
Program Coordinator, ACM International Conference on Multimedia.
2021
Area Chair, International Conference on Computer Vision.
Area Chair, International Joint Conference on Artificial Intelligence.
Area Chair, Conference on Computer Vision and Pattern Recognition.
2020
Area Chair, European Conference on Computer Vision.
Brave New Ideas Chair, ACM International Conference on Multimedia.
Co-Organizer, CVPR Workshop on ActivityNet
Track Chair, International Conference on Pattern Recognition.
2019
Area Chair, International Conference on Computer Vision.
Area Chair, ACM International Conference on Multimedia.
Area Chair, British Machine Vision Conference.
Co-Organizer, CVPR Workshop on ActivityNet.
Program Chair: International Conference on Image Analysis and Processing.
Tutorial Chair, ACM International Conference on Multimedia Retrieval.
2018
Area Chair, British Machine Vision Conference.
Co-Organizer, CVPR Workshop on ActivityNet.
2017
Program Co-Chair, ACM International Conference on Multimedia Retrieval.
Co-Organizer, CVPR Workshop on ActivityNet.
Area Chair, ACM International Conference on Multimedia.
Area Chair, British Machine Vision Conference.
Area Chair, International Conference on Computer Vision.
Video Analysis and Retrieval, International Summer School on Multimedia Semantics, 2009.
Video Search Engines, IEEE Conference on Computer Vision and Pattern Recognition, 2009.
Concept-based Video Retrieval, Pacific-Rim Symposium on Image and Video Technology, 2009.
Semantic Indexing and Retrieval of Video, IEEE International Conference on Pattern Recognition, 2008.
Concept-based Video Retrieval, Summer School on Image Processing, 2008.
Semantic Indexing and Retrieval of Video, IEEE International Conference on Multimedia & Expo, 2008.
Semantic Indexing and Retrieval of Video, Swiss School of the 3eme cycle romand in Informatics, 2007.
Concept-based Video Indexing and Retrieval, International Summer School on Multimedia Semantics Analysis, Annotation, Retrieval and Applications, 2007.
Semantic Indexing and Retrieval of Video, International Conference on Semantic and Digital Media Technologies, 2006.
Semantic Indexing and Retrieval of Video, ACM International Conference on Multimedia, 2006.
Efstratios Gavves, Nuances in Visual Recognition, 2008-2012. Stratis is currently an Associate Professor at the University of Amsterdam and recipient of an NWO VIDI and ERC Starting Grant.
Alexandros Stergiou, Efficient Modelling Across Time of Human Actions and Interactions, Utrecht University, September 2021.
Shuai Liao, Deep Learning with 3D and Label Geometry, University of Amsterdam, September 2021.
Berkay Kicanaoglu, Deep Representations of Structures in the 3D-World, University of Amsterdam, September 2021.
Yue Sun, Video-based Infant Discomfort Detection, Eindhoven University of Technology, July 2021.
Georgios Kapidis, A Modular Approach for the Detection and Interconnection of Objects, Hands, Locations, and Actions for Egocentric Video Understanding, Utrecht University, June 2021.
Hoàng Ân Lê, Outdoor Image Understanding from Multiple Vision Modalities, University of Amsterdam, May 2021.
Noortje Seijdel, Object Recognition Put in Context, University of Amsterdam, April 2021.
Tom Runia, Recurrent Motion in Vision, University of Amsterdam, April 2021.
Noureldien Hussein, Aspects of Time for Recognizing Human Activities, University of Amsterdam, April 2021.
Wendy Shang, Crafting Deep Learning Models for Reinforcement Learning and Computer Vision Applications, University of Amsterdam, January 2021.
Harrie Oosterhuis, Learning from User Interactions with Rankings, University of Amsterdam, November 2020.
Dan Li, Effective Collection Construction for IR Evaluation and Optimization, University of Amsterdam, November 2020.
Praveen Dakwale, Exploring Strategies for Effective Utilization of Training Data for Machine Translation, University of Amsterdam, October 2020.
Peter O’Connor, Biologically Plausible Deep Learning, University of Amsterdam, September 2020.
David Semedo, Bridging Vision and Language over Time with Neural Cross-modal Embeddings, NOVA University of Lisbon, July 2020.
Nuno Cruz Garcia, Learning with Privileged Information using Multimodal Data, Universita di Genova, November 2019.
Davide Moltisanti, On the Impact of Action Boundaries for Video Recognition, University of Bristol, November 2019.
Jun Xiao, Improving Application Timing Predictability and Caching Performance on Multi-core Systems, University of Amsterdam, October 2019.
Kyriacos Shiarlis, Detaching the strings: Practical algorithms for Learning from Demonstration, University of Amsterdam, September 2019.
Fabian Caba, Understanding Human Activities at Large Scale. King Abdullah University of Science and Technology, March 2019.
Guilhem Chéron, Structured modeling and recognition of human actions in video. École Normale Supérieure de Paris/Inria, December 2018.
Riste Gligorov, Serious Games in Audio-Visual Collections. Vrije University Amsterdam, November 2018.
Fabian Flohr, Vulnerable Road User Detection and Orientation Estimation for Context-Aware Automated Driving, University of Amsterdam, 2018.
Spencer Cappallo, Predicting Visual Trends, University of Amsterdam, 2018.
Joern Jacobsen, Structured Convolutional Networks. University of Amsterdam, 2018.
Wenjie Pei, Models for Supervised Learning on Sequence Data. Delft University of Technology, 2018.
Maaike de Boer, Semantic Mapping in Video Retrieval. Radboud University Nijmegen, 2017.
Alessio Bazzica, Music Information Retrieval beyond Audio. Delft University of Technology, 2017.
Zhenyang Li, Exploring Locality for Visual Recognition. University of Amsterdam, December 2017.
Pascal Mettes, Objects for Spatio-Temporal Activity Recognition in Videos. University of Amsterdam, December 2017.
Maurice Peemen, Improving the Efficiency of Deep Convolutional Neural Networks. Eindhoven University of Technology, 2017.
Ork de Rooij, Interactive Content-Based Visualizations for Multimedia Search. University of Amsterdam, 2017.
Jan Zahálka, The Machine in Mulimedia Analytics. University of Amsterdam, July 2017.
Ali Sharif Razavian, Convolutional Network Representation for Visual Recognition. Royal Institute of Technology (KTH), January 2017.
Ran Tao, Visual Instance Search from One Example. University of Amsterdam, January 2017.
Silvia-Laura Pintea, Continuous Learning in Computer Vision. University of Amsterdam, January 2017.
Sezer Karaoglu. Recognition and Detection of Objects Using Visual and Textual Cues. University of Amsterdam, December 2016.
Svetlana Kordumova, Learning to Search for Images without Annotations. University of Amsterdam, November 2016.
Amirhossein Habibian, Storytelling Machines for Video Search. University of Amsterdam, September 2016.
Masoud Mazloom, In Search of Video Event Semantics. University of Amsterdam, September 2016.
Daan Odijk, Context & Semantics in News & Web Search. University of Amsterdam, June 2016.
Fares Alnajar, Automatic Age and Gaze Estimation under Uncontrolled Conditions. University of Amsterdam, January 2016.
Andrej Mikulik, Large-Scale Content-Based Sub-Image Search. Czech Technical University in Prague, July 2015.
Dan Oneata, Robust and efficient models for action recognition and localization. Universite de Grenoble/Inria, July 2015.
Ben van Werkhoven, Scientifi c Supercomputing with Graphics Processing Units, VU University Amsterdam, October 2014.
Efstratios Gavves, Nuances in Visual Recognition, University of Amsterdam, September 2014.
Zhigang Ma, From Concepts to Events: A Progressive Process for Multimedia Content Analysis, University of Trento, December 2013.
Stevan Rudinac, Advancing the Relevance Criteria for Video Search and Visual Summarization, Delft University of Technology, May 2013.
Simon Carter, Exploration and Exploitation of Multilingual Data for Statistical Machine Translation, University of Amsterdam, December 2012.
Xirong Li, Content-Based Visual Search Learned from Social Media, University of Amsterdam, March 2012.
Koen van de Sande, Invariant Color Descriptors for Efficient Object Recognition, University of Amsterdam, December 2011.
Jasper Uijlings, The What and Where in Visual Object Recognition, University of Amsterdam, December 2011.
Bouke Huurnink, Search in Audiovisual Broadcast Archives, University of Amsterdam, November 2010.
M.Sc. Thesis Supervision
S. Reuther, Task-Aware Transfer Learning, March 2021.
M. van Rijn, Face Anonymisation in Face Detector Training Data, September 2020.
A. Gansekoele, The Fisher-Watson Detector for Out-of-Distribution and Adversarial Detection, July 2020.
T. van Dijk, Ball-I3D: Localizing Footballs from Player Coordinates, October 2019.
E. Machielse, Video Summarizaton by Learning from a Direct Ground-truth, September 2019.
J. Verhagen, PixelLink++: Adversarial Detection of Text in the Wild, July 2019.
M. Nagel, Meta Fisher Vectors for generative encoding of visual streams, January 2015.
B. van de Poel, Evaluating Visual Representations for Video Event Retrieval, December 2012.
E.A. van Beijsterveldt, Searching Television Fragments Using Micro-Blogs, September 2012.
D. Modolo, Towards Semantic Representations for Event Detection and Segmentation, December 2011.
J. Steggink, Adding Semantics to Image Region Annotations with the Name-It-Game, June 2009.
A. Setz, Can Social Tagged Images Aid Concept-Based Video Search?, April 2009.
R. Nijdam, A Performance Evaluation of Concept-Based Video Genre Classification Components, October 2007.
J. Damman, Using a Category System in an Online Annotation Game, September 2007.
T. van Dijk, The Potential of Social Tagged Data for Visual Indexing, July 2007.
K.E.A. van de Sande, Coloring Concept Detection in Video using Interest Regions, April 2007.
L. van der Zande, On the Effectiveness of Query-Concept-Dependent Video Search, June 2006.
J. Edens, Towards Combining Automatic, Semi-automatic, and Manual Annotation for Semantic Narrowcast Video Retrieval, June 2006.
A. Algoe, People Annotation in Frequent-Face Videos, October 2004.
B.Sc. Thesis Supervision
J. Rots, Detecting explosive ATM attacks, July 2019.
H. Scholtens, A Text-Based Framework for Generic Person X Annotation in Broadcast News Video, August 2005.
Invited Presentations
International
AIDA AI Excellence Lecture Series, virtual, November 2021.
Huawei Cloud Service Summit, Finland, November 2021.
ICCV Tutorial on on Reviewing the Review Process, virtual, October 2021.
ICCV Tutorial on Multi-Modality Learning from Videos and Beyond, virtual, October 2021.
ICCV Tutorial on Large-Scale Holistic Video Understanding, virtual, October 2021.
MM Workshop on Trustworthy AI for Multimedia, China, October 2021.
Fifth IPM Advanced School on Computing: Artificial Intelligence, Iran, September 2021.
IEEE CASS Seasonal School on New Trends of Visual and Language Understanding, China, August 2021.
International Conference on Multimedia Modeling, Praha, June 2021.
WACV Workshop on Biased and Scarce Data, Hawaii, January 2021.
MM Workshop on Human-centric Multimedia Analysis, Seattle, October 2020.
SRI International, New Jersey, September 2020.
Huawei International Video Intelligence Forum, Dublin, Ireland, September 2020.
Samsung AI Center Cambridge, UK, June 2020.
Bilkent University, Ankara, Turkey, November 2019.
Qualcomm, Seoul, Korea, November 2019.
ICCV Workshop on Learning Concepts – Zero-Shot, One-Shot, Few-Shot and Beyond, Seoul, Korea, October 2019.
ICCV Workshop on Video Retrieval Methods and Their Limits, Seoul, Korea, October 2019.
ICCV Workshop on Large-Scale Video Understanding, Seoul, Korea, October 2019.
ICCV Workshop on Multi-modal video analysis, Seoul, Korea, October 2019.
ICCV Workshop Toward Human-Level Video Story Understanding, October 2019.
BMVA Symposium on Video Understanding, London, UK, September 2019.
CVPR Workshop on Multi-modal learning from videos, Long Beach, USA, June 2019.
Facebook AI Video Summit, Los Angeles, USA, June 2019.
Huawei, Shenzhen, China, May 2019.
IIT-PAVIS, Genoa, Italy, May 2019.
Holland Innovation Seminar, Singapore, February 2019.
WACV Workshop on Human Activity Detection in Multi-Camera, Continuous, Long-Duration Video, Hawaii, USA, January 2019.
International Conference on Big Scientific Data Management, Beijing, China, November 2018.
Renmin University, Beijing, China, November 2018.
CVPR Workshop on Video Understanding, Salt Lake City, USA, June 2018.
Qualcomm, San Diego, USA, June 2018.
Machines Can See Conference, Moscow, Russia, June 2018.
EuropeanaTech Conference, Rotterdam, the Netherlands, May 2018.
Qualcomm Innovation Fellowship, Amsterdam, the Netherlands, May 2018.
University of Bristol, Bristol, UK, November 2017.
CVPR Workshop on Brave New Motion, Honolulu, USA, July 2017.
Frontiers of Video Technology Workshop, San Jose, USA, July 2017.
Royal Institute of Technology (KTH), Stockholm, Sweden, January 2017.
ECCV Workshop on Storytelling with Images and Videos, Amsterdam, The Netherlands, October 2016.
CVPR Workshop on Deep Vision, Las Vegas, USA, June 2016.
Cannes Lions International Festival of Creativity, Cannes, France, June 2016.
Blippar, London, UK, April 2016.
ICCV Workshop on Web-scale Vision and Social Media, Santiago, Chile, December 2015.
MM Workshop on Human-Centered Event Understanding from Multimedia, Brisbane, Australia, October 2015.
SIGMM Multimedia Frontier Workshop, Brisbane, Australia, October 2015.
Re.Work Deep Learning Summit, London, UK, September 2015.
Inria-LEAR, Grenoble, France, July 2015.
Qualcomm, San Diego, USA, October 2014.
ECCV Workshop on THUMOS Challenge: Action Recognition with a Large Number of Classes, Zürich, Switzerland, September 2014.
ECCV Workshop on Visual surveillance and Re-identification, Zürich, Switzerland, September 2014.
ICMR Workshop on Social Events in Web Multimedia, Glasgow, UK, April 2014.
VRT Media Fast Forward event, Brussels, Belgium, November 2013.
MM Workshop on Event-based Media Integration and Processing, Barcelona, Spain, October 2013.
MMC Seminar: Changing Sceneries, Changing Roles, Hilversum, May 2013.
Center for Machine Perception, Czech Technical University, Prague, April 2013.
ECCV Workshop on Information fusion in computer vision for concept recognition, Firenze, Italy, October 2012.
International Workshop on Digital Media Analysis, Search and Management, La Jolla, USA, February 2012.
Audio-Visual Search Cluster meeting, Brussels, December 2011.
International Workshop on Computer Vision Applications, Eindhoven, March 2011.
Gracenote, Emeryville, USA, February 2011.
Google Inc., Mountain View, USA, October 2010.
U.C. Berkeley, Berkeley, USA, September 2010.
Akiira Media Systems, Palo Alto, USA, June 2010.
FXPAL, Palo Alto, USA, January 2010.
K.U. Leuven, Leuven, Belgium, May 2009.
National Institute of Informatics, Tokyo, Japan, January 2009.
Schloss Dagstuhl, Dagstuhl, Germany, June 2008.
Glasgow University, Glasgow, UK, July 2007.
Tsinghua University, Beijing, China, July 2007.
Fraunhofer Institute for Computer Graphics, Darmstadt, Germany. October, 2005.
University of Dortmund, Dortmund, Germany, March, 2004.
Carnegie Mellon University, Pittsburgh, USA, October 2003.
National
Amsterdam AI Tech Week, October 2021.
Lunch at ICAI, September 2021.
Van Mierlo Stichting, April 2021.
Florence Nightingale Colloquium, Leiden, December 2020.
Teknowlogy, Maarssen, November 2020.
Lunch at ICAI, October 2020.
NVPHBV, Amsterdam, November 2019.
Gemeente Edam-Volendam, November 2019.
SPUI25, Amsterdam, May 2019.
Thalia Symposium, Radboud University, March 2019.
SPUI25, Amsterdam, March 2019.
Gemeente Amsterdam, February 2019.
SNIC, SingularIT, Haarlem, November 2018.
Business Cluster Semiconductors Netherlands, Heteren, July 2018.
French Tech Amsterdam, May 2018.
Innovation Center for Artificial Intelligence, Amsterdam, April 2018.
MAGNIMS workshop, Amsterdam, April 2018.
University of Amsterdam, Amsterdam, February 2018.
Eindhoven University of Technology, Eindhoven, January 2018.
Radboud University, Nijmegen, December 2017.
Eindhoven University of Technology, Eindhoven, October 2017.
VOGIN-IP, Amsterdam, March 2017.
Institute Quantivision Conference, February 2017.
Schiphol GMI overleg, Schiphol, October 2016.
ICT.OPEN, Apeldoorn, March 2016.
Cross Media Cafe ‘Video Formats’, Hilversum, February 2016.
National eScience Symposium, Amsterdam, October 2015.
AWTI, NIKHEF Amsterdam, June 2015.
SEA: Search Engines Amsterdam, Universiteit van Amsterdam, May 2015.
Barlaeus Lecture, Universiteit van Amsterdam, December 2013.
ICT.OPEN, Eindhoven, November 2013.
ASCI.OPEN, Eindhoven, November 2013.
Landelijke videodag, Nederlands Forensisch Instituut, The Hague, June 2013.
DAS workshop, Delft, February 2013.
NWO Chemistry & Physical Sciences, The Hague, January 2013.
Delft University of Technology, Delft, October 2012.
Faculty Colloquium, Amsterdam, October 2012.
ZiuZ Gebruikersdag, Sint Nicolaasga, May 2012.
Amsterdam Image Statistics & Neural Processing Meeting, Amsterdam, March 2012.
Afscheidsseminar Eric Sieverts, Amsterdam, January 2012.
TNO, Delft, August 2011.
Fulbright Award Ceremony, Amsterdam, June 2011.
NWO Bessensap, Den Haag, June 2011.
Symposium on Future Directions for Indexing and Retrieving Visual Media, Amsterdam, November 2010.
Landelijke videodag, Nederlands Forensisch Instituut, The Hague, June 2010.
ICTDelta, Rotterdam, March 2010.
Leidsche Flesch, Leiden University, Leiden, February 2010.
Bètapartners education conference, Amsterdam, January 2010.
Society of the Query conference, Amsterdam, November 2009.
Cross Media Cafe ‘Media & Uitvinders’, Hilversum, October 2009.
CWI, Amsterdam, April 2009.
Delft University of Technology, Delft, February 2009.
Delft University of Technology, Delft, May 2008.
CWI, Amsterdam, November 2004.
TNO, Delft, April 2003.
Nederlands Genootschap voor Informatica, Amsterdam, April 2002.
Grants and Prizes
Grants
PI of NWO Open Technology project: Real-Time Video Surveillance Search. December 2019.
Co-PI of IARPA DIVA project TARDIS-V: Multi-Layer Compositional Activity Understanding using Joint Visual and Semantic Inference. November 2017.
WP leader of NWO Perspectief on Efficient Deep Learning project: Deep Learning for Video Analysis and Surveillance. November 2017.
Co-PI of QUVA Lab, Toeslag Topconsortia voor Kennis en Innovatie, December 2015.
Co-PI of QUVA Lab, the public-private partnership between Qualcomm Technologies Inc. and the University of Amsterdam. May 2015.
Co-PI of Digging into Data proposal: Digging Archaeology Data: Image Search and Markup (DADAISM). January 2014.
PI of NWO Big Grid proposal: VideoSCOUD: Video Search on the Cloud. October 2012.
PI of NWO Innovational Research Incentives Scheme (“VIDI”) proposal: STORY: Searching for the events told by video content. June 2012.
WP leader of FES COMMIT sub-grant proposal: Socially-Enriched Access to Linked Cultural Media. October 2010.
Co-PI of IARPA Aladdin SESAME: Video Search with Speed and Accuracy for Multimedia Events. October 2010.
PI of Fulbright Junior Scholar proposals: Visual Search Engines (teaching) and Shaping Visual Semantics for Video Search (research), both executed at U.C. Berkeley, CA, USA. April 2010.
PI of NWO-NCF proposal: VideoSUPER: Video Search by Understanding Multiple Keyframes. June 2009.
PI of MultimediaN Idea-competition proposal: De PinkPop Teletijdmachine. May 2009.
PI of NWO Innovational Research Incentives Scheme (“VENI”) proposal: SEARCHER: Substituting Experts by Amateurs for Concept-based Video Retrieval. August 2008.
Co-PI of Dutch/Flemish IM-Pact proposal: BeeldCanon: Videobeelden Categoriseren van Atomium tot Zaanse Schans. March 2008.
Co-PI of Muscle Showcase proposal: Image and Video Retrieval Evaluation Showcases. December 2006.
