{"id":348,"date":"2009-09-15T15:25:47","date_gmt":"2009-09-15T14:25:47","guid":{"rendered":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/?p=348"},"modified":"2009-09-15T15:25:47","modified_gmt":"2009-09-15T14:25:47","slug":"comparing-compact-codebooks-for-visual-categorization","status":"publish","type":"post","link":"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/","title":{"rendered":"Comparing Compact Codebooks for Visual Categorization"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" title=\"holeinwater\" src=\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/09\/holeinwater.jpg\" alt=\"holeinwater\" width=\"219\" height=\"159\" align=\"right\" \/><\/p>\n<p>A preprint of the paper <em>Comparing Compact Codebooks for Visual Categorization<\/em> by <a href=\"http:\/\/staff.science.uva.nl\/~jvgemert\" target=\"_blank\">Jan van Gemert<\/a>, <a href=\"http:\/\/staff.science.uva.nl\/~cveenman\/\" target=\"_blank\">Cor Veenman<\/a>, <a href=\"http:\/\/staff.science.uva.nl\/~smeulder\">Arnold Smeulders<\/a>, <a href=\"http:\/\/staff.science.uva.nl\/~mark\" target=\"_blank\">Jan-Mark Geusebroek<\/a>, and myself is <a href=\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/pub\/gemert-compact-codebooks-cviu.pdf\" target=\"_blank\">available online now<\/a>. In the face of current large-scale video libraries, the practical applicability of content-based indexing algorithms is constrained by their efficiency. To this end, this paper compares various visual-based concept categorization techniques for efficient large-scale video indexing. In visual categorization, the popular codebook model has shown excellent categorization performance. The codebook model represents continuous visual features by discrete prototypes predefined in a vocabulary. The vocabulary size has a major impact on categorization efficiency, where a more compact vocabulary is more efficient. However, smaller vocabularies typically score lower on classification performance than larger vocabularies. This paper compares four approaches to achieve a compact codebook vocabulary while retaining categorization performance. For these four methods, we investigate the trade-off between codebook compactness and categorization performance. We evaluate the methods on more than 200 hours of challenging video data with as many as 101 semantic concepts. The results allow us to create a taxonomy of the four methods based on their efficiency and categorization performance. The paper will appear in the forthcoming special issue on Image and Video Retrieval Evaluation of <em>Computer Vision and Image Understanding<\/em>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A preprint of the paper Comparing Compact Codebooks for Visual Categorization by Jan van Gemert, Cor Veenman, Arnold Smeulders, Jan-Mark Geusebroek, and myself is available online now. In the face of current large-scale video libraries, the practical applicability of content-based indexing algorithms is constrained by their efficiency. To this end, this paper compares various visual-based [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-348","post","type-post","status-publish","format-standard","hentry","category-science"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Comparing Compact Codebooks for Visual Categorization - Cees Snoek<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Comparing Compact Codebooks for Visual Categorization - Cees Snoek\" \/>\n<meta property=\"og:description\" content=\"A preprint of the paper Comparing Compact Codebooks for Visual Categorization by Jan van Gemert, Cor Veenman, Arnold Smeulders, Jan-Mark Geusebroek, and myself is available online now. In the face of current large-scale video libraries, the practical applicability of content-based indexing algorithms is constrained by their efficiency. To this end, this paper compares various visual-based [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/\" \/>\n<meta property=\"og:site_name\" content=\"Cees Snoek\" \/>\n<meta property=\"article:published_time\" content=\"2009-09-15T14:25:47+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/09\/holeinwater.jpg\" \/>\n<meta name=\"author\" content=\"Cees\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Cees\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/\",\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/\",\"name\":\"Comparing Compact Codebooks for Visual Categorization - Cees Snoek\",\"isPartOf\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/#primaryimage\"},\"thumbnailUrl\":\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/09\/holeinwater.jpg\",\"datePublished\":\"2009-09-15T14:25:47+00:00\",\"author\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/#primaryimage\",\"url\":\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/09\/holeinwater.jpg\",\"contentUrl\":\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/09\/holeinwater.jpg\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.ceessnoek.info\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Comparing Compact Codebooks for Visual Categorization\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.ceessnoek.info\/#website\",\"url\":\"https:\/\/www.ceessnoek.info\/\",\"name\":\"Cees Snoek\",\"description\":\"research on video and image ai\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.ceessnoek.info\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\",\"name\":\"Cees\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"caption\":\"Cees\"},\"sameAs\":[\"http:\/\/www.CeesSnoek.info\"],\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Comparing Compact Codebooks for Visual Categorization - Cees Snoek","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/","og_locale":"en_US","og_type":"article","og_title":"Comparing Compact Codebooks for Visual Categorization - Cees Snoek","og_description":"A preprint of the paper Comparing Compact Codebooks for Visual Categorization by Jan van Gemert, Cor Veenman, Arnold Smeulders, Jan-Mark Geusebroek, and myself is available online now. In the face of current large-scale video libraries, the practical applicability of content-based indexing algorithms is constrained by their efficiency. To this end, this paper compares various visual-based [&hellip;]","og_url":"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/","og_site_name":"Cees Snoek","article_published_time":"2009-09-15T14:25:47+00:00","og_image":[{"url":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/09\/holeinwater.jpg","type":"","width":"","height":""}],"author":"Cees","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Cees","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/","url":"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/","name":"Comparing Compact Codebooks for Visual Categorization - Cees Snoek","isPartOf":{"@id":"https:\/\/www.ceessnoek.info\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/#primaryimage"},"image":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/#primaryimage"},"thumbnailUrl":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/09\/holeinwater.jpg","datePublished":"2009-09-15T14:25:47+00:00","author":{"@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1"},"breadcrumb":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/#primaryimage","url":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/09\/holeinwater.jpg","contentUrl":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/09\/holeinwater.jpg"},{"@type":"BreadcrumbList","@id":"https:\/\/www.ceessnoek.info\/index.php\/comparing-compact-codebooks-for-visual-categorization\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ceessnoek.info\/"},{"@type":"ListItem","position":2,"name":"Comparing Compact Codebooks for Visual Categorization"}]},{"@type":"WebSite","@id":"https:\/\/www.ceessnoek.info\/#website","url":"https:\/\/www.ceessnoek.info\/","name":"Cees Snoek","description":"research on video and image ai","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ceessnoek.info\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1","name":"Cees","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","caption":"Cees"},"sameAs":["http:\/\/www.CeesSnoek.info"],"url":"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/348","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/comments?post=348"}],"version-history":[{"count":4,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/348\/revisions"}],"predecessor-version":[{"id":353,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/348\/revisions\/353"}],"wp:attachment":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/media?parent=348"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/categories?post=348"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/tags?post=348"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}