{"id":1143,"date":"2013-10-21T22:29:29","date_gmt":"2013-10-21T21:29:29","guid":{"rendered":"http:\/\/www.ceessnoek.info\/?p=1143"},"modified":"2013-10-21T22:29:29","modified_gmt":"2013-10-21T21:29:29","slug":"iccv13-codemaps-segment-classify-and-search-objects-locally","status":"publish","type":"post","link":"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/","title":{"rendered":"ICCV13: Codemaps Segment, Classify and Search Objects Locally"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" alt=\"Codemaps\" src=\"http:\/\/www.ceessnoek.info\/wp-content\/uploads\/2013\/10\/Codemaps-e1382377796460.png\" width=\"325\" height=\"405\" align=\"right\" \/><br \/>\nThe ICCV13 paper entitled \u201c<em>Codemaps Segment, Classify and Search Objects Locally<\/em>\u201d by Zhenyang Li, Efstratios Gavves, Koen van de Sande, Cees Snoek, and Arnold Smeulders is now also <a href=\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/pub\/li-codemaps-iccv13.pdf\">available<\/a>. In this paper we aim for segmentation and classification of objects. We propose codemaps that are a joint formulation of the classification score and the local neighborhood it belongs to in the image. We obtain the codemap by reordering the encoding, pooling and classification steps over lattice elements. Other than existing linear decompositions who emphasize only the efficiency benefits for localized search, we make three novel contributions. As a preliminary, we provide a theoretical generalization of the sufficient mathematical conditions under which image encodings and classification becomes locally decomposable. As first novelty we introduce l2 normalization for arbitrarily shaped image regions, which is fast enough for semantic segmentation using our Fisher codemaps. Second, using the same lattice across images, we propose kernel pooling which embeds nonlinearities into codemaps for object classification by explicit or approximate feature mappings. Results demonstrate that \u21132 normalized Fisher codemaps improve the state-of-the-art in semantic segmentation for PASCAL VOC. For object classification the addition of nonlinearities brings us on par with the state-of-the-art, but is 3x faster. Because of the codemaps\u2019 inherent efficiency, we can reach significant speed-ups for localized search as well. We exploit the efficiency gain for our third novelty: object segment retrieval using a single query image only.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The ICCV13 paper entitled \u201cCodemaps Segment, Classify and Search Objects Locally\u201d by Zhenyang Li, Efstratios Gavves, Koen van de Sande, Cees Snoek, and Arnold Smeulders is now also available. In this paper we aim for segmentation and classification of objects. We propose codemaps that are a joint formulation of the classification score and the local [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-1143","post","type-post","status-publish","format-standard","hentry","category-science"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>ICCV13: Codemaps Segment, Classify and Search Objects Locally - Cees Snoek<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"ICCV13: Codemaps Segment, Classify and Search Objects Locally - Cees Snoek\" \/>\n<meta property=\"og:description\" content=\"The ICCV13 paper entitled \u201cCodemaps Segment, Classify and Search Objects Locally\u201d by Zhenyang Li, Efstratios Gavves, Koen van de Sande, Cees Snoek, and Arnold Smeulders is now also available. In this paper we aim for segmentation and classification of objects. We propose codemaps that are a joint formulation of the classification score and the local [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/\" \/>\n<meta property=\"og:site_name\" content=\"Cees Snoek\" \/>\n<meta property=\"article:published_time\" content=\"2013-10-21T21:29:29+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/www.ceessnoek.info\/wp-content\/uploads\/2013\/10\/Codemaps-e1382377796460.png\" \/>\n<meta name=\"author\" content=\"Cees\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Cees\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/\",\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/\",\"name\":\"ICCV13: Codemaps Segment, Classify and Search Objects Locally - Cees Snoek\",\"isPartOf\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/#primaryimage\"},\"thumbnailUrl\":\"http:\/\/www.ceessnoek.info\/wp-content\/uploads\/2013\/10\/Codemaps-e1382377796460.png\",\"datePublished\":\"2013-10-21T21:29:29+00:00\",\"author\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/#primaryimage\",\"url\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2013\/10\/Codemaps-e1382377796460.png\",\"contentUrl\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2013\/10\/Codemaps-e1382377796460.png\",\"width\":325,\"height\":405},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.ceessnoek.info\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"ICCV13: Codemaps Segment, Classify and Search Objects Locally\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.ceessnoek.info\/#website\",\"url\":\"https:\/\/www.ceessnoek.info\/\",\"name\":\"Cees Snoek\",\"description\":\"research on video and image ai\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.ceessnoek.info\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\",\"name\":\"Cees\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"caption\":\"Cees\"},\"sameAs\":[\"http:\/\/www.CeesSnoek.info\"],\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"ICCV13: Codemaps Segment, Classify and Search Objects Locally - Cees Snoek","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/","og_locale":"en_US","og_type":"article","og_title":"ICCV13: Codemaps Segment, Classify and Search Objects Locally - Cees Snoek","og_description":"The ICCV13 paper entitled \u201cCodemaps Segment, Classify and Search Objects Locally\u201d by Zhenyang Li, Efstratios Gavves, Koen van de Sande, Cees Snoek, and Arnold Smeulders is now also available. In this paper we aim for segmentation and classification of objects. We propose codemaps that are a joint formulation of the classification score and the local [&hellip;]","og_url":"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/","og_site_name":"Cees Snoek","article_published_time":"2013-10-21T21:29:29+00:00","og_image":[{"url":"http:\/\/www.ceessnoek.info\/wp-content\/uploads\/2013\/10\/Codemaps-e1382377796460.png","type":"","width":"","height":""}],"author":"Cees","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Cees","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/","url":"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/","name":"ICCV13: Codemaps Segment, Classify and Search Objects Locally - Cees Snoek","isPartOf":{"@id":"https:\/\/www.ceessnoek.info\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/#primaryimage"},"image":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/#primaryimage"},"thumbnailUrl":"http:\/\/www.ceessnoek.info\/wp-content\/uploads\/2013\/10\/Codemaps-e1382377796460.png","datePublished":"2013-10-21T21:29:29+00:00","author":{"@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1"},"breadcrumb":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/#primaryimage","url":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2013\/10\/Codemaps-e1382377796460.png","contentUrl":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2013\/10\/Codemaps-e1382377796460.png","width":325,"height":405},{"@type":"BreadcrumbList","@id":"https:\/\/www.ceessnoek.info\/index.php\/iccv13-codemaps-segment-classify-and-search-objects-locally\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ceessnoek.info\/"},{"@type":"ListItem","position":2,"name":"ICCV13: Codemaps Segment, Classify and Search Objects Locally"}]},{"@type":"WebSite","@id":"https:\/\/www.ceessnoek.info\/#website","url":"https:\/\/www.ceessnoek.info\/","name":"Cees Snoek","description":"research on video and image ai","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ceessnoek.info\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1","name":"Cees","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","caption":"Cees"},"sameAs":["http:\/\/www.CeesSnoek.info"],"url":"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/1143","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/comments?post=1143"}],"version-history":[{"count":3,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/1143\/revisions"}],"predecessor-version":[{"id":1147,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/1143\/revisions\/1147"}],"wp:attachment":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/media?parent=1143"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/categories?post=1143"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/tags?post=1143"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}