{"id":333,"date":"2009-08-25T18:25:17","date_gmt":"2009-08-25T17:25:17","guid":{"rendered":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/?p=333"},"modified":"2009-08-26T15:49:31","modified_gmt":"2009-08-26T14:49:31","slug":"evaluating-color-descriptors-for-object-and-scene-recognition","status":"publish","type":"post","link":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/","title":{"rendered":"Evaluating Color Descriptors for Object and Scene Recognition"},"content":{"rendered":"<p><a href=\"http:\/\/www.colordescriptors.com\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright size-medium wp-image-334\" title=\"colordescriptors_small\" src=\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/08\/colordescriptors_small-300x215.png\" alt=\"colordescriptors_small\" width=\"300\" height=\"215\" align=\"right\" srcset=\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2009\/08\/colordescriptors_small-300x215.png 300w, https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2009\/08\/colordescriptors_small.png 768w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>A preprint of the paper <em>Evaluating Color Descriptors for Object and Scene Recognition<\/em> by <a href=\"http:\/\/staff.science.uva.nl\/~ksande\" target=\"_blank\">Koen van de Sande<\/a>, <a href=\"http:\/\/staff.science.uva.nl\/~gevers\" target=\"_blank\">Theo Gevers<\/a>, and myself is <a href=\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/pub\/sande-colordescriptors-pami.pdf\" target=\"_blank\">available online now<\/a>. In this paper we study visual descriptors, which are an important prerequisite to access visual information on the level of objects and scene types. So far, intensity-based descriptors have been widely used for feature extraction at salient points. To increase illumination invariance and discriminative power, color descriptors have been proposed. Because many different descriptors exist, a structured overview is required of color invariant descriptors in the context of image category recognition. Therefore, this paper studies the invariance properties and the distinctiveness of color descriptors in a structured way. The analytical invariance properties of color descriptors are explored, using a taxonomy based on invariance properties with respect to photometric transformations, and tested experimentally using a dataset with known illumination conditions. In addition, the distinctiveness of color descriptors is assessed experimentally using two benchmarks, one from the image domain and one from the video domain. From the theoretical and experimental results, it can be derived that invariance to light intensity changes and light color changes affects category recognition. The results reveal further that, for light intensity shifts, the usefulness of invariance is category-specific. Overall, when choosing a single descriptor and no prior knowledge about the dataset and object and scene categories is available, the OpponentSIFT is recommended. Furthermore, a combined set of color descriptors outperforms intensity-based SIFT and improves category recognition by 8% on the PASCAL VOC 2007 and by 7% on the Mediamill Challenge. The paper appears in <em>IEEE Transactions on Pattern Analysis and Machine Intelligence<\/em>, the software is available on <a href=\"http:\/\/www.colordescriptors.com\" target=\"_blank\">www.colordescriptors.com<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A preprint of the paper Evaluating Color Descriptors for Object and Scene Recognition by Koen van de Sande, Theo Gevers, and myself is available online now. In this paper we study visual descriptors, which are an important prerequisite to access visual information on the level of objects and scene types. So far, intensity-based descriptors have [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-333","post","type-post","status-publish","format-standard","hentry","category-science"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Evaluating Color Descriptors for Object and Scene Recognition - Cees Snoek<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Evaluating Color Descriptors for Object and Scene Recognition - Cees Snoek\" \/>\n<meta property=\"og:description\" content=\"A preprint of the paper Evaluating Color Descriptors for Object and Scene Recognition by Koen van de Sande, Theo Gevers, and myself is available online now. In this paper we study visual descriptors, which are an important prerequisite to access visual information on the level of objects and scene types. So far, intensity-based descriptors have [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/\" \/>\n<meta property=\"og:site_name\" content=\"Cees Snoek\" \/>\n<meta property=\"article:published_time\" content=\"2009-08-25T17:25:17+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2009-08-26T14:49:31+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/08\/colordescriptors_small-300x215.png\" \/>\n<meta name=\"author\" content=\"Cees\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Cees\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/\",\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/\",\"name\":\"Evaluating Color Descriptors for Object and Scene Recognition - Cees Snoek\",\"isPartOf\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/#primaryimage\"},\"thumbnailUrl\":\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/08\/colordescriptors_small-300x215.png\",\"datePublished\":\"2009-08-25T17:25:17+00:00\",\"dateModified\":\"2009-08-26T14:49:31+00:00\",\"author\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/#primaryimage\",\"url\":\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/08\/colordescriptors_small-300x215.png\",\"contentUrl\":\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/08\/colordescriptors_small-300x215.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.ceessnoek.info\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Evaluating Color Descriptors for Object and Scene Recognition\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.ceessnoek.info\/#website\",\"url\":\"https:\/\/www.ceessnoek.info\/\",\"name\":\"Cees Snoek\",\"description\":\"research on video and image ai\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.ceessnoek.info\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\",\"name\":\"Cees\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"caption\":\"Cees\"},\"sameAs\":[\"http:\/\/www.CeesSnoek.info\"],\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Evaluating Color Descriptors for Object and Scene Recognition - Cees Snoek","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/","og_locale":"en_US","og_type":"article","og_title":"Evaluating Color Descriptors for Object and Scene Recognition - Cees Snoek","og_description":"A preprint of the paper Evaluating Color Descriptors for Object and Scene Recognition by Koen van de Sande, Theo Gevers, and myself is available online now. In this paper we study visual descriptors, which are an important prerequisite to access visual information on the level of objects and scene types. So far, intensity-based descriptors have [&hellip;]","og_url":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/","og_site_name":"Cees Snoek","article_published_time":"2009-08-25T17:25:17+00:00","article_modified_time":"2009-08-26T14:49:31+00:00","og_image":[{"url":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/08\/colordescriptors_small-300x215.png","type":"","width":"","height":""}],"author":"Cees","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Cees","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/","url":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/","name":"Evaluating Color Descriptors for Object and Scene Recognition - Cees Snoek","isPartOf":{"@id":"https:\/\/www.ceessnoek.info\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/#primaryimage"},"image":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/#primaryimage"},"thumbnailUrl":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/08\/colordescriptors_small-300x215.png","datePublished":"2009-08-25T17:25:17+00:00","dateModified":"2009-08-26T14:49:31+00:00","author":{"@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1"},"breadcrumb":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/#primaryimage","url":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/08\/colordescriptors_small-300x215.png","contentUrl":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/08\/colordescriptors_small-300x215.png"},{"@type":"BreadcrumbList","@id":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-color-descriptors-for-object-and-scene-recognition\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ceessnoek.info\/"},{"@type":"ListItem","position":2,"name":"Evaluating Color Descriptors for Object and Scene Recognition"}]},{"@type":"WebSite","@id":"https:\/\/www.ceessnoek.info\/#website","url":"https:\/\/www.ceessnoek.info\/","name":"Cees Snoek","description":"research on video and image ai","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ceessnoek.info\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1","name":"Cees","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","caption":"Cees"},"sameAs":["http:\/\/www.CeesSnoek.info"],"url":"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/333","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/comments?post=333"}],"version-history":[{"count":3,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/333\/revisions"}],"predecessor-version":[{"id":336,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/333\/revisions\/336"}],"wp:attachment":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/media?parent=333"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/categories?post=333"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/tags?post=333"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}