{"id":242,"date":"2009-03-19T18:27:35","date_gmt":"2009-03-19T17:27:35","guid":{"rendered":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/?p=242"},"modified":"2009-03-19T18:27:35","modified_gmt":"2009-03-19T17:27:35","slug":"annotating-images-by-harnessing-worldwide-user-tagged-photos","status":"publish","type":"post","link":"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/","title":{"rendered":"Annotating Images by Harnessing Worldwide User-Tagged Photos"},"content":{"rendered":"<p><a href=\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/pub\/li-annotating-images-icassp2009.pdf\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/03\/xirong-annotating-images.png\" alt=\"xirong-annotating-images\" width=\"251\" height=\"137\" align=\"right\" \/><\/a><\/p>\n<p>The paper entitled <em>&#8220;Annotating Images by Harnessing Worldwide User-Tagged Photos&#8221;<\/em> by Xirong Li, Cees Snoek, and Marcel Worring, which will appear in the proceedings of the forthcoming <a href=\"http:\/\/icassp09.com\/\" target=\"_blank\">ICASSP2009<\/a> conference, is <a href=\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/pub\/li-annotating-images-icassp2009.pdf\" target=\"_blank\">available online<\/a> now. Automatic image tagging is important yet challenging due to the semantic gap and the lack of learning examples to model a tag&#8217;s visual diversity. Meanwhile, social user tagging is creating rich multimedia content on the web. In this paper, we propose to combine the two tagging approaches in a search-based framework. For an unlabeled image, we first retrieve its visual neighbors from a large user-tagged image database. We then select relevant tags from the result images to annotate the unlabeled image. To tackle the unreliability and sparsity of user tagging, we introduce a joint-modality tag relevance estimation method which efficiently addresses both textual and visual clues. Experiments on 1.5 million Flickr photos and 10 000 Corel images verify the proposed method.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The paper entitled &#8220;Annotating Images by Harnessing Worldwide User-Tagged Photos&#8221; by Xirong Li, Cees Snoek, and Marcel Worring, which will appear in the proceedings of the forthcoming ICASSP2009 conference, is available online now. Automatic image tagging is important yet challenging due to the semantic gap and the lack of learning examples to model a tag&#8217;s [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-242","post","type-post","status-publish","format-standard","hentry","category-science"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Annotating Images by Harnessing Worldwide User-Tagged Photos - Cees Snoek<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Annotating Images by Harnessing Worldwide User-Tagged Photos - Cees Snoek\" \/>\n<meta property=\"og:description\" content=\"The paper entitled &#8220;Annotating Images by Harnessing Worldwide User-Tagged Photos&#8221; by Xirong Li, Cees Snoek, and Marcel Worring, which will appear in the proceedings of the forthcoming ICASSP2009 conference, is available online now. Automatic image tagging is important yet challenging due to the semantic gap and the lack of learning examples to model a tag&#8217;s [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/\" \/>\n<meta property=\"og:site_name\" content=\"Cees Snoek\" \/>\n<meta property=\"article:published_time\" content=\"2009-03-19T17:27:35+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/03\/xirong-annotating-images.png\" \/>\n<meta name=\"author\" content=\"Cees\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Cees\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/\",\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/\",\"name\":\"Annotating Images by Harnessing Worldwide User-Tagged Photos - Cees Snoek\",\"isPartOf\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/#primaryimage\"},\"thumbnailUrl\":\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/03\/xirong-annotating-images.png\",\"datePublished\":\"2009-03-19T17:27:35+00:00\",\"author\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/#primaryimage\",\"url\":\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/03\/xirong-annotating-images.png\",\"contentUrl\":\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/03\/xirong-annotating-images.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.ceessnoek.info\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Annotating Images by Harnessing Worldwide User-Tagged Photos\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.ceessnoek.info\/#website\",\"url\":\"https:\/\/www.ceessnoek.info\/\",\"name\":\"Cees Snoek\",\"description\":\"research on video and image ai\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.ceessnoek.info\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\",\"name\":\"Cees\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"caption\":\"Cees\"},\"sameAs\":[\"http:\/\/www.CeesSnoek.info\"],\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Annotating Images by Harnessing Worldwide User-Tagged Photos - Cees Snoek","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/","og_locale":"en_US","og_type":"article","og_title":"Annotating Images by Harnessing Worldwide User-Tagged Photos - Cees Snoek","og_description":"The paper entitled &#8220;Annotating Images by Harnessing Worldwide User-Tagged Photos&#8221; by Xirong Li, Cees Snoek, and Marcel Worring, which will appear in the proceedings of the forthcoming ICASSP2009 conference, is available online now. Automatic image tagging is important yet challenging due to the semantic gap and the lack of learning examples to model a tag&#8217;s [&hellip;]","og_url":"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/","og_site_name":"Cees Snoek","article_published_time":"2009-03-19T17:27:35+00:00","og_image":[{"url":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/03\/xirong-annotating-images.png","type":"","width":"","height":""}],"author":"Cees","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Cees","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/","url":"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/","name":"Annotating Images by Harnessing Worldwide User-Tagged Photos - Cees Snoek","isPartOf":{"@id":"https:\/\/www.ceessnoek.info\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/#primaryimage"},"image":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/#primaryimage"},"thumbnailUrl":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/03\/xirong-annotating-images.png","datePublished":"2009-03-19T17:27:35+00:00","author":{"@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1"},"breadcrumb":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/#primaryimage","url":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/03\/xirong-annotating-images.png","contentUrl":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/03\/xirong-annotating-images.png"},{"@type":"BreadcrumbList","@id":"https:\/\/www.ceessnoek.info\/index.php\/annotating-images-by-harnessing-worldwide-user-tagged-photos\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ceessnoek.info\/"},{"@type":"ListItem","position":2,"name":"Annotating Images by Harnessing Worldwide User-Tagged Photos"}]},{"@type":"WebSite","@id":"https:\/\/www.ceessnoek.info\/#website","url":"https:\/\/www.ceessnoek.info\/","name":"Cees Snoek","description":"research on video and image ai","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ceessnoek.info\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1","name":"Cees","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","caption":"Cees"},"sameAs":["http:\/\/www.CeesSnoek.info"],"url":"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/242","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/comments?post=242"}],"version-history":[{"count":3,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/242\/revisions"}],"predecessor-version":[{"id":246,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/242\/revisions\/246"}],"wp:attachment":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/media?parent=242"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/categories?post=242"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/tags?post=242"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}