{"id":267,"date":"2009-04-24T08:57:10","date_gmt":"2009-04-24T07:57:10","guid":{"rendered":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/?p=267"},"modified":"2009-04-24T09:07:56","modified_gmt":"2009-04-24T08:07:56","slug":"learning-social-tag-relevance-by-neighbor-voting","status":"publish","type":"post","link":"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/","title":{"rendered":"Learning Social Tag Relevance by Neighbor Voting"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" title=\"tag_relevance_neighbor_voting\" src=\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/04\/neighbor_voting_idea-300x197.jpg\" alt=\"neighbor_voting_idea\" width=\"300\" height=\"197\" align=\"right\" \/><\/p>\n<p>The forthcoming IEEE Transactions on Multimedia paper by <a href=\"http:\/\/staff.science.uva.nl\/~xirong\">Xirong Li<\/a>, Cees Snoek, and <a href=\"http:\/\/staff.science.uva.nl\/~worring\/\" target=\"_blank\">Marcel Worring<\/a>, entitled &#8220;<em>Learning Social Tag Relevance by Neighbor Voting<\/em>&#8221; is <a href=\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/pub\/li-socialtagrelevance-tmm.pdf\" target=\"_blank\">available online now<\/a>. Social image analysis and retrieval is important for helping people organize and access the increasing amount of user-tagged multimedia. Since user tagging is known to be uncontrolled, ambiguous, and overly personalized, a fundamental problem is how to interpret the relevance of a user-contributed tag with respect to the visual content the tag is describing. Intuitively, if different persons label visually similar images using the same tags, these tags are likely to reflect objective aspects of the visual content. Starting from this intuition, we propose in this paper a neighbor voting algorithm which accurately and efficiently learns tag relevance by accumulating votes from visual neighbors. Under a set of well defined and realistic assumptions, we prove that our algorithm is a good tag relevance measurement for both image ranking and tag ranking. Three experiments on 3.5 million Flickr photos demonstrate the general applicability of our algorithm in both social image retrieval and image tag suggestion. Our tag relevance learning algorithm substantially improves upon baselines for all the experiments. The results suggest that the proposed algorithm is promising for real-world applications.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The forthcoming IEEE Transactions on Multimedia paper by Xirong Li, Cees Snoek, and Marcel Worring, entitled &#8220;Learning Social Tag Relevance by Neighbor Voting&#8221; is available online now. Social image analysis and retrieval is important for helping people organize and access the increasing amount of user-tagged multimedia. Since user tagging is known to be uncontrolled, ambiguous, [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-267","post","type-post","status-publish","format-standard","hentry","category-science"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Learning Social Tag Relevance by Neighbor Voting - Cees Snoek<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Learning Social Tag Relevance by Neighbor Voting - Cees Snoek\" \/>\n<meta property=\"og:description\" content=\"The forthcoming IEEE Transactions on Multimedia paper by Xirong Li, Cees Snoek, and Marcel Worring, entitled &#8220;Learning Social Tag Relevance by Neighbor Voting&#8221; is available online now. Social image analysis and retrieval is important for helping people organize and access the increasing amount of user-tagged multimedia. Since user tagging is known to be uncontrolled, ambiguous, [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/\" \/>\n<meta property=\"og:site_name\" content=\"Cees Snoek\" \/>\n<meta property=\"article:published_time\" content=\"2009-04-24T07:57:10+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2009-04-24T08:07:56+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/04\/neighbor_voting_idea-300x197.jpg\" \/>\n<meta name=\"author\" content=\"Cees\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Cees\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/\",\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/\",\"name\":\"Learning Social Tag Relevance by Neighbor Voting - Cees Snoek\",\"isPartOf\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/#primaryimage\"},\"thumbnailUrl\":\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/04\/neighbor_voting_idea-300x197.jpg\",\"datePublished\":\"2009-04-24T07:57:10+00:00\",\"dateModified\":\"2009-04-24T08:07:56+00:00\",\"author\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/#primaryimage\",\"url\":\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/04\/neighbor_voting_idea-300x197.jpg\",\"contentUrl\":\"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/04\/neighbor_voting_idea-300x197.jpg\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.ceessnoek.info\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Learning Social Tag Relevance by Neighbor Voting\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.ceessnoek.info\/#website\",\"url\":\"https:\/\/www.ceessnoek.info\/\",\"name\":\"Cees Snoek\",\"description\":\"research on video and image ai\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.ceessnoek.info\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\",\"name\":\"Cees\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"caption\":\"Cees\"},\"sameAs\":[\"http:\/\/www.CeesSnoek.info\"],\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Learning Social Tag Relevance by Neighbor Voting - Cees Snoek","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/","og_locale":"en_US","og_type":"article","og_title":"Learning Social Tag Relevance by Neighbor Voting - Cees Snoek","og_description":"The forthcoming IEEE Transactions on Multimedia paper by Xirong Li, Cees Snoek, and Marcel Worring, entitled &#8220;Learning Social Tag Relevance by Neighbor Voting&#8221; is available online now. Social image analysis and retrieval is important for helping people organize and access the increasing amount of user-tagged multimedia. Since user tagging is known to be uncontrolled, ambiguous, [&hellip;]","og_url":"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/","og_site_name":"Cees Snoek","article_published_time":"2009-04-24T07:57:10+00:00","article_modified_time":"2009-04-24T08:07:56+00:00","og_image":[{"url":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/04\/neighbor_voting_idea-300x197.jpg","type":"","width":"","height":""}],"author":"Cees","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Cees","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/","url":"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/","name":"Learning Social Tag Relevance by Neighbor Voting - Cees Snoek","isPartOf":{"@id":"https:\/\/www.ceessnoek.info\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/#primaryimage"},"image":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/#primaryimage"},"thumbnailUrl":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/04\/neighbor_voting_idea-300x197.jpg","datePublished":"2009-04-24T07:57:10+00:00","dateModified":"2009-04-24T08:07:56+00:00","author":{"@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1"},"breadcrumb":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/#primaryimage","url":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/04\/neighbor_voting_idea-300x197.jpg","contentUrl":"http:\/\/staff.science.uva.nl\/~cgmsnoek\/wp-content\/uploads\/2009\/04\/neighbor_voting_idea-300x197.jpg"},{"@type":"BreadcrumbList","@id":"https:\/\/www.ceessnoek.info\/index.php\/learning-social-tag-relevance-by-neighbor-voting\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ceessnoek.info\/"},{"@type":"ListItem","position":2,"name":"Learning Social Tag Relevance by Neighbor Voting"}]},{"@type":"WebSite","@id":"https:\/\/www.ceessnoek.info\/#website","url":"https:\/\/www.ceessnoek.info\/","name":"Cees Snoek","description":"research on video and image ai","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ceessnoek.info\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1","name":"Cees","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","caption":"Cees"},"sameAs":["http:\/\/www.CeesSnoek.info"],"url":"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/267","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/comments?post=267"}],"version-history":[{"count":3,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/267\/revisions"}],"predecessor-version":[{"id":270,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/267\/revisions\/270"}],"wp:attachment":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/media?parent=267"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/categories?post=267"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/tags?post=267"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}