{"id":1071,"date":"2013-06-17T12:40:27","date_gmt":"2013-06-17T11:40:27","guid":{"rendered":"http:\/\/www.ceessnoek.info\/?p=1071"},"modified":"2013-06-17T12:40:27","modified_gmt":"2013-06-17T11:40:27","slug":"evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media","status":"publish","type":"post","link":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/","title":{"rendered":"Evaluating Sources and Strategies for Learning Video Concepts from Social Media"},"content":{"rendered":"

The CBMI’13 paper “Evaluating Sources and Strategies for Learning Video Concepts from Social Media” by Svetlana Kordumova, Xirong Li and Cees Snoek is now available<\/a>.\u00a0Learning video concept detectors from social media sources, such as Flickr images and YouTube videos, has the potential to address a wide variety of concept queries for video search. While the potential has been recognized by many, and progress on the topic has been impressive, we argue that two key questions, i.e., What visual tagging source is most suited for selecting positive training examples to learn video concepts? and What strategy should be used for selecting positive examples from tagged sources?, remain open. As an initial attempt to answer the two questions, we conduct an experimental study using a video search engine which is capable of learning concept detectors from social media, be it socially tagged videos or socially tagged images.Within the video search engine we investigate six strategies of positive examples selection. The performance is evaluated on the challenging TRECVID benchmark 2011 with 400 hours of Internet videos. The new experiments lead to novel and nontrivial findings: (1) tagged images are a better source for learning video concepts from the web, (2) selecting tag relevant examples as positives for learning video concepts is always beneficial and it can be done automatically and (3) the best source and strategy compare favorably against several present-day methods.<\/p>\n

\"sources-strategies\"<\/p>\n","protected":false},"excerpt":{"rendered":"

The CBMI’13 paper “Evaluating Sources and Strategies for Learning Video Concepts from Social Media” by Svetlana Kordumova, Xirong Li and Cees Snoek is now available.\u00a0Learning video concept detectors from social media sources, such as Flickr images and YouTube videos, has the potential to address a wide variety of concept queries for video search. While the […]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-1071","post","type-post","status-publish","format-standard","hentry","category-science"],"yoast_head":"\nEvaluating Sources and Strategies for Learning Video Concepts from Social Media - Cees Snoek<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Evaluating Sources and Strategies for Learning Video Concepts from Social Media - Cees Snoek\" \/>\n<meta property=\"og:description\" content=\"The CBMI’13 paper “Evaluating Sources and Strategies for Learning Video Concepts from Social Media” by Svetlana Kordumova, Xirong Li and Cees Snoek is now available.\u00a0Learning video concept detectors from social media sources, such as Flickr images and YouTube videos, has the potential to address a wide variety of concept queries for video search. While the […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/\" \/>\n<meta property=\"og:site_name\" content=\"Cees Snoek\" \/>\n<meta property=\"article:published_time\" content=\"2013-06-17T11:40:27+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/www.ceessnoek.info\/wp-content\/uploads\/2013\/06\/sources-strategies.jpg\" \/>\n<meta name=\"author\" content=\"Cees\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Cees\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/\",\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/\",\"name\":\"Evaluating Sources and Strategies for Learning Video Concepts from Social Media - Cees Snoek\",\"isPartOf\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/#primaryimage\"},\"thumbnailUrl\":\"http:\/\/www.ceessnoek.info\/wp-content\/uploads\/2013\/06\/sources-strategies.jpg\",\"datePublished\":\"2013-06-17T11:40:27+00:00\",\"author\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/#primaryimage\",\"url\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2013\/06\/sources-strategies.jpg\",\"contentUrl\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2013\/06\/sources-strategies.jpg\",\"width\":600,\"height\":273},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.ceessnoek.info\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Evaluating Sources and Strategies for Learning Video Concepts from Social Media\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.ceessnoek.info\/#website\",\"url\":\"https:\/\/www.ceessnoek.info\/\",\"name\":\"Cees Snoek\",\"description\":\"research on video and image ai\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.ceessnoek.info\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\",\"name\":\"Cees\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"caption\":\"Cees\"},\"sameAs\":[\"http:\/\/www.CeesSnoek.info\"],\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Evaluating Sources and Strategies for Learning Video Concepts from Social Media - Cees Snoek","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/","og_locale":"en_US","og_type":"article","og_title":"Evaluating Sources and Strategies for Learning Video Concepts from Social Media - Cees Snoek","og_description":"The CBMI’13 paper “Evaluating Sources and Strategies for Learning Video Concepts from Social Media” by Svetlana Kordumova, Xirong Li and Cees Snoek is now available.\u00a0Learning video concept detectors from social media sources, such as Flickr images and YouTube videos, has the potential to address a wide variety of concept queries for video search. While the […]","og_url":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/","og_site_name":"Cees Snoek","article_published_time":"2013-06-17T11:40:27+00:00","og_image":[{"url":"http:\/\/www.ceessnoek.info\/wp-content\/uploads\/2013\/06\/sources-strategies.jpg","type":"","width":"","height":""}],"author":"Cees","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Cees","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/","url":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/","name":"Evaluating Sources and Strategies for Learning Video Concepts from Social Media - Cees Snoek","isPartOf":{"@id":"https:\/\/www.ceessnoek.info\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/#primaryimage"},"image":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/#primaryimage"},"thumbnailUrl":"http:\/\/www.ceessnoek.info\/wp-content\/uploads\/2013\/06\/sources-strategies.jpg","datePublished":"2013-06-17T11:40:27+00:00","author":{"@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1"},"breadcrumb":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/#primaryimage","url":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2013\/06\/sources-strategies.jpg","contentUrl":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2013\/06\/sources-strategies.jpg","width":600,"height":273},{"@type":"BreadcrumbList","@id":"https:\/\/www.ceessnoek.info\/index.php\/evaluating-sources-and-strategies-for-learning-video-concepts-from-social-media\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ceessnoek.info\/"},{"@type":"ListItem","position":2,"name":"Evaluating Sources and Strategies for Learning Video Concepts from Social Media"}]},{"@type":"WebSite","@id":"https:\/\/www.ceessnoek.info\/#website","url":"https:\/\/www.ceessnoek.info\/","name":"Cees Snoek","description":"research on video and image ai","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ceessnoek.info\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1","name":"Cees","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","caption":"Cees"},"sameAs":["http:\/\/www.CeesSnoek.info"],"url":"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/1071","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/comments?post=1071"}],"version-history":[{"count":2,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/1071\/revisions"}],"predecessor-version":[{"id":1075,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/1071\/revisions\/1075"}],"wp:attachment":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/media?parent=1071"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/categories?post=1071"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/tags?post=1071"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}