{"id":3986,"date":"2022-02-21T16:19:26","date_gmt":"2022-02-21T15:19:26","guid":{"rendered":"https:\/\/www.ceessnoek.info\/?p=3986"},"modified":"2022-02-28T16:29:15","modified_gmt":"2022-02-28T15:29:15","slug":"diversely-supervised-visual-product-search","status":"publish","type":"post","link":"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/","title":{"rendered":"ToMM: Diversely-Supervised Visual Product Search"},"content":{"rendered":"\n<p>The paper Diversely-Supervised Visual Product Search by William Thong and Cees Snoek is published in <a href=\"https:\/\/isis-data.science.uva.nl\/cgmsnoek\/pub\/thong-diversely-tomm.pdf\">ACM Transactions on Multimedia Computing, Communications, and Application<\/a>s. This article strives for a diversely supervised visual product search, where queries specify a diverse set of labels to search for. Where previous works have focused on representing attribute, instance, or category labels individually, we consider them together to create a diverse set of labels for visually describing products. We learn an embedding from the supervisory signal provided by every label to encode their interrelationships. Once trained, every label has a corresponding visual representation in the embedding space, which is an aggregation of selected items from the training set. At search time, composite query representations retrieve images that match a specific set of diverse labels. We form composite query representations by averaging over the aggregated representations of each diverse label in the specific set. For evaluation, we extend existing product datasets of cars and clothes with a diverse set of labels. Experiments show the benefits of our embedding for diversely supervised visual product search in seen and unseen product combinations and for discovering product design styles.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/02\/thong-diversely.png\"><img loading=\"lazy\" decoding=\"async\" width=\"1732\" height=\"612\" src=\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/02\/thong-diversely.png\" alt=\"\" class=\"wp-image-3988\" srcset=\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/02\/thong-diversely.png 1732w, https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/02\/thong-diversely-300x106.png 300w, https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/02\/thong-diversely-1024x362.png 1024w, https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/02\/thong-diversely-768x271.png 768w, https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/02\/thong-diversely-1536x543.png 1536w\" sizes=\"auto, (max-width: 1732px) 100vw, 1732px\" \/><\/a><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>The paper Diversely-Supervised Visual Product Search by William Thong and Cees Snoek is published in ACM Transactions on Multimedia Computing, Communications, and Applications. This article strives for a diversely supervised visual product search, where queries specify a diverse set of labels to search for. Where previous works have focused on representing attribute, instance, or category [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-3986","post","type-post","status-publish","format-standard","hentry","category-science"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>ToMM: Diversely-Supervised Visual Product Search - Cees Snoek<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"ToMM: Diversely-Supervised Visual Product Search - Cees Snoek\" \/>\n<meta property=\"og:description\" content=\"The paper Diversely-Supervised Visual Product Search by William Thong and Cees Snoek is published in ACM Transactions on Multimedia Computing, Communications, and Applications. This article strives for a diversely supervised visual product search, where queries specify a diverse set of labels to search for. Where previous works have focused on representing attribute, instance, or category [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/\" \/>\n<meta property=\"og:site_name\" content=\"Cees Snoek\" \/>\n<meta property=\"article:published_time\" content=\"2022-02-21T15:19:26+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-02-28T15:29:15+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/02\/thong-diversely.png\" \/>\n<meta name=\"author\" content=\"Cees\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Cees\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/\",\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/\",\"name\":\"ToMM: Diversely-Supervised Visual Product Search - Cees Snoek\",\"isPartOf\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/02\/thong-diversely.png\",\"datePublished\":\"2022-02-21T15:19:26+00:00\",\"dateModified\":\"2022-02-28T15:29:15+00:00\",\"author\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/#primaryimage\",\"url\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/02\/thong-diversely.png\",\"contentUrl\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/02\/thong-diversely.png\",\"width\":1732,\"height\":612},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.ceessnoek.info\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"ToMM: Diversely-Supervised Visual Product Search\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.ceessnoek.info\/#website\",\"url\":\"https:\/\/www.ceessnoek.info\/\",\"name\":\"Cees Snoek\",\"description\":\"research on video and image ai\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.ceessnoek.info\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\",\"name\":\"Cees\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"caption\":\"Cees\"},\"sameAs\":[\"http:\/\/www.CeesSnoek.info\"],\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"ToMM: Diversely-Supervised Visual Product Search - Cees Snoek","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/","og_locale":"en_US","og_type":"article","og_title":"ToMM: Diversely-Supervised Visual Product Search - Cees Snoek","og_description":"The paper Diversely-Supervised Visual Product Search by William Thong and Cees Snoek is published in ACM Transactions on Multimedia Computing, Communications, and Applications. This article strives for a diversely supervised visual product search, where queries specify a diverse set of labels to search for. Where previous works have focused on representing attribute, instance, or category [&hellip;]","og_url":"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/","og_site_name":"Cees Snoek","article_published_time":"2022-02-21T15:19:26+00:00","article_modified_time":"2022-02-28T15:29:15+00:00","og_image":[{"url":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/02\/thong-diversely.png","type":"","width":"","height":""}],"author":"Cees","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Cees","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/","url":"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/","name":"ToMM: Diversely-Supervised Visual Product Search - Cees Snoek","isPartOf":{"@id":"https:\/\/www.ceessnoek.info\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/#primaryimage"},"image":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/#primaryimage"},"thumbnailUrl":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/02\/thong-diversely.png","datePublished":"2022-02-21T15:19:26+00:00","dateModified":"2022-02-28T15:29:15+00:00","author":{"@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1"},"breadcrumb":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/#primaryimage","url":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/02\/thong-diversely.png","contentUrl":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/02\/thong-diversely.png","width":1732,"height":612},{"@type":"BreadcrumbList","@id":"https:\/\/www.ceessnoek.info\/index.php\/diversely-supervised-visual-product-search\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ceessnoek.info\/"},{"@type":"ListItem","position":2,"name":"ToMM: Diversely-Supervised Visual Product Search"}]},{"@type":"WebSite","@id":"https:\/\/www.ceessnoek.info\/#website","url":"https:\/\/www.ceessnoek.info\/","name":"Cees Snoek","description":"research on video and image ai","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ceessnoek.info\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1","name":"Cees","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","caption":"Cees"},"sameAs":["http:\/\/www.CeesSnoek.info"],"url":"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/3986","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/comments?post=3986"}],"version-history":[{"count":3,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/3986\/revisions"}],"predecessor-version":[{"id":3996,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/3986\/revisions\/3996"}],"wp:attachment":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/media?parent=3986"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/categories?post=3986"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/tags?post=3986"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}