{"id":4217,"date":"2023-04-17T21:18:41","date_gmt":"2023-04-17T20:18:41","guid":{"rendered":"https:\/\/www.ceessnoek.info\/?p=4217"},"modified":"2023-04-17T21:25:14","modified_gmt":"2023-04-17T20:25:14","slug":"cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail","status":"publish","type":"post","link":"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/","title":{"rendered":"CVPR 2023: SuperDisco: Super-Class Discovery Improves Visual Recognition for the Long-Tail"},"content":{"rendered":"\n<p>The CVPR 2023 paper <em>SuperDisco: Super-Class Discovery Improves Visual Recognition for the Long-Tail <\/em>by Yingjun Du, Jiayi Shen, Xiantong Zhen, and Cees Snoek is <a href=\"https:\/\/arxiv.org\/abs\/2304.00101\">now available<\/a>. Modern image classifiers perform well on populated classes, while degrading considerably on tail classes with only a few instances. Humans, by contrast, effortlessly handle the long-tailed recognition challenge, since they can learn the tail representation based on different levels of semantic abstraction, making the learned tail features more discriminative. This phenomenon motivated us to propose SuperDisco, an algorithm that discovers super-class representations for long-tailed recognition using a graph model. We learn to construct the super-class graph to guide the representation learning to deal with long-tailed distributions. Through message passing on the super-class graph, image representations are rectified and refined by attending to the most relevant entities based on the semantic similarity among their super-classes. Moreover, we propose to meta-learn the super-class graph under the supervision of a prototype graph constructed from a small amount of imbalanced data. By doing so, we obtain a more robust super-class graph that further improves the long-tailed recognition performance. The consistent state-of-the-art experiments on the long-tailed CIFAR-100, ImageNet, Places and iNaturalist demonstrate the benefit of the discovered super-class graph for dealing with long-tailed distributions.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2023\/02\/yingjun-superdisco.png\"><img loading=\"lazy\" decoding=\"async\" width=\"1318\" height=\"1270\" src=\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2023\/02\/yingjun-superdisco.png\" alt=\"\" class=\"wp-image-4190\" srcset=\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2023\/02\/yingjun-superdisco.png 1318w, https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2023\/02\/yingjun-superdisco-300x289.png 300w, https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2023\/02\/yingjun-superdisco-1024x987.png 1024w, https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2023\/02\/yingjun-superdisco-768x740.png 768w\" sizes=\"auto, (max-width: 1318px) 100vw, 1318px\" \/><\/a><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>The CVPR 2023 paper SuperDisco: Super-Class Discovery Improves Visual Recognition for the Long-Tail by Yingjun Du, Jiayi Shen, Xiantong Zhen, and Cees Snoek is now available. Modern image classifiers perform well on populated classes, while degrading considerably on tail classes with only a few instances. Humans, by contrast, effortlessly handle the long-tailed recognition challenge, since [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-4217","post","type-post","status-publish","format-standard","hentry","category-science"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>CVPR 2023: SuperDisco: Super-Class Discovery Improves Visual Recognition for the Long-Tail - Cees Snoek<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"CVPR 2023: SuperDisco: Super-Class Discovery Improves Visual Recognition for the Long-Tail - Cees Snoek\" \/>\n<meta property=\"og:description\" content=\"The CVPR 2023 paper SuperDisco: Super-Class Discovery Improves Visual Recognition for the Long-Tail by Yingjun Du, Jiayi Shen, Xiantong Zhen, and Cees Snoek is now available. Modern image classifiers perform well on populated classes, while degrading considerably on tail classes with only a few instances. Humans, by contrast, effortlessly handle the long-tailed recognition challenge, since [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/\" \/>\n<meta property=\"og:site_name\" content=\"Cees Snoek\" \/>\n<meta property=\"article:published_time\" content=\"2023-04-17T20:18:41+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-04-17T20:25:14+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2023\/02\/yingjun-superdisco.png\" \/>\n<meta name=\"author\" content=\"Cees\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Cees\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/\",\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/\",\"name\":\"CVPR 2023: SuperDisco: Super-Class Discovery Improves Visual Recognition for the Long-Tail - Cees Snoek\",\"isPartOf\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2023\/02\/yingjun-superdisco.png\",\"datePublished\":\"2023-04-17T20:18:41+00:00\",\"dateModified\":\"2023-04-17T20:25:14+00:00\",\"author\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/#primaryimage\",\"url\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2023\/02\/yingjun-superdisco.png\",\"contentUrl\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2023\/02\/yingjun-superdisco.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.ceessnoek.info\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"CVPR 2023: SuperDisco: Super-Class Discovery Improves Visual Recognition for the Long-Tail\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.ceessnoek.info\/#website\",\"url\":\"https:\/\/www.ceessnoek.info\/\",\"name\":\"Cees Snoek\",\"description\":\"research on video and image ai\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.ceessnoek.info\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\",\"name\":\"Cees\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"caption\":\"Cees\"},\"sameAs\":[\"http:\/\/www.CeesSnoek.info\"],\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"CVPR 2023: SuperDisco: Super-Class Discovery Improves Visual Recognition for the Long-Tail - Cees Snoek","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/","og_locale":"en_US","og_type":"article","og_title":"CVPR 2023: SuperDisco: Super-Class Discovery Improves Visual Recognition for the Long-Tail - Cees Snoek","og_description":"The CVPR 2023 paper SuperDisco: Super-Class Discovery Improves Visual Recognition for the Long-Tail by Yingjun Du, Jiayi Shen, Xiantong Zhen, and Cees Snoek is now available. Modern image classifiers perform well on populated classes, while degrading considerably on tail classes with only a few instances. Humans, by contrast, effortlessly handle the long-tailed recognition challenge, since [&hellip;]","og_url":"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/","og_site_name":"Cees Snoek","article_published_time":"2023-04-17T20:18:41+00:00","article_modified_time":"2023-04-17T20:25:14+00:00","og_image":[{"url":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2023\/02\/yingjun-superdisco.png","type":"","width":"","height":""}],"author":"Cees","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Cees","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/","url":"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/","name":"CVPR 2023: SuperDisco: Super-Class Discovery Improves Visual Recognition for the Long-Tail - Cees Snoek","isPartOf":{"@id":"https:\/\/www.ceessnoek.info\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/#primaryimage"},"image":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/#primaryimage"},"thumbnailUrl":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2023\/02\/yingjun-superdisco.png","datePublished":"2023-04-17T20:18:41+00:00","dateModified":"2023-04-17T20:25:14+00:00","author":{"@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1"},"breadcrumb":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/#primaryimage","url":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2023\/02\/yingjun-superdisco.png","contentUrl":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2023\/02\/yingjun-superdisco.png"},{"@type":"BreadcrumbList","@id":"https:\/\/www.ceessnoek.info\/index.php\/cvpr-2023-superdisco-super-class-discovery-improves-visual-recognition-for-the-long-tail\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ceessnoek.info\/"},{"@type":"ListItem","position":2,"name":"CVPR 2023: SuperDisco: Super-Class Discovery Improves Visual Recognition for the Long-Tail"}]},{"@type":"WebSite","@id":"https:\/\/www.ceessnoek.info\/#website","url":"https:\/\/www.ceessnoek.info\/","name":"Cees Snoek","description":"research on video and image ai","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ceessnoek.info\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1","name":"Cees","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","caption":"Cees"},"sameAs":["http:\/\/www.CeesSnoek.info"],"url":"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/4217","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/comments?post=4217"}],"version-history":[{"count":1,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/4217\/revisions"}],"predecessor-version":[{"id":4218,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/4217\/revisions\/4218"}],"wp:attachment":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/media?parent=4217"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/categories?post=4217"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/tags?post=4217"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}