{"id":4125,"date":"2022-10-16T12:13:36","date_gmt":"2022-10-16T11:13:36","guid":{"rendered":"https:\/\/www.ceessnoek.info\/?p=4125"},"modified":"2022-10-16T12:14:11","modified_gmt":"2022-10-16T11:14:11","slug":"neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts","status":"publish","type":"post","link":"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/","title":{"rendered":"NeurIPS 2022: Association Graph Learning for Multi-Task Classification with Category Shifts"},"content":{"rendered":"\n

The NeurIPS 2022 paper “Association Graph Learning for Multi-Task Classification with Category Shifts<\/em>” by Jiayi Shen, Zehao Xiao, Xiantong Zhen, Cees Snoek and Marcel Worring is now available<\/a>. In this paper, we focus on multi-task classification, where related classification tasks share the same label space and are learned simultaneously. In particular, we tackle a new setting, which is more realistic than currently addressed in the literature, where categories shift from training to test data. Hence, individual tasks do not contain complete training data for the categories in the test set. To generalize to such test data, it is crucial for individual tasks to leverage knowledge from related tasks. To this end, we propose learning an association graph to transfer knowledge among tasks for missing classes. We construct the association graph with nodes representing tasks, classes and instances, and encode the relationships among the nodes in the edges to guide their mutual knowledge transfer. By message passing on the association graph, our model enhances the categorical information of each instance, making it more discriminative. To avoid spurious correlations between task and class nodes in the graph, we introduce an assignment entropy maximization that encourages each class node to balance its edge weights. This enables all tasks to fully utilize the categorical information from related tasks. An extensive evaluation on three general benchmarks and a medical dataset for skin lesion classification reveals that our method consistently performs better than representative baselines.<\/p>\n\n\n\n

\"\"<\/a><\/figure>\n","protected":false},"excerpt":{"rendered":"

The NeurIPS 2022 paper “Association Graph Learning for Multi-Task Classification with Category Shifts” by Jiayi Shen, Zehao Xiao, Xiantong Zhen, Cees Snoek and Marcel Worring is now available. In this paper, we focus on multi-task classification, where related classification tasks share the same label space and are learned simultaneously. In particular, we tackle a new […]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-4125","post","type-post","status-publish","format-standard","hentry","category-science"],"yoast_head":"\nNeurIPS 2022: Association Graph Learning for Multi-Task Classification with Category Shifts - Cees Snoek<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"NeurIPS 2022: Association Graph Learning for Multi-Task Classification with Category Shifts - Cees Snoek\" \/>\n<meta property=\"og:description\" content=\"The NeurIPS 2022 paper “Association Graph Learning for Multi-Task Classification with Category Shifts” by Jiayi Shen, Zehao Xiao, Xiantong Zhen, Cees Snoek and Marcel Worring is now available. In this paper, we focus on multi-task classification, where related classification tasks share the same label space and are learned simultaneously. In particular, we tackle a new […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/\" \/>\n<meta property=\"og:site_name\" content=\"Cees Snoek\" \/>\n<meta property=\"article:published_time\" content=\"2022-10-16T11:13:36+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-10-16T11:14:11+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/10\/category-shifts.png\" \/>\n<meta name=\"author\" content=\"Cees\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Cees\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/\",\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/\",\"name\":\"NeurIPS 2022: Association Graph Learning for Multi-Task Classification with Category Shifts - Cees Snoek\",\"isPartOf\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/10\/category-shifts.png\",\"datePublished\":\"2022-10-16T11:13:36+00:00\",\"dateModified\":\"2022-10-16T11:14:11+00:00\",\"author\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/#primaryimage\",\"url\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/10\/category-shifts.png\",\"contentUrl\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/10\/category-shifts.png\",\"width\":2528,\"height\":680},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.ceessnoek.info\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"NeurIPS 2022: Association Graph Learning for Multi-Task Classification with Category Shifts\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.ceessnoek.info\/#website\",\"url\":\"https:\/\/www.ceessnoek.info\/\",\"name\":\"Cees Snoek\",\"description\":\"research on video and image ai\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.ceessnoek.info\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\",\"name\":\"Cees\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"caption\":\"Cees\"},\"sameAs\":[\"http:\/\/www.CeesSnoek.info\"],\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"NeurIPS 2022: Association Graph Learning for Multi-Task Classification with Category Shifts - Cees Snoek","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/","og_locale":"en_US","og_type":"article","og_title":"NeurIPS 2022: Association Graph Learning for Multi-Task Classification with Category Shifts - Cees Snoek","og_description":"The NeurIPS 2022 paper “Association Graph Learning for Multi-Task Classification with Category Shifts” by Jiayi Shen, Zehao Xiao, Xiantong Zhen, Cees Snoek and Marcel Worring is now available. In this paper, we focus on multi-task classification, where related classification tasks share the same label space and are learned simultaneously. In particular, we tackle a new […]","og_url":"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/","og_site_name":"Cees Snoek","article_published_time":"2022-10-16T11:13:36+00:00","article_modified_time":"2022-10-16T11:14:11+00:00","og_image":[{"url":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/10\/category-shifts.png","type":"","width":"","height":""}],"author":"Cees","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Cees","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/","url":"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/","name":"NeurIPS 2022: Association Graph Learning for Multi-Task Classification with Category Shifts - Cees Snoek","isPartOf":{"@id":"https:\/\/www.ceessnoek.info\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/#primaryimage"},"image":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/#primaryimage"},"thumbnailUrl":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/10\/category-shifts.png","datePublished":"2022-10-16T11:13:36+00:00","dateModified":"2022-10-16T11:14:11+00:00","author":{"@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1"},"breadcrumb":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/#primaryimage","url":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/10\/category-shifts.png","contentUrl":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/10\/category-shifts.png","width":2528,"height":680},{"@type":"BreadcrumbList","@id":"https:\/\/www.ceessnoek.info\/index.php\/neurips-2022-association-graph-learning-for-multi-task-classification-with-category-shifts\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ceessnoek.info\/"},{"@type":"ListItem","position":2,"name":"NeurIPS 2022: Association Graph Learning for Multi-Task Classification with Category Shifts"}]},{"@type":"WebSite","@id":"https:\/\/www.ceessnoek.info\/#website","url":"https:\/\/www.ceessnoek.info\/","name":"Cees Snoek","description":"research on video and image ai","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ceessnoek.info\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1","name":"Cees","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","caption":"Cees"},"sameAs":["http:\/\/www.CeesSnoek.info"],"url":"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/4125","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/comments?post=4125"}],"version-history":[{"count":1,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/4125\/revisions"}],"predecessor-version":[{"id":4127,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/4125\/revisions\/4127"}],"wp:attachment":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/media?parent=4125"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/categories?post=4125"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/tags?post=4125"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}