{"id":4006,"date":"2022-03-28T20:48:01","date_gmt":"2022-03-28T19:48:01","guid":{"rendered":"https:\/\/www.ceessnoek.info\/?p=4006"},"modified":"2022-03-28T20:55:20","modified_gmt":"2022-03-28T19:55:20","slug":"iclr-2022-learning-to-generalize-across-domains-on-single-test-samples","status":"publish","type":"post","link":"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/","title":{"rendered":"ICLR 2022: Learning to Generalize across Domains on Single Test Samples"},"content":{"rendered":"\n

The ICLR 2022 paper Learning to Generalize across Domains on Single Test Samples<\/em> by Zehao Xiao, Xiantong Zhen, Ling Shao and Cees G M Snoek is now available<\/a>. We strive to learn a model from a set of source domains that generalizes well to unseen target domains. The main challenge in such a domain generalization scenario is the unavailability of any target domain data during training, resulting in the learned model not being explicitly adapted to the unseen target domains. We propose learning to generalize across domains on single test samples. We leverage a meta-learning paradigm to learn our model to acquire the ability of adaptation with single samples at training time so as to further adapt itself to each single test sample at test time. We formulate the adaptation to the single test sample as a variational Bayesian inference problem, which incorporates the test sample as a conditional into the generation of model parameters. The adaptation to each test sample requires only one feed-forward computation at test time without any fine-tuning or self-supervised training on additional data from the unseen domains. Extensive ablation studies demonstrate that our model learns the ability to adapt models by mimicking domain shift during training. Further, our model achieves at least comparable — and often better — performance than state-of-the-art methods on multiple benchmarks for domain generalization.<\/p>\n\n\n\n

\"\"<\/a><\/figure>\n","protected":false},"excerpt":{"rendered":"

The ICLR 2022 paper Learning to Generalize across Domains on Single Test Samples by Zehao Xiao, Xiantong Zhen, Ling Shao and Cees G M Snoek is now available. We strive to learn a model from a set of source domains that generalizes well to unseen target domains. The main challenge in such a domain generalization […]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-4006","post","type-post","status-publish","format-standard","hentry","category-science"],"yoast_head":"\nICLR 2022: Learning to Generalize across Domains on Single Test Samples - Cees Snoek<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"ICLR 2022: Learning to Generalize across Domains on Single Test Samples - Cees Snoek\" \/>\n<meta property=\"og:description\" content=\"The ICLR 2022 paper Learning to Generalize across Domains on Single Test Samples by Zehao Xiao, Xiantong Zhen, Ling Shao and Cees G M Snoek is now available. We strive to learn a model from a set of source domains that generalizes well to unseen target domains. The main challenge in such a domain generalization […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/\" \/>\n<meta property=\"og:site_name\" content=\"Cees Snoek\" \/>\n<meta property=\"article:published_time\" content=\"2022-03-28T19:48:01+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-03-28T19:55:20+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/03\/zehao.png\" \/>\n<meta name=\"author\" content=\"Cees\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Cees\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/\",\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/\",\"name\":\"ICLR 2022: Learning to Generalize across Domains on Single Test Samples - Cees Snoek\",\"isPartOf\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/03\/zehao.png\",\"datePublished\":\"2022-03-28T19:48:01+00:00\",\"dateModified\":\"2022-03-28T19:55:20+00:00\",\"author\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/#primaryimage\",\"url\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/03\/zehao.png\",\"contentUrl\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/03\/zehao.png\",\"width\":2254,\"height\":882},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.ceessnoek.info\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"ICLR 2022: Learning to Generalize across Domains on Single Test Samples\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.ceessnoek.info\/#website\",\"url\":\"https:\/\/www.ceessnoek.info\/\",\"name\":\"Cees Snoek\",\"description\":\"research on video and image ai\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.ceessnoek.info\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\",\"name\":\"Cees\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"caption\":\"Cees\"},\"sameAs\":[\"http:\/\/www.CeesSnoek.info\"],\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"ICLR 2022: Learning to Generalize across Domains on Single Test Samples - Cees Snoek","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/","og_locale":"en_US","og_type":"article","og_title":"ICLR 2022: Learning to Generalize across Domains on Single Test Samples - Cees Snoek","og_description":"The ICLR 2022 paper Learning to Generalize across Domains on Single Test Samples by Zehao Xiao, Xiantong Zhen, Ling Shao and Cees G M Snoek is now available. We strive to learn a model from a set of source domains that generalizes well to unseen target domains. The main challenge in such a domain generalization […]","og_url":"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/","og_site_name":"Cees Snoek","article_published_time":"2022-03-28T19:48:01+00:00","article_modified_time":"2022-03-28T19:55:20+00:00","og_image":[{"url":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/03\/zehao.png","type":"","width":"","height":""}],"author":"Cees","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Cees","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/","url":"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/","name":"ICLR 2022: Learning to Generalize across Domains on Single Test Samples - Cees Snoek","isPartOf":{"@id":"https:\/\/www.ceessnoek.info\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/#primaryimage"},"image":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/#primaryimage"},"thumbnailUrl":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/03\/zehao.png","datePublished":"2022-03-28T19:48:01+00:00","dateModified":"2022-03-28T19:55:20+00:00","author":{"@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1"},"breadcrumb":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/#primaryimage","url":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/03\/zehao.png","contentUrl":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2022\/03\/zehao.png","width":2254,"height":882},{"@type":"BreadcrumbList","@id":"https:\/\/www.ceessnoek.info\/index.php\/iclr-2022-learning-to-generalize-across-domains-on-single-test-samples\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ceessnoek.info\/"},{"@type":"ListItem","position":2,"name":"ICLR 2022: Learning to Generalize across Domains on Single Test Samples"}]},{"@type":"WebSite","@id":"https:\/\/www.ceessnoek.info\/#website","url":"https:\/\/www.ceessnoek.info\/","name":"Cees Snoek","description":"research on video and image ai","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ceessnoek.info\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1","name":"Cees","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","caption":"Cees"},"sameAs":["http:\/\/www.CeesSnoek.info"],"url":"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/4006","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/comments?post=4006"}],"version-history":[{"count":1,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/4006\/revisions"}],"predecessor-version":[{"id":4008,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/4006\/revisions\/4008"}],"wp:attachment":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/media?parent=4006"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/categories?post=4006"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/tags?post=4006"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}