{"id":3858,"date":"2021-06-04T09:29:24","date_gmt":"2021-06-04T08:29:24","guid":{"rendered":"https:\/\/www.ceessnoek.info\/?p=3858"},"modified":"2021-06-04T09:30:34","modified_gmt":"2021-06-04T08:30:34","slug":"acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation","status":"publish","type":"post","link":"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/","title":{"rendered":"ACL 2021: Meta-Learning with Variational Semantic Memory for Word Sense Disambiguation"},"content":{"rendered":"\n

The ACL-IJCNLP 2021 paper entitled ‘Meta-Learning with Variational Semantic Memory for Word Sense Disambiguation<\/em>‘ by Yingjun Du, Nithin Holla, Xiantong Zhen, Cees Snoek, Ekaterina Shutova is now available<\/a>.\u00a0A critical challenge faced by supervised word sense disambiguation (WSD) is the lack of large annotated datasets with sufficient coverage of words in their diversity of senses. This inspired recent research on few-shot WSD using meta-learning. While such work has successfully applied meta-learning to learn new word senses from very few examples, its performance still lags behind its fully-supervised counterpart. Aiming to further close this gap, we propose a model of semantic memory for WSD in a meta-learning setting. Semantic memory encapsulates prior experiences seen throughout the lifetime of the model, which aids better generalization in limited data settings. Our model is based on hierarchical variational inference and incorporates an adaptive memory update rule via a hypernetwork. We show our model advances the state of the art in few-shot WSD, supports effective learning in extremely data scarce (e.g. one-shot) scenarios and produces meaning prototypes that capture similar senses of distinct words.<\/p>\n\n\n\n

\"\"<\/a><\/figure>\n","protected":false},"excerpt":{"rendered":"

The ACL-IJCNLP 2021 paper entitled ‘Meta-Learning with Variational Semantic Memory for Word Sense Disambiguation‘ by Yingjun Du, Nithin Holla, Xiantong Zhen, Cees Snoek, Ekaterina Shutova is now available.\u00a0A critical challenge faced by supervised word sense disambiguation (WSD) is the lack of large annotated datasets with sufficient coverage of words in their diversity of senses. This […]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-3858","post","type-post","status-publish","format-standard","hentry","category-science"],"yoast_head":"\nACL 2021: Meta-Learning with Variational Semantic Memory for Word Sense Disambiguation - Cees Snoek<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"ACL 2021: Meta-Learning with Variational Semantic Memory for Word Sense Disambiguation - Cees Snoek\" \/>\n<meta property=\"og:description\" content=\"The ACL-IJCNLP 2021 paper entitled ‘Meta-Learning with Variational Semantic Memory for Word Sense Disambiguation‘ by Yingjun Du, Nithin Holla, Xiantong Zhen, Cees Snoek, Ekaterina Shutova is now available.\u00a0A critical challenge faced by supervised word sense disambiguation (WSD) is the lack of large annotated datasets with sufficient coverage of words in their diversity of senses. This […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/\" \/>\n<meta property=\"og:site_name\" content=\"Cees Snoek\" \/>\n<meta property=\"article:published_time\" content=\"2021-06-04T08:29:24+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-06-04T08:30:34+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2021\/05\/du-wsd.png\" \/>\n<meta name=\"author\" content=\"Cees\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Cees\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/\",\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/\",\"name\":\"ACL 2021: Meta-Learning with Variational Semantic Memory for Word Sense Disambiguation - Cees Snoek\",\"isPartOf\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2021\/05\/du-wsd.png\",\"datePublished\":\"2021-06-04T08:29:24+00:00\",\"dateModified\":\"2021-06-04T08:30:34+00:00\",\"author\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/#primaryimage\",\"url\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2021\/05\/du-wsd.png\",\"contentUrl\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2021\/05\/du-wsd.png\",\"width\":444,\"height\":356},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.ceessnoek.info\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"ACL 2021: Meta-Learning with Variational Semantic Memory for Word Sense Disambiguation\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.ceessnoek.info\/#website\",\"url\":\"https:\/\/www.ceessnoek.info\/\",\"name\":\"Cees Snoek\",\"description\":\"research on video and image ai\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.ceessnoek.info\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\",\"name\":\"Cees\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"caption\":\"Cees\"},\"sameAs\":[\"http:\/\/www.CeesSnoek.info\"],\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"ACL 2021: Meta-Learning with Variational Semantic Memory for Word Sense Disambiguation - Cees Snoek","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/","og_locale":"en_US","og_type":"article","og_title":"ACL 2021: Meta-Learning with Variational Semantic Memory for Word Sense Disambiguation - Cees Snoek","og_description":"The ACL-IJCNLP 2021 paper entitled ‘Meta-Learning with Variational Semantic Memory for Word Sense Disambiguation‘ by Yingjun Du, Nithin Holla, Xiantong Zhen, Cees Snoek, Ekaterina Shutova is now available.\u00a0A critical challenge faced by supervised word sense disambiguation (WSD) is the lack of large annotated datasets with sufficient coverage of words in their diversity of senses. This […]","og_url":"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/","og_site_name":"Cees Snoek","article_published_time":"2021-06-04T08:29:24+00:00","article_modified_time":"2021-06-04T08:30:34+00:00","og_image":[{"url":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2021\/05\/du-wsd.png","type":"","width":"","height":""}],"author":"Cees","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Cees","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/","url":"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/","name":"ACL 2021: Meta-Learning with Variational Semantic Memory for Word Sense Disambiguation - Cees Snoek","isPartOf":{"@id":"https:\/\/www.ceessnoek.info\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/#primaryimage"},"image":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/#primaryimage"},"thumbnailUrl":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2021\/05\/du-wsd.png","datePublished":"2021-06-04T08:29:24+00:00","dateModified":"2021-06-04T08:30:34+00:00","author":{"@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1"},"breadcrumb":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/#primaryimage","url":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2021\/05\/du-wsd.png","contentUrl":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2021\/05\/du-wsd.png","width":444,"height":356},{"@type":"BreadcrumbList","@id":"https:\/\/www.ceessnoek.info\/index.php\/acl-2021-meta-learning-with-variational-semantic-memory-for-word-sense-disambiguation\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ceessnoek.info\/"},{"@type":"ListItem","position":2,"name":"ACL 2021: Meta-Learning with Variational Semantic Memory for Word Sense Disambiguation"}]},{"@type":"WebSite","@id":"https:\/\/www.ceessnoek.info\/#website","url":"https:\/\/www.ceessnoek.info\/","name":"Cees Snoek","description":"research on video and image ai","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ceessnoek.info\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1","name":"Cees","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","caption":"Cees"},"sameAs":["http:\/\/www.CeesSnoek.info"],"url":"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/3858","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/comments?post=3858"}],"version-history":[{"count":2,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/3858\/revisions"}],"predecessor-version":[{"id":3860,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/3858\/revisions\/3860"}],"wp:attachment":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/media?parent=3858"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/categories?post=3858"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/tags?post=3858"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}