{"id":4150,"date":"2022-12-10T12:48:06","date_gmt":"2022-12-10T11:48:06","guid":{"rendered":"https:\/\/www.ceessnoek.info\/?p=4150"},"modified":"2022-12-10T12:48:46","modified_gmt":"2022-12-10T11:48:46","slug":"log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets","status":"publish","type":"post","link":"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/","title":{"rendered":"LoG 2022: Pruning Edges and Gradients to Learn Hypergraphs from Larger Sets"},"content":{"rendered":"\n

The Learning on Graphs 2022 paper “Pruning Edges and Gradients to Learn Hypergraphs from Larger Sets<\/em>” by David W. Zhang, Gertjan Burghouts and Cees Snoek is now available<\/a>. This paper aims for set-to-hypergraph prediction, where the goal is to infer the set of relations for a given set of entities. This is a common abstraction for applications in particle physics, biological systems and combinatorial optimization. We address two common scaling problems encountered in set-to-hypergraph tasks that limit the size of the input set: the exponentially growing number of hyperedges and the run-time complexity, both leading to higher memory requirements. We make three contributions. First, we propose to predict and supervise the positive edges only, which changes the asymptotic memory scaling from exponential to linear. Second, we introduce a training method that encourages iterative refinement of the predicted hypergraph, which allows us to skip iterations in the backward pass for improved efficiency and constant memory usage. Third, we combine both contributions in a single set-to-hypergraph model that enables us to address problems with larger input set sizes. We provide ablations for our main technical contributions and show that our model outperforms prior state-of-the-art, especially for larger sets.<\/p>\n\n\n\n

\"\"<\/a><\/figure>\n","protected":false},"excerpt":{"rendered":"

The Learning on Graphs 2022 paper “Pruning Edges and Gradients to Learn Hypergraphs from Larger Sets” by David W. Zhang, Gertjan Burghouts and Cees Snoek is now available. This paper aims for set-to-hypergraph prediction, where the goal is to infer the set of relations for a given set of entities. This is a common abstraction […]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-4150","post","type-post","status-publish","format-standard","hentry","category-science"],"yoast_head":"\nLoG 2022: Pruning Edges and Gradients to Learn Hypergraphs from Larger Sets - Cees Snoek<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"LoG 2022: Pruning Edges and Gradients to Learn Hypergraphs from Larger Sets - Cees Snoek\" \/>\n<meta property=\"og:description\" content=\"The Learning on Graphs 2022 paper “Pruning Edges and Gradients to Learn Hypergraphs from Larger Sets” by David W. Zhang, Gertjan Burghouts and Cees Snoek is now available. This paper aims for set-to-hypergraph prediction, where the goal is to infer the set of relations for a given set of entities. This is a common abstraction […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/\" \/>\n<meta property=\"og:site_name\" content=\"Cees Snoek\" \/>\n<meta property=\"article:published_time\" content=\"2022-12-10T11:48:06+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-12-10T11:48:46+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2021\/06\/zhang-hypergraphs.png\" \/>\n<meta name=\"author\" content=\"Cees\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Cees\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/\",\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/\",\"name\":\"LoG 2022: Pruning Edges and Gradients to Learn Hypergraphs from Larger Sets - Cees Snoek\",\"isPartOf\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2021\/06\/zhang-hypergraphs.png\",\"datePublished\":\"2022-12-10T11:48:06+00:00\",\"dateModified\":\"2022-12-10T11:48:46+00:00\",\"author\":{\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/#primaryimage\",\"url\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2021\/06\/zhang-hypergraphs.png\",\"contentUrl\":\"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2021\/06\/zhang-hypergraphs.png\",\"width\":1878,\"height\":322},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.ceessnoek.info\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"LoG 2022: Pruning Edges and Gradients to Learn Hypergraphs from Larger Sets\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.ceessnoek.info\/#website\",\"url\":\"https:\/\/www.ceessnoek.info\/\",\"name\":\"Cees Snoek\",\"description\":\"research on video and image ai\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.ceessnoek.info\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1\",\"name\":\"Cees\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g\",\"caption\":\"Cees\"},\"sameAs\":[\"http:\/\/www.CeesSnoek.info\"],\"url\":\"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"LoG 2022: Pruning Edges and Gradients to Learn Hypergraphs from Larger Sets - Cees Snoek","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/","og_locale":"en_US","og_type":"article","og_title":"LoG 2022: Pruning Edges and Gradients to Learn Hypergraphs from Larger Sets - Cees Snoek","og_description":"The Learning on Graphs 2022 paper “Pruning Edges and Gradients to Learn Hypergraphs from Larger Sets” by David W. Zhang, Gertjan Burghouts and Cees Snoek is now available. This paper aims for set-to-hypergraph prediction, where the goal is to infer the set of relations for a given set of entities. This is a common abstraction […]","og_url":"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/","og_site_name":"Cees Snoek","article_published_time":"2022-12-10T11:48:06+00:00","article_modified_time":"2022-12-10T11:48:46+00:00","og_image":[{"url":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2021\/06\/zhang-hypergraphs.png","type":"","width":"","height":""}],"author":"Cees","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Cees","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/","url":"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/","name":"LoG 2022: Pruning Edges and Gradients to Learn Hypergraphs from Larger Sets - Cees Snoek","isPartOf":{"@id":"https:\/\/www.ceessnoek.info\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/#primaryimage"},"image":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/#primaryimage"},"thumbnailUrl":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2021\/06\/zhang-hypergraphs.png","datePublished":"2022-12-10T11:48:06+00:00","dateModified":"2022-12-10T11:48:46+00:00","author":{"@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1"},"breadcrumb":{"@id":"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/#primaryimage","url":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2021\/06\/zhang-hypergraphs.png","contentUrl":"https:\/\/www.ceessnoek.info\/wp-content\/uploads\/2021\/06\/zhang-hypergraphs.png","width":1878,"height":322},{"@type":"BreadcrumbList","@id":"https:\/\/www.ceessnoek.info\/index.php\/log-2022-pruning-edges-and-gradients-to-learn-hypergraphs-from-larger-sets\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ceessnoek.info\/"},{"@type":"ListItem","position":2,"name":"LoG 2022: Pruning Edges and Gradients to Learn Hypergraphs from Larger Sets"}]},{"@type":"WebSite","@id":"https:\/\/www.ceessnoek.info\/#website","url":"https:\/\/www.ceessnoek.info\/","name":"Cees Snoek","description":"research on video and image ai","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ceessnoek.info\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/4bca975b7c432aeb5dced40bdbc204c1","name":"Cees","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ceessnoek.info\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/756ccb993852c1e8e3af39a228d11a7305b2a937750f26dc5799d5df019b0f51?s=96&d=mm&r=g","caption":"Cees"},"sameAs":["http:\/\/www.CeesSnoek.info"],"url":"https:\/\/www.ceessnoek.info\/index.php\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/4150","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/comments?post=4150"}],"version-history":[{"count":1,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/4150\/revisions"}],"predecessor-version":[{"id":4151,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/posts\/4150\/revisions\/4151"}],"wp:attachment":[{"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/media?parent=4150"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/categories?post=4150"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ceessnoek.info\/index.php\/wp-json\/wp\/v2\/tags?post=4150"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}