Giacomo Camposampiero, Michael Hersche, Aleksandar Terzić, Roger Wattenhofer, Abu Sebastian, Abbas Rahimi
{"title":"利用 VSA 分布式表征学习归纳推理","authors":"Giacomo Camposampiero, Michael Hersche, Aleksandar Terzić, Roger Wattenhofer, Abu Sebastian, Abbas Rahimi","doi":"arxiv-2406.19121","DOIUrl":null,"url":null,"abstract":"We introduce the Abductive Rule Learner with Context-awareness (ARLC), a\nmodel that solves abstract reasoning tasks based on Learn-VRF. ARLC features a\nnovel and more broadly applicable training objective for abductive reasoning,\nresulting in better interpretability and higher accuracy when solving Raven's\nprogressive matrices (RPM). ARLC allows both programming domain knowledge and\nlearning the rules underlying a data distribution. We evaluate ARLC on the\nI-RAVEN dataset, showcasing state-of-the-art accuracy across both\nin-distribution and out-of-distribution (unseen attribute-rule pairs) tests.\nARLC surpasses neuro-symbolic and connectionist baselines, including large\nlanguage models, despite having orders of magnitude fewer parameters. We show\nARLC's robustness to post-programming training by incrementally learning from\nexamples on top of programmed knowledge, which only improves its performance\nand does not result in catastrophic forgetting of the programmed solution. We\nvalidate ARLC's seamless transfer learning from a 2x2 RPM constellation to\nunseen constellations. Our code is available at\nhttps://github.com/IBM/abductive-rule-learner-with-context-awareness.","PeriodicalId":501033,"journal":{"name":"arXiv - CS - Symbolic Computation","volume":"144 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Towards Learning Abductive Reasoning using VSA Distributed Representations\",\"authors\":\"Giacomo Camposampiero, Michael Hersche, Aleksandar Terzić, Roger Wattenhofer, Abu Sebastian, Abbas Rahimi\",\"doi\":\"arxiv-2406.19121\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We introduce the Abductive Rule Learner with Context-awareness (ARLC), a\\nmodel that solves abstract reasoning tasks based on Learn-VRF. ARLC features a\\nnovel and more broadly applicable training objective for abductive reasoning,\\nresulting in better interpretability and higher accuracy when solving Raven's\\nprogressive matrices (RPM). ARLC allows both programming domain knowledge and\\nlearning the rules underlying a data distribution. We evaluate ARLC on the\\nI-RAVEN dataset, showcasing state-of-the-art accuracy across both\\nin-distribution and out-of-distribution (unseen attribute-rule pairs) tests.\\nARLC surpasses neuro-symbolic and connectionist baselines, including large\\nlanguage models, despite having orders of magnitude fewer parameters. We show\\nARLC's robustness to post-programming training by incrementally learning from\\nexamples on top of programmed knowledge, which only improves its performance\\nand does not result in catastrophic forgetting of the programmed solution. We\\nvalidate ARLC's seamless transfer learning from a 2x2 RPM constellation to\\nunseen constellations. Our code is available at\\nhttps://github.com/IBM/abductive-rule-learner-with-context-awareness.\",\"PeriodicalId\":501033,\"journal\":{\"name\":\"arXiv - CS - Symbolic Computation\",\"volume\":\"144 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-06-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Symbolic Computation\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2406.19121\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Symbolic Computation","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2406.19121","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Towards Learning Abductive Reasoning using VSA Distributed Representations
We introduce the Abductive Rule Learner with Context-awareness (ARLC), a
model that solves abstract reasoning tasks based on Learn-VRF. ARLC features a
novel and more broadly applicable training objective for abductive reasoning,
resulting in better interpretability and higher accuracy when solving Raven's
progressive matrices (RPM). ARLC allows both programming domain knowledge and
learning the rules underlying a data distribution. We evaluate ARLC on the
I-RAVEN dataset, showcasing state-of-the-art accuracy across both
in-distribution and out-of-distribution (unseen attribute-rule pairs) tests.
ARLC surpasses neuro-symbolic and connectionist baselines, including large
language models, despite having orders of magnitude fewer parameters. We show
ARLC's robustness to post-programming training by incrementally learning from
examples on top of programmed knowledge, which only improves its performance
and does not result in catastrophic forgetting of the programmed solution. We
validate ARLC's seamless transfer learning from a 2x2 RPM constellation to
unseen constellations. Our code is available at
https://github.com/IBM/abductive-rule-learner-with-context-awareness.