Towards Learning Abductive Reasoning Using VSA Distributed Representations

被引:0
|
作者
Camposampiero, Giacomo [1 ,2 ]
Hersche, Michael [1 ]
Terzic, Aleksandar [1 ,2 ]
Wattenhofer, Roger [2 ]
Sebastian, Abu [1 ]
Rahimi, Abbas [1 ]
机构
[1] IBM Res Zurich, Ruschlikon, Switzerland
[2] Swiss Fed Inst Technol, Zurich, Switzerland
基金
瑞士国家科学基金会;
关键词
D O I
10.1007/978-3-031-71167-1_20
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce the Abductive Rule Learner with Context-awareness (ARLC), a model that solves abstract reasoning tasks based on Learn-VRF. ARLC features a novel and more broadly applicable training objective for abductive reasoning, resulting in better interpretability and higher accuracy when solving Raven's progressive matrices (RPM). ARLC allows both programming domain knowledge and learning the rules underlying a data distribution. We evaluate ARLC on the IRAVEN dataset, showcasing state-of-the-art accuracy across both indistribution and out-of-distribution (unseen attribute-rule pairs) tests. ARLC surpasses neuro-symbolic and connectionist baselines, including large language models, despite having orders of magnitude fewer parameters. We show ARLC's robustness to post-programming training by incrementally learning from examples on top of programmed knowledge, which only improves its performance and does not result in catastrophic forgetting of the programmed solution. We validate ARLC's seamless transfer learning from a 2x2 RPM constellation to unseen constellations. Our code is available at https://github.com/IBM/abductive- rule-learner-with-context- awareness.
引用
收藏
页码:370 / 385
页数:16
相关论文
共 50 条
  • [41] Learning to Reweight Terms with Distributed Representations
    Zheng, Guoqing
    Callan, Jamie
    SIGIR 2015: PROCEEDINGS OF THE 38TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2015, : 575 - 584
  • [42] Distributed machine learning and sparse representations
    Obst, Oliver
    NEUROCOMPUTING, 2014, 124 : 1 - 1
  • [43] Towards reasoning based representations: Deep Consistence Seeking Machine
    Lorincz, A.
    Csakvari, M.
    Fothi, A.
    Milacski, Z. A.
    Sarkany, A.
    Toser, Z.
    COGNITIVE SYSTEMS RESEARCH, 2018, 47 : 92 - 108
  • [44] Reasoning about temporal context using ontology and abductive constraint logic programming
    Zhu, HW
    Madnick, SE
    Siegel, MD
    PRINCIPLES AND PRACTICE OF SEMANTIC WEB REASONING, PROCEEDINGS, 2004, 3208 : 90 - 101
  • [45] Abductive Reasoning Using Tableau Methods for High-Level Image Interpretation
    Yang, Yifan
    Atif, Jamal
    Bloch, Isabelle
    KI 2015: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2015, 9324 : 356 - 365
  • [46] Improving a distributed case-based reasoning system using introspective learning
    Watson, I
    Gardingen, D
    RESEARCH AND DEVELOPMENT IN INTELLIGENT SYSTEMS XVI, 2000, : 178 - 190
  • [47] Towards robust and generalizable representations of extracellular data using contrastive learning
    Vishnubhotla, Ankit
    Loh, Charlotte
    Paninski, Liam
    Srivastava, Akash
    Hurwitz, Cole
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [48] Towards a Rule Based Distributed OWL Reasoning Framework
    Mutharaju, Raghava
    Mateti, Prabhaker
    Hitzler, Pascal
    ONTOLOGY ENGINEERING, 2016, 9557 : 87 - 92
  • [49] Federated Learning for Distributed Reasoning on Edge Computing
    Firouzi, Ramin
    Rahmani, Rahim
    Kanter, Theo
    12TH INTERNATIONAL CONFERENCE ON AMBIENT SYSTEMS, NETWORKS AND TECHNOLOGIES (ANT) / THE 4TH INTERNATIONAL CONFERENCE ON EMERGING DATA AND INDUSTRY 4.0 (EDI40) / AFFILIATED WORKSHOPS, 2021, 184 : 419 - 427
  • [50] TOWARDS LEARNING UNIVERSAL AUDIO REPRESENTATIONS
    Wang, Luyu
    Luc, Pauline
    Wu, Yan
    Recasens, Adria
    Smaira, Lucas
    Brock, Andrew
    Jaegle, Andrew
    Alayrac, Jean-Baptiste
    Dieleman, Sander
    Carreira, Joao
    van den Oord, Aaron
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 4593 - 4597