Model-contrastive explanations through symbolic reasoning

被引:4
|
作者
Malandri, Lorenzo
Mercorio, Fabio [1 ]
Mezzanzanica, Mario
Seveso, Andrea
机构
[1] Univ Milano Bicocca, Dept Stat & Quantitat Methods, Milan, Italy
关键词
eXplainable AI; Contrastive explanation methods for XAI; Post -hoc explainability; XAI Interpretability;
D O I
10.1016/j.dss.2023.114040
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Explaining how two machine learning classification models differ in their behaviour is gaining significance in eXplainable AI, given the increasing diffusion of learning-based decision support systems. Human decisionmakers deal with more than one machine learning model in several practical situations. Consequently, the importance of understanding how two machine learning models work beyond their prediction performances is key to understanding their behaviour, differences, and likeness. Some attempts have been made to address these problems, for instance, by explaining text classifiers in a timecontrastive fashion. In this paper, we present MERLIN, a novel eXplainable AI approach that provides contrastive explanations of two machine learning models, introducing the concept of model-contrastive explanations. We propose an encoding that allows MERLIN to work with both text and tabular data and with mixed continuous and discrete features. To show the effectiveness of our approach, we evaluate it on an extensive set of benchmark datasets. MERLIN is also implemented as a python-pip package.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Model-Contrastive Federated Learning
    Li, Qinbin
    He, Bingsheng
    Song, Dawn
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 10708 - 10717
  • [2] Model-Contrastive Learning for Backdoor Elimination
    Yue, Zhihao
    Xia, Jun
    Ling, Zhiwei
    Hu, Ming
    Wang, Ting
    Wei, Xian
    Chen, Mingsong
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 8869 - 8880
  • [3] Contrastive explanations of plans through model restrictions
    Krarup, Benjamin
    Krivic, Senka
    Magazzeni, Daniele
    Long, Derek
    Cashmore, Michael
    Smith, David E.
    Journal of Artificial Intelligence Research, 2021, 72 : 533 - 612
  • [4] Contrastive Explanations of Plans Through Model Restrictions
    Krarup, Benjamin
    Krivic, Senka
    Magazzeni, Daniele
    Long, Derek
    Cashmore, Michael
    Smith, David E.
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2021, 72 : 533 - 612
  • [5] Symbolic Explanations of Generalized Fuzzy Reasoning
    Szalas, Andrzej
    SMART DIGITAL FUTURES 2014, 2014, 262 : 7 - 16
  • [6] Bidirectional Corrective Model-Contrastive Federated Adversarial Training
    Zhang, Yuyue
    Shi, Yicong
    Zhao, Xiaoli
    ELECTRONICS, 2024, 13 (18)
  • [7] Prompting Contrastive Explanations for Commonsense Reasoning Tasks
    Paranjape, Bhargavi
    Michael, Julian
    Ghazvininejad, Marjan
    Hajishirzi, Hannaneh
    Zettlemoyer, Luke
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 4179 - 4192
  • [8] Contrastive Reinforcement Learning of Symbolic Reasoning Domains
    Poesia, Gabriel
    Dong, WenXin
    Goodman, Noah
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [9] Secure Model-Contrastive Federated Learning With Improved Compressive Sensing
    Miao, Yinbin
    Zheng, Wei
    Li, Xinghua
    Li, Hongwei
    Choo, Kim-Kwang Raymond
    Deng, Robert H.
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2023, 18 : 3430 - 3444
  • [10] Contrastive Explanations for Model Interpretability
    Jacovi, Alon
    Swayamdipta, Swabha
    Ravfogel, Shauli
    Elazar, Yanai
    Choi, Yejin
    Goldberg, Yoav
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 1597 - 1611