Evaluation Metrics Research for Explainable Artificial Intelligence Global Methods Using Synthetic Data

被引:5
|
作者
Oblizanov, Alexandr [1 ]
Shevskaya, Natalya [1 ]
Kazak, Anatoliy [2 ]
Rudenko, Marina [3 ]
Dorofeeva, Anna [2 ]
机构
[1] St Petersburg Electrotech Univ Leti, Fac Comp Sci & Technol, St Petersburg 197376, Russia
[2] VI Vernadsky Crimean Fed Univ, Humanitarian Pedag Acad, Simferopol 295007, Russia
[3] VI Vernadsky Crimean Fed Univ, Inst Phys & Technol, Simferopol 295007, Russia
关键词
explainable artificial intelligence; XAI; explanation metrics; synthetic data; SMOTE;
D O I
10.3390/asi6010026
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, artificial intelligence technologies have been developing more and more rapidly, and a lot of research is aimed at solving the problem of explainable artificial intelligence. Various XAI methods are being developed to allow the user to understand the logic of how machine learning models work, and in order to compare the methods, it is necessary to evaluate them. The paper analyzes various approaches to the evaluation of XAI methods, defines the requirements for the evaluation system and suggests metrics to determine the various technical characteristics of the methods. A study was conducted, using these metrics, which determined the degradation in the explanation quality of the SHAP and LIME methods with increasing correlation in the input data. Recommendations are also given for further research in the field of practical implementation of metrics, expanding the scope of their use.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Editorial: Explainable artificial intelligence models and methods in finance and healthcare
    Caffo, Brian S.
    D'Asaro, Fabio A.
    Garcez, Artur
    Raffinetti, Emanuela
    FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2022, 5
  • [42] Evaluation of Explainable Artificial Intelligence Methods in Language Learning Classification of Spanish Tertiary Education Students
    Tzionis, Grigorios
    Antzoulatos, Gerasimos
    Papaioannou, Periklis
    Mavropoulos, Athanasios
    Gialampoukidis, Ilias
    Gonzalez Burgos, Marta
    Vrochidis, Stefanos
    Kompatsiaris, Ioannis
    Vlachopoulou, Maro
    SMART MOBILE COMMUNICATION & ARTIFICIAL INTELLIGENCE, VOL 1, IMCL 2023, 2024, 936 : 351 - 362
  • [43] Evaluation of Artificial Intelligence-Based Denoising Methods for Global Illumination
    Faradounbeh, Soroor Malekmohammadi
    Kim, SeongKi
    JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2021, 17 (04): : 737 - 753
  • [44] Explainable artificial intelligence and the social sciences: a plea for interdisciplinary research
    De Mulder, Wim
    AI & SOCIETY, 2024,
  • [45] Understanding the importance of individual samples and their effects on materials data using explainable artificial intelligence
    Liu, Tommy
    Tho, Zhi Yang
    Barnard, Amanda S.
    DIGITAL DISCOVERY, 2024, 3 (02): : 422 - 435
  • [46] Explainable Artificial Intelligence: Objectives, Stakeholders, and Future Research Opportunities
    Meske, Christian
    Bunde, Enrico
    Schneider, Johannes
    Gersch, Martin
    INFORMATION SYSTEMS MANAGEMENT, 2022, 39 (01) : 53 - 63
  • [47] Food fraud detection using explainable artificial intelligence
    Buyuktepe, Okan
    Catal, Cagatay
    Kar, Gorkem
    Bouzembrak, Yamine
    Marvin, Hans
    Gavai, Anand
    EXPERT SYSTEMS, 2025, 42 (01)
  • [48] Explainable Artificial Intelligence Using Expressive Boolean Formulas
    Rosenberg, Gili
    Brubaker, John Kyle
    Schuetz, Martin J. A.
    Salton, Grant
    Zhu, Zhihuai
    Zhu, Elton Yechao
    Kadioglu, Serdar
    Borujeni, Sima E.
    Katzgraber, Helmut G.
    MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2023, 5 (04): : 1760 - 1795
  • [49] Improving Crowdfunding Decisions Using Explainable Artificial Intelligence
    Gregoriades, Andreas
    Themistocleous, Christos
    SUSTAINABILITY, 2025, 17 (04)
  • [50] Diagnosis of Acute Poisoning using explainable artificial intelligence
    Chary, Michael
    Boyer, Ed W.
    Burns, Michele M.
    COMPUTERS IN BIOLOGY AND MEDICINE, 2021, 134