<sc>FairCaipi</sc>: A Combination of Explanatory Interactive and Fair Machine Learning for Human and Machine Bias Reduction

被引:3
|
作者
Heidrich, Louisa [1 ]
Slany, Emanuel [1 ,2 ]
Scheele, Stephan [1 ,2 ]
Schmid, Ute [1 ,2 ]
Cabitza, Federico
Chen, Fang
Zhou, Jianlong
Holzinger, Andreas
机构
[1] Univ Bamberg, Cognit Syst, Weberei 5, D-96047 Bamberg, Germany
[2] Fraunhofer Inst Integrated Circuits IIS, Sensory Percept & Analyt, Comprehensible AI, Wolfsmantel 33, D-91058 Erlangen, Germany
来源
关键词
fair machine learning; explanatory and interactive machine learning;
D O I
10.3390/make5040076
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The rise of machine-learning applications in domains with critical end-user impact has led to a growing concern about the fairness of learned models, with the goal of avoiding biases that negatively impact specific demographic groups. Most existing bias-mitigation strategies adapt the importance of data instances during pre-processing. Since fairness is a contextual concept, we advocate for an interactive machine-learning approach that enables users to provide iterative feedback for model adaptation. Specifically, we propose to adapt the explanatory interactive machine-learning approach Caipi for fair machine learning. FairCaipi incorporates human feedback in the loop on predictions and explanations to improve the fairness of the model. Experimental results demonstrate that FairCaipi outperforms a state-of-the-art pre-processing bias mitigation strategy in terms of the fairness and the predictive performance of the resulting machine-learning model. We show that FairCaipi can both uncover and reduce bias in machine-learning models and allows us to detect human bias.
引用
收藏
页码:1519 / 1538
页数:20
相关论文
共 50 条
  • [31] Limitations of mitigating judicial bias with machine learning Machine-learning algorithms trained with data that encode human bias will reproduce, not eliminate, the bias, says Kristian Lum.
    Lum, Kristian
    NATURE HUMAN BEHAVIOUR, 2017, 1 (07):
  • [32] Visual and structural feature combination in an interactive machine learning system for medical image segmentation
    Galisot, Gaetan
    Ramel, Jean -Yves
    Brouard, Thierry
    Chaillou, Elodie
    Serres, Barthelemy
    MACHINE LEARNING WITH APPLICATIONS, 2022, 8
  • [33] An Interactive Human-Machine Learning Interface for Collecting and Learning from Complex Annotations
    Erskine, Jonathan
    Clifford, Matt
    Hepburn, Alexander
    Rodriguez, Raul Santos
    PROCEEDINGS OF THE THIRTY-THIRD INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2024, 2024, : 8644 - 8647
  • [34] Improving high-impact bug report prediction with combination of interactive machine learning and active learning
    Wu, Xiaoxue
    Zheng, Wei
    Chen, Xiang
    Zhao, Yu
    Yu, Tingting
    Mu, Dejun
    Zheng, Wei (wzheng@nwpu.edu.cn), 1600, Elsevier B.V. (133):
  • [35] Improving high-impact bug report prediction with combination of interactive machine learning and active learning
    Wu, Xiaoxue
    Zheng, Wei
    Chen, Xiang
    Zhao, Yu
    Yu, Tingting
    Mu, Dejun
    INFORMATION AND SOFTWARE TECHNOLOGY, 2021, 133
  • [36] Investigating the Role of Dimension Reduction in Counteracting Machine Learning Performance Bias in TSMO Strategies
    Attallah, Mustafa
    Kianfar, Jalil
    INTERNATIONAL CONFERENCE ON TRANSPORTATION AND DEVELOPMENT 2024: TRANSPORTATION SAFETY AND EMERGING TECHNOLOGIES, ICTD 2024, 2024, : 821 - 832
  • [37] Looping In: Exploring Feedback Strategies to Motivate Human Engagement in Interactive Machine Learning
    Shin, Hyorim
    Park, Jeongeun
    Yu, Jeongmin
    Kim, Jungeun
    Kim, Ha Young
    Oh, Changhoon
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2024,
  • [38] Human-in-the-loop machine learning: Reconceptualizing the role of the user in interactive approaches
    Gomez-Carmona, Oihane
    Casado-Mansilla, Diego
    Lopez-de-Ipina, Diego
    Garcia-Zubia, Javier
    INTERNET OF THINGS, 2024, 25
  • [39] Machine Learning in Urban Tree Canopy Mapping: A Columbia, SC Case Study for Urban Heat Island Analysis
    Morgan, Grayson R.
    Fulham, Alexander
    Farmer, T. Grant
    GEOGRAPHIES, 2023, 3 (02): : 359 - 374
  • [40] Understanding the focal points and sentiment of learners in MOOC reviews: A machine learning and SC-LIWC-based approach
    Geng, Shuang
    Niu, Ben
    Feng, Yuanyue
    Huang, Miaojia
    BRITISH JOURNAL OF EDUCATIONAL TECHNOLOGY, 2020, 51 (05) : 1785 - 1803