Enhancing fairness in AI-enabled medical systems with the attribute neutral framework

被引:0
|
作者
Hu, Lianting [1 ,2 ,3 ,4 ]
Li, Dantong [2 ,3 ,4 ]
Liu, Huazhang [3 ,4 ]
Chen, Xuanhui [3 ,4 ]
Gao, Yunfei [3 ,4 ]
Huang, Shuai [3 ,4 ]
Peng, Xiaoting [3 ,4 ]
Zhang, Xueli [4 ,5 ,6 ]
Bai, Xiaohe [7 ]
Yang, Huan [2 ,3 ,4 ]
Kong, Lingcong [3 ,4 ]
Tang, Jiajie [8 ]
Lu, Peixin [9 ]
Xiong, Chao [1 ]
Liang, Huiying [1 ,2 ,3 ,4 ]
机构
[1] Huazhong Univ Sci & Technol, Wuhan Childrens Hosp, Wuhan Maternal & Child Healthcare Hosp, Tongji Med Coll,Data Ctr, Wuhan 430016, Hubei, Peoples R China
[2] Guangdong Acad Med Sci, Guangdong Prov Peoples Hosp, Guangdong Cardiovasc Inst, Guangzhou 510080, Guangdong, Peoples R China
[3] Southern Med Univ, Guangdong Prov Peoples Hosp, Guangdong Acad Med Sci, Med Big Data Ctr, Guangzhou 510080, Guangdong, Peoples R China
[4] Guangdong Acad Med Sci, Guangdong Prov Peoples Hosp, Guangdong Prov Key Lab Artificial Intelligence Med, Guangzhou 510080, Guangdong, Peoples R China
[5] Southern Med Univ, Guangdong Prov Peoples Hosp, Med Res Inst, Guangdong Acad Med Sci, Guangzhou 510080, Guangdong, Peoples R China
[6] Southern Med Univ, Guangdong Prov Peoples Hosp, Guangdong Acad Med Sci, Guangdong Eye Inst,Dept Ophthalmol, Guangzhou 510080, Guangdong, Peoples R China
[7] Univ Calif San Diego, Sch Phys Sci, San Diego, CA 92093 USA
[8] Army Med Univ, Xinqiao Hosp, Clin Med Res Ctr, Chongqing 400037, Peoples R China
[9] Cincinnati Childrens Hosp Med Ctr, Div Biomed Informat, Cincinnati, OH 45229 USA
基金
中国国家自然科学基金;
关键词
D O I
10.1038/s41467-024-52930-1
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Questions of unfairness and inequity pose critical challenges to the successful deployment of artificial intelligence (AI) in healthcare settings. In AI models, unequal performance across protected groups may be partially attributable to the learning of spurious or otherwise undesirable correlations between sensitive attributes and disease-related information. Here, we introduce the Attribute Neutral Framework, designed to disentangle biased attributes from disease-relevant information and subsequently neutralize them to improve representation across diverse subgroups. Within the framework, we develop the Attribute Neutralizer (AttrNzr) to generate neutralized data, for which protected attributes can no longer be easily predicted by humans or by machine learning classifiers. We then utilize these data to train the disease diagnosis model (DDM). Comparative analysis with other unfairness mitigation algorithms demonstrates that AttrNzr outperforms in reducing the unfairness of the DDM while maintaining DDM's overall disease diagnosis performance. Furthermore, AttrNzr supports the simultaneous neutralization of multiple attributes and demonstrates utility even when applied solely during the training phase, without being used in the test phase. Moreover, instead of introducing additional constraints to the DDM, the AttrNzr directly addresses a root cause of unfairness, providing a model-independent solution. Our results with AttrNzr highlight the potential of data-centered and model-independent solutions for fairness challenges in AI-enabled medical systems. Unfairness in AI healthcare models arise from biased correlations between sensitive attributes and disease data. Here, the authors show that the Attribute Neutral Framework reduces these biases and enhances fairness without compromising diagnostic accuracy.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] AI-Enabled Wearable Medical Internet of Things in Healthcare System: A Survey
    Subhan, Fazli
    Mirza, Alina
    Su'ud, Mazliham Bin Mohd
    Alam, Muhammad Mansoor
    Nisar, Shibli
    Habib, Usman
    Iqbal, Muhammad Zubair
    APPLIED SCIENCES-BASEL, 2023, 13 (03):
  • [42] Ai-enabled efficient modulation classification in underwater OWC systems
    He, Qingwen
    Zeng, Zhihong
    Liu, Min
    Zhu, Binbin
    Lin, Bangjiang
    Chen, Chen
    OPTICAL REVIEW, 2024, 31 (06) : 688 - 693
  • [43] AI-Enabled Sensing and Decision-Making for IoT Systems
    Qinxia, Hao
    Nazir, Shah
    Li, Ma
    Ullah Khan, Habib
    Lianlian, Wang
    Ahmad, Sultan
    COMPLEXITY, 2021, 2021
  • [44] Transforming Healthcare: Unified Medical Identification and AI-Enabled Treatment Advancements
    Abhinand, A.
    Babu, Aswin K., V
    Rajesh, Goutham
    Parthasaradhi, H.
    Bhadran, Bindhya
    2024 SECOND INTERNATIONAL CONFERENCE ON INVENTIVE COMPUTING AND INFORMATICS, ICICI 2024, 2024, : 378 - 382
  • [45] SIEGE: A Semantics-Guided Safety Enhancement Framework for AI-Enabled Cyber-Physical Systems
    Song, Jiayang
    Xie, Xuan
    Ma, Lei
    IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2023, 49 (08) : 4058 - 4080
  • [46] Design and performance of an AI-enabled threat intelligence framework for IoT-enabled autonomous vehicles
    Akhunzada, Adnan
    Al-Shamayleh, Ahmad Sami
    Zeadally, Sherali
    Almogren, Ahmad
    Abu-Shareha, Ahmad Adel
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 119
  • [47] Enhancing cardiovascular risk prediction through AI-enabled calcium-omics
    Hoori, Ammar
    Al-Kindi, Sadeer
    Hu, Tao
    Song, Yingnan
    Wu, Hao
    Lee, Juhwan
    Tashtish, Nour
    Fu, Pingfu
    Gilkeson, Robert
    Rajagopalan, Sanjay
    Wilson, David L.
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [48] Disentangling Human-AI Hybrids Conceptualizing the Interworking of Humans and AI-Enabled Systems
    Fabri, Lukas
    Haeckel, Bjoern
    Oberlaender, Anna Maria
    Rieg, Marius
    Stohr, Alexander
    BUSINESS & INFORMATION SYSTEMS ENGINEERING, 2023, 65 (06) : 623 - 641
  • [49] AI-Enabled Framework for Fog Computing Driven E-Healthcare Applications
    Sodhro, Ali Hassan
    Zahid, Noman
    SENSORS, 2021, 21 (23)
  • [50] An Explainable AI-Enabled Framework for Interpreting Pulmonary Diseases from Chest Radiographs
    Naz, Zubaira
    Khan, Muhammad Usman Ghani
    Saba, Tanzila
    Rehman, Amjad
    Nobanee, Haitham
    Bahaj, Saeed Ali
    CANCERS, 2023, 15 (01)