DDoD: Dual Denial of Decision Attacks on Human-AI Teams

被引:1
|
作者
Tag, Benjamin [1 ]
van Berkel, Niels [2 ]
Verma, Sunny [3 ]
Zhao, Benjamin Zi Hao [3 ]
Berkovsky, Shlomo [3 ]
Kaafar, Dali [3 ]
Kostakos, Vassilis [1 ]
Ohrimenko, Olga [1 ]
机构
[1] Univ Melbourne, Parkville, Vic 3010, Australia
[2] Aalborg Univ, DK-9220 Aalborg, Denmark
[3] Macquarie Univ, Macquarie Pk, NSW 2109, Australia
关键词
Artificial intelligence; Task analysis; Data models; Predictive models; Uncertainty; Training; Training data;
D O I
10.1109/MPRV.2022.3218773
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial intelligence (AI) systems have been increasingly used to make decision-making processes faster, more accurate, and more efficient. However, such systems are also at constant risk of being attacked. While the majority of attacks targeting AI-based applications aim to manipulate classifiers or training data and alter the output of an AI model, recently proposed sponge attacks against AI models aim to impede the classifier's execution by consuming substantial resources. In this work, we propose dual denial of decision (DDoD) attacks against collaborative human-AI teams. We discuss how such attacks aim to deplete both computational and human resources, and significantly impair decision-making capabilities. We describe DDoD on human and computational resources and present potential risk scenarios in a series of exemplary domains.
引用
收藏
页码:77 / 84
页数:8
相关论文
共 50 条
  • [41] Guidelines for Human-AI Interaction
    Amershi, Saleema
    Weld, Dan
    Vorvoreanu, Mihaela
    Fourney, Adam
    Nushi, Besmira
    Collisson, Penny
    Suh, Jina
    Iqbal, Shamsi
    Bennett, Paul N.
    Inkpen, Kori
    Teevan, Jaime
    Kikin-Gil, Ruth
    Horvitz, Eric
    CHI 2019: PROCEEDINGS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2019,
  • [42] Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations
    Chen V.
    Liao Q.V.
    Wortman Vaughan J.
    Bansal G.
    Proceedings of the ACM on Human-Computer Interaction, 2023, 7 (CSCW2)
  • [43] Trustworthy human-AI partnerships
    Ramchurn, Sarvapali D.
    Stein, Sebastian
    Jennings, Nicholas R.
    ISCIENCE, 2021, 24 (08)
  • [44] Emotions in Human-AI Collaboration
    Ferrada, Filipa
    Camarinha-Matos, Luis M.
    NAVIGATING UNPREDICTABILITY: COLLABORATIVE NETWORKS IN NON-LINEAR WORLDS, PRO-VE 2024, PT I, 2024, 726 : 101 - 117
  • [45] Evaluating the Impact of Human Explanation Strategies on Human-AI Visual Decision-Making
    Morrison K.
    Shin D.
    Holstein K.
    Perer A.
    Proceedings of the ACM on Human-Computer Interaction, 2023, 7 (CSCW1)
  • [46] From Human-AI Confrontation to Human-AI Symbiosis in Society 5.0: Transformation Challenges and Mechanisms
    Zhang, Xi
    Wei, Xin
    Ou, Carol X. J.
    Caron, Emiel
    Zhu, Hengshu
    Xiong, Hui
    IT PROFESSIONAL, 2022, 24 (03) : 43 - 51
  • [47] Towards Synergistic Human-AI Collaboration in Hybrid Decision-Making Systems
    Punzi, Clara
    Setzu, Mattia
    Pellungrini, Roberto
    Giannotti, Fosca
    Pedreschi, Dino
    MACHINE LEARNING AND PRINCIPLES AND PRACTICE OF KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2023, PT II, 2025, 2134 : 268 - 275
  • [48] "DecisionTime": A Configurable Framework for Reproducible Human-AI Decision-Making Studies
    Salimzadeh, Sara
    Gadiraju, Ujwal
    ADJUNCT PROCEEDINGS OF THE 32ND ACM CONFERENCE ON USER MODELING, ADAPTATION AND PERSONALIZATION, UMAP 2024, 2024, : 66 - 69
  • [49] Intricacies of human-AI interaction in dynamic decision-making for precision oncology
    Niraula, Dipesh
    Cuneo, Kyle C.
    Dinov, Ivo D.
    Gonzalez, Brian D.
    Jamaluddin, Jamalina B.
    Jin, Jionghua Judy
    Luo, Yi
    Matuszak, Martha M.
    Ten Haken, Randall K.
    Bryant, Alex K.
    Dilling, Thomas J.
    Dykstra, Michael P.
    Frakes, Jessica M.
    Liveringhouse, Casey L.
    Miller, Sean R.
    Mills, Matthew N.
    Palm, Russell F.
    Regan, Samuel N.
    Rishi, Anupam
    Torres-Roca, Javier F.
    Yu, Hsiang-Hsuan Michael
    El Naqa, Issam
    NATURE COMMUNICATIONS, 2025, 16 (01)
  • [50] Decision control and explanations in human-AI collaboration: Improving user perceptions and compliance
    Westphal, Monika
    Voessing, Michael
    Satzger, Gerhard
    Yom-Tov, Galit B.
    Rafaeli, Anat
    COMPUTERS IN HUMAN BEHAVIOR, 2023, 144