DDoD: Dual Denial of Decision Attacks on Human-AI Teams

被引:1
|
作者
Tag, Benjamin [1 ]
van Berkel, Niels [2 ]
Verma, Sunny [3 ]
Zhao, Benjamin Zi Hao [3 ]
Berkovsky, Shlomo [3 ]
Kaafar, Dali [3 ]
Kostakos, Vassilis [1 ]
Ohrimenko, Olga [1 ]
机构
[1] Univ Melbourne, Parkville, Vic 3010, Australia
[2] Aalborg Univ, DK-9220 Aalborg, Denmark
[3] Macquarie Univ, Macquarie Pk, NSW 2109, Australia
关键词
Artificial intelligence; Task analysis; Data models; Predictive models; Uncertainty; Training; Training data;
D O I
10.1109/MPRV.2022.3218773
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial intelligence (AI) systems have been increasingly used to make decision-making processes faster, more accurate, and more efficient. However, such systems are also at constant risk of being attacked. While the majority of attacks targeting AI-based applications aim to manipulate classifiers or training data and alter the output of an AI model, recently proposed sponge attacks against AI models aim to impede the classifier's execution by consuming substantial resources. In this work, we propose dual denial of decision (DDoD) attacks against collaborative human-AI teams. We discuss how such attacks aim to deplete both computational and human resources, and significantly impair decision-making capabilities. We describe DDoD on human and computational resources and present potential risk scenarios in a series of exemplary domains.
引用
收藏
页码:77 / 84
页数:8
相关论文
共 50 条
  • [21] A Quantum Probability Approach to Improving Human-AI Decision Making
    Humr, Scott
    Canan, Mustafa
    Demir, Mustafa
    ENTROPY, 2025, 27 (02)
  • [22] The Impact of Imperfect XAI on Human-AI Decision-Making
    Morrison K.
    Spitzer P.
    Turri V.
    Feng M.
    Kühl N.
    Perer A.
    Proceedings of the ACM on Human-Computer Interaction, 2024, 8 (CSCW1)
  • [23] Understanding the influence of AI autonomy on AI explainability levels in human-AI teams using a mixed methods approach
    Hauptman, Allyson I.
    Schelble, Beau G.
    Duan, Wen
    Flathmann, Christopher
    Mcneese, Nathan J.
    COGNITION TECHNOLOGY & WORK, 2024, 26 (03) : 435 - 455
  • [24] Evaluation of Human-AI Teams for Learned and Rule-Based Agents in Hanabi
    Siu, Ho Chit
    Pena, Jaime D.
    Zhou, Yutai
    Chen, Edenna
    Lopez, Victor J.
    Palko, Kyle
    Chang, Kimberlee C.
    Allen, Ross E.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [25] Member's performance in human-AI hybrid teams: a perspective of adaptability theory
    Chen, Aihui
    Lyu, Anran
    Lu, Yaobin
    INFORMATION TECHNOLOGY & PEOPLE, 2024,
  • [26] Shaping a multidisciplinary understanding of team trust in human-AI teams: a theoretical framework
    Ulfert, Anna-Sophie
    Georganta, Eleni
    Centeio Jorge, Carolina
    Mehrotra, Siddharth
    Tielman, Myrthe
    EUROPEAN JOURNAL OF WORK AND ORGANIZATIONAL PSYCHOLOGY, 2024, 33 (02) : 158 - 171
  • [27] Predictive models for human-AI nexus in group decision making
    Askarisichani, Omid
    Bullo, Francesco
    Friedkin, Noah E.
    Singh, Ambuj K.
    ANNALS OF THE NEW YORK ACADEMY OF SCIENCES, 2022, 1514 (01) : 70 - 81
  • [28] Effective Human-AI Teams via Learned Natural Language Rules and Onboarding
    Mozannar, Hussein
    Lee, Jimin J.
    Wei, Dennis
    Sattigeri, Prasanna
    Das, Subhro
    Sontag, David
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [29] Understanding the processes of trust and distrust contagion in Human-AI Teams: A qualitative approach
    Duan, Wen
    Zhou, Shiwen
    Scalia, Matthew J.
    Freeman, Guo
    Gorman, Jamie
    Tolston, Michael
    Mcneese, Nathan J.
    Funke, Gregory
    COMPUTERS IN HUMAN BEHAVIOR, 2025, 165
  • [30] Human-AI coevolution
    Pedreschi, Dino
    Pappalardo, Luca
    Ferragina, Emanuele
    Baeza-Yates, Ricardo
    Barabasi, Albert-Laszlo
    Dignum, Frank
    Dignum, Virginia
    Eliassi-Rad, Tina
    Giannotti, Fosca
    Kertesz, Janos
    Knott, Alistair
    Ioannidis, Yannis
    Lukowicz, Paul
    Passarella, Andrea
    Pentland, Alex Sandy
    Shawe-Taylor, John
    Vespignani, Alessandro
    ARTIFICIAL INTELLIGENCE, 2025, 339