Securing Vision-Language Models with a Robust Encoder Against Jailbreak and Adversarial Attacks

被引：0
|
作者：
Hossain, Md Zarif [1 ,2 ]
Imteaj, Ahmed [1 ,2 ]
机构：
[1] Southern Illinois University, School of Computing, Carbondale,IL, United States
[2] Security, Privacy and Intelligence for Edge Devices Laboratory (SPEED Lab), United States
来源：
Proceedings - 2024 IEEE International Conference on Big Data, BigData 2024 | 2024年
关键词：
Compendex;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Visual languages
引用
收藏
页码：6250 / 6259
相关论文
共 50 条
  • [1] Unveiling Vulnerabilities in Large Vision-Language Models: The SAVJ Jailbreak Approach
    Zhang, Gang
    Fan, Xiaowei
    Fang, Jingquan
    Sun, Yanna
    Shi, Xiayang
    Lu, Chunyang
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING-ICANN 2024, PT V, 2024, 15020 : 417 - 434
  • [2] Adversarial Prompt Tuning for Vision-Language Models
    Zhang, Jiaming
    Ma, Xingjun
    Wang, Xin
    Qiu, Lingyu
    Wang, Jiaqi
    Jiang, Yu-Gang
    Sang, Jitao
    COMPUTER VISION - ECCV 2024, PT XLV, 2025, 15103 : 56 - 72
  • [3] On Evaluating Adversarial Robustness of Large Vision-Language Models
    Zhao, Yunqing
    Pang, Tianyu
    Du, Chao
    Yang, Xiao
    Li, Chongxuan
    Cheung, Ngai-Man
    Lin, Min
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [4] VLATTACK: Multimodal Adversarial Attacks on Vision-Language Tasks via Pre-trained Models
    Yin, Ziyi
    Ye, Muchao
    Zhang, Tianrong
    Du, Tianyu
    Zhu, Jinguo
    Liu, Han
    Chen, Jinghui
    Wang, Ting
    Ma, Fenglong
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [5] Adversarial Reinforced Instruction Attacker for Robust Vision-Language Navigation
    Lin, Bingqian
    Zhu, Yi
    Long, Yanxin
    Liang, Xiaodan
    Ye, Qixiang
    Lin, Liang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) : 7175 - 7189
  • [6] A Robust Approach for Securing Audio Classification Against Adversarial Attacks
    Esmaeilpour, Mohammad
    Cardinal, Patrick
    Koerich, Alessandro
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2020, 15 : 2147 - 2159
  • [7] JailbreakLens: Visual Analysis of Jailbreak Attacks Against Large Language Models
    Feng, Yingchaojie
    Chen, Zhizhang
    Kang, Zhining
    Wang, Sijia
    Zhu, Minfeng
    Zhang, Wei
    Chen, Wei
    arXiv,
  • [8] Adversarial Attacks on Vision-Language Model-Empowered Chatbots in Consumer Electronics
    Shang, Yingjia
    Liu, Zhijun
    Kang, Jiawen
    Hossain, M. Shamim
    Wu, Yi
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (03) : 6075 - 6083
  • [9] Patch is enough: naturalistic adversarial patch against vision-language pre-training models
    Dehong Kong
    Siyuan Liang
    Xiaopeng Zhu
    Yuansheng Zhong
    Wenqi Ren
    Visual Intelligence, 2 (1):
  • [10] Universal Adversarial Perturbations for Vision-Language Pre-trained Models
    Zhang, Peng-Fei
    Huang, Zi
    Bai, Guangdong
    PROCEEDINGS OF THE 47TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2024, 2024, : 862 - 871
12345