Securing Vision-Language Models with a Robust Encoder Against Jailbreak and Adversarial Attacks

被引：0
|
作者：
Hossain, Md Zarif [1 ,2 ]
Imteaj, Ahmed [1 ,2 ]
机构：
[1] Southern Illinois University, School of Computing, Carbondale,IL, United States
[2] Security, Privacy and Intelligence for Edge Devices Laboratory (SPEED Lab), United States
来源：
Proceedings - 2024 IEEE International Conference on Big Data, BigData 2024 | 2024年
关键词：
Compendex;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Visual languages
引用
收藏
页码：6250 / 6259
相关论文
共 50 条
  • [21] Efficient Generation of Targeted and Transferable Adversarial Examples for Vision-Language Models via Diffusion Models
    Guo, Qi
    Pang, Shanmin
    Jia, Xiaojun
    Liu, Yang
    Guo, Qing
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2025, 20 : 1333 - 1348
  • [22] Visual Adversarial Examples Jailbreak Aligned Large Language Models
    Princeton University, United States
    Proc. AAAI Conf. Artif. Intell., 19 (21527-21536):
  • [23] Visual Adversarial Examples Jailbreak Aligned Large Language Models
    Qi, Xiangyu
    Huang, Kaixuan
    Panda, Ashwinee
    Henderson, Peter
    Wang, Mengdi
    Mittal, Prateek
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 19, 2024, : 21527 - 21536
  • [24] Defending Large Language Models Against Jailbreak Attacks via Layer-specific Editing
    Zhao, Wei
    Li, Zhe
    Li, Yige
    Zhang, Ye
    Sun, Jun
    EMNLP 2024 - 2024 Conference on Empirical Methods in Natural Language Processing, Findings of EMNLP 2024, 2024, : 5094 - 5109
  • [25] Defending Large Language Models Against Jailbreak Attacks via Layer-specific Editing
    Zhao, Wei
    Li, Zhe
    Li, Yige
    Zhang, Ye
    Sun, Jun
    arXiv,
  • [26] Learning to Prompt for Vision-Language Models
    Zhou, Kaiyang
    Yang, Jingkang
    Loy, Chen Change
    Liu, Ziwei
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2022, 130 (09) : 2337 - 2348
  • [27] MixPrompt: Enhancing Generalizability and Adversarial Robustness for Vision-Language Models via Prompt Fusion
    Fan, Hao
    Ma, Zhaoyang
    Li, Yong
    Tian, Rui
    Chen, Yunli
    Gao, Chenlong
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT IX, ICIC 2024, 2024, 14870 : 328 - 339
  • [28] Vision-Language Models for Biomedical Applications
    Thapa, Surendrabikram
    Naseem, Usman
    Zhou, Luping
    Kim, Jinman
    PROCEEDINGS OF THE FIRST INTERNATIONAL WORKSHOP ON VISION-LANGUAGE MODELS FOR BIOMEDICAL APPLICATIONS, VLM4BIO 2024, 2024, : 1 - 2
  • [29] Learning to Prompt for Vision-Language Models
    Kaiyang Zhou
    Jingkang Yang
    Chen Change Loy
    Ziwei Liu
    International Journal of Computer Vision, 2022, 130 : 2337 - 2348
  • [30] The Neglected Tails in Vision-Language Models
    Parashar, Shubham
    Lin, Zhiqiu
    Liu, Tian
    Dong, Xiangjue
    Li, Yanan
    Ramanan, Deva
    Caverlee, James
    Kong, Shu
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 12988 - 12997
12345