Images are Achilles’ Heel of Alignment: Exploiting Visual Vulnerabilities for Jailbreaking Multimodal Large Language Models

被引:0
|
作者
Li, Yifan [1 ,3 ]
Guo, Hangyu [1 ,3 ]
Zhou, Kun [2 ,3 ]
Zhao, Wayne Xin [1 ,3 ]
Wen, Ji-Rong [1 ,2 ,3 ]
机构
[1] Gaoling School of Artificial Intelligence, Renmin University of China, China
[2] School of Information, Renmin University of China, China
[3] Beijing Key Laboratory of Big Data Management and Analysis Methods, China
来源
关键词
Compilation and indexing terms; Copyright 2025 Elsevier Inc;
D O I
暂无
中图分类号
学科分类号
摘要
Alignment - Problem oriented languages
引用
收藏
相关论文
共 50 条
  • [21] A survey on multimodal large language models
    Yin, Shukang
    Fu, Chaoyou
    Zhao, Sirui
    Li, Ke
    Sun, Xing
    Xu, Tong
    Chen, Enhong
    NATIONAL SCIENCE REVIEW, 2024, 11 (12)
  • [22] A survey on multimodal large language models
    Shukang Yin
    Chaoyou Fu
    Sirui Zhao
    Ke Li
    Xing Sun
    Tong Xu
    Enhong Chen
    National Science Review, 2024, 11 (12) : 277 - 296
  • [23] On the Calibration of Large Language Models and Alignment
    Zhu, Chiwei
    Xu, Benfeng
    Wang, Quan
    Zhang, Yongdong
    Mao, Zhendong
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 9778 - 9795
  • [24] Automatic Estimation for Visual Quality Changes of Street Space via Street-View Images and Multimodal Large Language Models
    Liang, Hao
    Zhang, Jiaxin
    Li, Yunqin
    Wang, Bowen
    Huang, Jingyong
    IEEE ACCESS, 2024, 12 : 87713 - 87727
  • [25] A Design of Interface for Visual-Impaired People to Access Visual Information from Images Featuring Large Language Models and Visual Language Models
    Zhang, Zhe-Xin
    EXTENDED ABSTRACTS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2024, 2024,
  • [26] A Survey on Multimodal Large Language Models in Radiology for Report Generation and Visual Question Answering
    Yi, Ziruo
    Xiao, Ting
    Albert, Mark V.
    INFORMATION, 2025, 16 (02)
  • [27] From Large Language Models to Large Multimodal Models: A Literature Review
    Huang, Dawei
    Yan, Chuan
    Li, Qing
    Peng, Xiaojiang
    APPLIED SCIENCES-BASEL, 2024, 14 (12):
  • [28] A comprehensive survey of large language models and multimodal large models in medicine
    Xiao, Hanguang
    Zhou, Feizhong
    Liu, Xingyue
    Liu, Tianqi
    Li, Zhipeng
    Liu, Xin
    Huang, Xiaoxuan
    INFORMATION FUSION, 2025, 117
  • [29] Multimodal Large Language Models in Vision and Ophthalmology
    Lu, Zhiyong
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2024, 65 (07)
  • [30] Jailbreaking Pre-trained Large Language Models Towards Hardware Vulnerability Insertion Ability
    Wan, Gwok-Waa
    Wong, Sam-Zaak
    Wang, Xi
    PROCEEDING OF THE GREAT LAKES SYMPOSIUM ON VLSI 2024, GLSVLSI 2024, 2024, : 579 - 582