TY  - EJOU
AU  - Shi, Yufei 
AU  - He, Ziwen 
AU  - Jin, Teng 
AU  - Tong, Haochen 
AU  - Fu, Zhangjie 

TI  - AMA: Adaptive Multimodal Adversarial Attack with Dynamic Perturbation Optimization
T2  - Computer Modeling in Engineering \& Sciences

PY  - 2025
VL  - 144
IS  - 2
SN  - 1526-1506

AB  - This article proposes an innovative adversarial attack method, AMA (Adaptive Multimodal Attack), which introduces an adaptive feedback mechanism by dynamically adjusting the perturbation strength. Specifically, AMA adjusts perturbation amplitude based on task complexity and optimizes the perturbation direction based on the gradient direction in real time to enhance attack efficiency. Experimental results demonstrate that AMA elevates attack success rates from approximately 78.95% to 89.56% on visual question answering and from 78.82% to 84.96% on visual reasoning tasks across representative vision-language benchmarks. These findings demonstrate AMA’s superior attack efficiency and reveal the vulnerability of current visual language models to carefully crafted adversarial examples, underscoring the need to enhance their robustness.
KW  - Adversarial attack; visual language model; black-box attack; adaptive multimodal attack; disturbance intensity

DO  - 10.32604/cmes.2025.067658