Robustness and Performance Comparison of Generative AI Time Series Anomaly Detection under Noise
Jeongsu Park1, Moohong Min2,*
1 Department of Computer Education/Data Science, Sungkyunkwan University, Seoul, 03063, Republic of Korea
2 Department of Computer Education/Social Innovation Convergence Program, Sungkyunkwan University, Seoul, 03063, Republic of Korea
* Corresponding Author: Moohong Min. Email: 
Computer Modeling in Engineering & Sciences https://doi.org/10.32604/cmes.2025.072261
Received 22 August 2025; Accepted 23 October 2025; Published online 21 November 2025
Abstract
Time series anomaly detection is critical in domains such as manufacturing, finance, and cybersecurity. Recent generative AI models, particularly Transformer- and Autoencoder-based architectures, show strong accuracy but their robustness under noisy conditions is less understood. This study evaluates three representative models—AnomalyTransformer, TranAD, and USAD—on the Server Machine Dataset (SMD) and cross-domain benchmarks including the Soil Moisture Active Passive (SMAP) dataset, the Mars Science Laboratory (MSL) dataset, and the Secure Water Treatment (SWaT) testbed. Seven noise settings (five canonical, two mixed) at multiple intensities are tested under fixed clean-data training, with variations in window, stride, and thresholding. Results reveal distinct robustness profiles: AnomalyTransformer maintains recall but loses precision under abrupt noise, TranAD balances sensitivity yet is vulnerable to structured anomalies, and USAD resists Gaussian perturbations but collapses under block anomalies. Quantitatively, F1 drops 60%–70% on noisy SMD, with severe collapse in SWaT (F1 ≤ 0.10, Drop up to 84%) but relative stability on SMAP/MSL (Drop within ±10%). Overall, generative models exhibit complementary robustness patterns, highlighting noise-type dependent vulnerabilities and providing practical guidance for robust deployment.
Graphical Abstract
Keywords
Time series anomaly detection; robustness evaluation; generative AI models; AnomalyTransformer; TranAD; USAD; noise injection; cross-domain datasets (SMD, SMAP, MSL, SWaT)
Open Access
Login
Register
Submit a Paper
Propose a Special lssue
Download PDF
Downloads
Citation Tools
