Special Issues
Table of Content

Attention Mechanism-based Complex System Pattern Intelligent Recognition and Accurate Prediction

Submission Deadline: 31 January 2026 View: 2768 Submit to Special Issue

Guest Editors

Dr. Xin Zhang

Email: mexzyl@ust.hk

Affiliation: Department of Mechanical and Aerospace Engineering, The Hong Kong University of Science and Technology,999077, Hong Kong

Homepage:

Research Interests: Complex equipment condition recognition, digital twin, deep learning

图片1.png


Dr. Ruyi Huang

Email: snowxiaoyu@hotmail.com

Affiliation: Department of Mechanical & Aerospace Engineering ,Case Western Reserve University, Cleveland,44106,USA

Homepage:

Research Interests: Interpretable AI-based Method and Its Industrial Applications, Diagnostic and Prognostic based on Industrial Big Data

图片2.png


Dr. Yadong Xu

Email: yadongseu.xu@polyu.edu.hk

Affiliation: Department of Industrial and Systems Engineering, The Hong Kong Polytechnic University, 100872, Hong Kong

Homepage:

Research Interests: condition recognition, digital twin, fault diagnosis, signal processing, deep learning

图片3.png


Assist. Prof. Baoru Huang

Email: baoru.huang@liverpool.ac.uk

Affiliation: Department of Computer Science,University of Liverpool, Liverpool, L69 3BX, United Kingdom

Homepage:

Research Interests: Embodied AI, Robotics, Surgical Vision


Summary

Complex systems are ubiquitous across various industries, including advanced mechanical equipment, human physiological systems, and large-scale software systems. Monitoring and analyzing the operational states of such systems is crucial to ensure their safety, reliability, and functionality. In recent years, artificial intelligence (AI) technologies have revolutionized approaches to system monitoring and analysis. Numerous machine learning and deep learning models have been developed to perform pattern recognition and prediction tasks using diverse data types, such as time-series data (e.g., EEG signals, vibration signals), images (e.g., medical imaging), and graph data (e.g., social networks). These AI-driven strategies have laid the foundation for intelligent, generalized operational maintenance and mechanism analysis of complex systems.


Nevertheless, in extreme scenarios, the accuracy of pattern recognition and prediction can be compromised. For instance, external noise can significantly alter data distributions, making analysis challenging. To address these issues, the attention mechanism—an influential deep learning approach—has gained prominence in various fields, including natural language processing, computer vision, equipment health management, and healthcare. By dynamically focusing on the most relevant parts of the input and assigning weights to features based on their importance, attention mechanisms enhance model precision and interpretability. However, designing effective attention modules tailored to specific tasks and scenarios remains a significant challenge.


This special issue invites original research and review articles on the development of attention-based deep learning models for addressing the challenges in complex system pattern recognition and prediction. We encourage submissions on the following topics, but are not limited to:

• Prognostics and health management of complex systems

• Pattern recognition and prediction in healthcare for complex systems

• Attention-based medical image analysis

• Attention-based electroencephalogram (EEG) signal processing and analysis

• Model interpretability for complex systems

• Digital twin technologies for complex systems

• Mechanism analysis of complex systems

• Large language models for complex systems

• Multi-modal data processing in complex systems

• Other deep learning-based algorithms and applications


Keywords

Attention Mechanism; Deep Learning; Complex Systems; Pattern Recognition; Prognostics and Health Management (PHM); Medical Image Analysis; Electroencephalogram (EEG) Signal Processing; Multi-Modal Data Fusion; Digital Twin; Model Interpretability

Published Papers


  • Open Access

    ARTICLE

    Integrating Attention Mechanism with Code Structural Affinity and Execution Context Correlation for Automated Bug Repair

    Jinfeng Ji, Geunseok Yang
    CMC-Computers, Materials & Continua, DOI:10.32604/cmc.2025.071733
    (This article belongs to the Special Issue: Attention Mechanism-based Complex System Pattern Intelligent Recognition and Accurate Prediction)
    Abstract Automated Program Repair (APR) techniques have shown significant potential in mitigating the cost and complexity associated with debugging by automatically generating corrective patches for software defects. Despite considerable progress in APR methodologies, existing approaches frequently lack contextual awareness of runtime behaviors and structural intricacies inherent in buggy source code. In this paper, we propose a novel APR approach that integrates attention mechanisms within an autoencoder-based framework, explicitly utilizing structural code affinity and execution context correlation derived from stack trace analysis. Our approach begins with an innovative preprocessing pipeline, where code segments and stack traces are… More >

  • Open Access

    ARTICLE

    LP-YOLO: Enhanced Smoke and Fire Detection via Self-Attention and Feature Pyramid Integration

    Qing Long, Bing Yi, Haiqiao Liu, Zhiling Peng, Xiang Liu
    CMC-Computers, Materials & Continua, DOI:10.32604/cmc.2025.072058
    (This article belongs to the Special Issue: Attention Mechanism-based Complex System Pattern Intelligent Recognition and Accurate Prediction)
    Abstract Accurate detection of smoke and fire sources is critical for early fire warning and environmental monitoring. However, conventional detection approaches are highly susceptible to noise, illumination variations, and complex environmental conditions, which often reduce detection accuracy and real-time performance. To address these limitations, we propose Lightweight and Precise YOLO (LP-YOLO), a high-precision detection framework that integrates a self-attention mechanism with a feature pyramid, built upon YOLOv8. First, to overcome the restricted receptive field and parameter redundancy of conventional Convolutional Neural Networks (CNNs), we design an enhanced backbone based on Wavelet Convolutions (WTConv), which expands the… More >

  • Open Access

    ARTICLE

    Interactive Dynamic Graph Convolution with Temporal Attention for Traffic Flow Forecasting

    Zitong Zhao, Zixuan Zhang, Zhenxing Niu
    CMC-Computers, Materials & Continua, Vol.86, No.1, pp. 1-16, 2026, DOI:10.32604/cmc.2025.069752
    (This article belongs to the Special Issue: Attention Mechanism-based Complex System Pattern Intelligent Recognition and Accurate Prediction)
    Abstract Reliable traffic flow prediction is crucial for mitigating urban congestion. This paper proposes Attention-based spatiotemporal Interactive Dynamic Graph Convolutional Network (AIDGCN), a novel architecture integrating Interactive Dynamic Graph Convolution Network (IDGCN) with Temporal Multi-Head Trend-Aware Attention. Its core innovation lies in IDGCN, which uniquely splits sequences into symmetric intervals for interactive feature sharing via dynamic graphs, and a novel attention mechanism incorporating convolutional operations to capture essential local traffic trends—addressing a critical gap in standard attention for continuous data. For 15- and 60-min forecasting on METR-LA, AIDGCN achieves MAEs of 0.75% and 0.39%, and RMSEs More >

  • Open Access

    ARTICLE

    SDVformer: A Resource Prediction Method for Cloud Computing Systems

    Shui Liu, Ke Xiong, Yeshen Li, Zhifei Zhang, Yu Zhang, Pingyi Fan
    CMC-Computers, Materials & Continua, Vol.84, No.3, pp. 5077-5093, 2025, DOI:10.32604/cmc.2025.064880
    (This article belongs to the Special Issue: Attention Mechanism-based Complex System Pattern Intelligent Recognition and Accurate Prediction)
    Abstract Accurate prediction of cloud resource utilization is critical. It helps improve service quality while avoiding resource waste and shortages. However, the time series of resource usage in cloud computing systems often exhibit multidimensionality, nonlinearity, and high volatility, making the high-precision prediction of resource utilization a complex and challenging task. At present, cloud computing resource prediction methods include traditional statistical models, hybrid approaches combining machine learning and classical models, and deep learning techniques. Traditional statistical methods struggle with nonlinear predictions, hybrid methods face challenges in feature extraction and long-term dependencies, and deep learning methods incur high… More >

  • Open Access

    ARTICLE

    MGD-YOLO: An Enhanced Road Defect Detection Algorithm Based on Multi-Scale Attention Feature Fusion

    Zhengji Li, Fazhan Xiong, Boyun Huang, Meihui Li, Xi Xiao, Yingrui Ji, Jiacheng Xie, Aokun Liang, Hao Xu
    CMC-Computers, Materials & Continua, Vol.84, No.3, pp. 5613-5635, 2025, DOI:10.32604/cmc.2025.066188
    (This article belongs to the Special Issue: Attention Mechanism-based Complex System Pattern Intelligent Recognition and Accurate Prediction)
    Abstract Accurate and real-time road defect detection is essential for ensuring traffic safety and infrastructure maintenance. However, existing vision-based methods often struggle with small, sparse, and low-resolution defects under complex road conditions. To address these limitations, we propose Multi-Scale Guided Detection YOLO (MGD-YOLO), a novel lightweight and high-performance object detector built upon You Only Look Once Version 5 (YOLOv5). The proposed model integrates three key components: (1) a Multi-Scale Dilated Attention (MSDA) module to enhance semantic feature extraction across varying receptive fields; (2) Depthwise Separable Convolution (DSC) to reduce computational cost and improve model generalization; and More >

  • Open Access

    ARTICLE

    YOLO-LE: A Lightweight and Efficient UAV Aerial Image Target Detection Model

    Zhe Chen, Yinyang Zhang, Sihao Xing
    CMC-Computers, Materials & Continua, Vol.84, No.1, pp. 1787-1803, 2025, DOI:10.32604/cmc.2025.065238
    (This article belongs to the Special Issue: Attention Mechanism-based Complex System Pattern Intelligent Recognition and Accurate Prediction)
    Abstract Unmanned aerial vehicle (UAV) imagery poses significant challenges for object detection due to extreme scale variations, high-density small targets (68% in VisDrone dataset), and complex backgrounds. While YOLO-series models achieve speed-accuracy trade-offs via fixed convolution kernels and manual feature fusion, their rigid architectures struggle with multi-scale adaptability, as exemplified by YOLOv8n’s 36.4% mAP and 13.9% small-object AP on VisDrone2019. This paper presents YOLO-LE, a lightweight framework addressing these limitations through three novel designs: (1) We introduce the C2f-Dy and LDown modules to enhance the backbone’s sensitivity to small-object features while reducing backbone parameters, thereby improving More >

  • Open Access

    ARTICLE

    Remote Sensing Image Information Granulation Transformer for Semantic Segmentation

    Haoyang Tang, Kai Zeng
    CMC-Computers, Materials & Continua, Vol.84, No.1, pp. 1485-1506, 2025, DOI:10.32604/cmc.2025.064441
    (This article belongs to the Special Issue: Attention Mechanism-based Complex System Pattern Intelligent Recognition and Accurate Prediction)
    Abstract Semantic segmentation provides important technical support for Land cover/land use (LCLU) research. By calculating the cosine similarity between feature vectors, transformer-based models can effectively capture the global information of high-resolution remote sensing images. However, the diversity of detailed and edge features within the same class of ground objects in high-resolution remote sensing images leads to a dispersed embedding distribution. The dispersed feature distribution enlarges feature vector angles and reduces cosine similarity, weakening the attention mechanism’s ability to identify the same class of ground objects. To address this challenge, remote sensing image information granulation transformer for… More >

Share Link