Home / Advanced Search

  • Title/Keywords

  • Author/Affliations

  • Journal

  • Article Type

  • Start Year

  • End Year

Update SearchingClear
  • Articles
  • Online
Search Results (553)
  • Open Access

    ARTICLE

    Why Transformers Outperform LSTMs: A Comparative Study on Sarcasm Detection

    Palak Bari, Gurnur Bedi, Khushi Joshi, Anupama Jawale*

    Journal on Artificial Intelligence, Vol.7, pp. 499-508, 2025, DOI:10.32604/jai.2025.072531 - 17 November 2025

    Abstract This study investigates sarcasm detection in text using a dataset of 8095 sentences compiled from MUStARD and HuggingFace repositories, balanced across sarcastic and non-sarcastic classes. A sequential baseline model (LSTM) is compared with transformer-based models (RoBERTa and XLNet), integrated with attention mechanisms. Transformers were chosen for their proven ability to capture long-range contextual dependencies, whereas LSTM serves as a traditional benchmark for sequential modeling. Experimental results show that RoBERTa achieves 0.87 accuracy, XLNet 0.83, and LSTM 0.52. These findings confirm that transformer architectures significantly outperform recurrent models in sarcasm detection. Future work will incorporate multimodal More >

  • Open Access

    ARTICLE

    Hybrid Attention-Driven Transfer Learning with DSCNN for Cross-Domain Bearing Fault Diagnosis under Variable Operating Conditions

    Qiang Ma1,2,3,4, Zepeng Li1,2, Kai Yang1,2,*, Shaofeng Zhang1,2, Zhuopei Wei1,2

    Structural Durability & Health Monitoring, Vol.19, No.6, pp. 1607-1634, 2025, DOI:10.32604/sdhm.2025.069876 - 17 November 2025

    Abstract Effective fault identification is crucial for bearings, which are critical components of mechanical systems and play a pivotal role in ensuring overall safety and operational efficiency. Bearings operate under variable service conditions, and their diagnostic environments are complex and dynamic. In the process of bearing diagnosis, fault datasets are relatively scarce compared with datasets representing normal operating conditions. These challenges frequently cause the practicality of fault detection to decline, the extraction of fault features to be incomplete, and the diagnostic accuracy of many existing models to decrease. In this work, a transfer-learning framework, designated DSCNN-HA-TL,… More >

  • Open Access

    ARTICLE

    Segmentation of Building Surface Cracks by Incorporating Attention Mechanism and Dilation-Wise Residual

    Yating Xu1, Mansheng Xiao1,*, Mengxing Gao1, Zhenzhen Liu1, Zeyu Xiao2

    Structural Durability & Health Monitoring, Vol.19, No.6, pp. 1635-1656, 2025, DOI:10.32604/sdhm.2025.068822 - 17 November 2025

    Abstract During the operation, maintenance and upkeep of concrete buildings, surface cracks are often regarded as important warning signs of potential damage. Their precise segmentation plays a key role in assessing the health of a building. Traditional manual inspection is subjective, inefficient and has safety hazards. In contrast, current mainstream computer vision–based crack segmentation methods still suffer from missed detections, false detections, and segmentation discontinuities. These problems are particularly evident when dealing with small cracks, complex backgrounds, and blurred boundaries. For this reason, this paper proposes a lightweight building surface crack segmentation method, HL-YOLO, based on… More >

  • Open Access

    ARTICLE

    Improved YOLO11 for Maglev Train Foreign Object Detection

    Qinzhen Fang1,2, Dongliang Peng1,2, Lu Zeng1,2,*, Zixuan Jiang1,2

    Journal on Artificial Intelligence, Vol.7, pp. 469-484, 2025, DOI:10.32604/jai.2025.073016 - 06 November 2025

    Abstract To address the issues of small target miss detection, false positives in complex scenarios, and insufficient real-time performance in maglev train foreign object intrusion detection, this paper proposes a multi-module fusion improvement algorithm, YOLO11-FADA (Fusion of Augmented Features and Dynamic Attention), based on YOLO11. The model achieves collaborative optimization through three key modules: The Local Feature Augmentation Module (LFAM) enhances small target features and mitigates feature loss during down-sampling through multi-scale feature parallel extraction and attention fusion. The Dynamically Tuned Self-Attention (DTSA) module introduces learnable parameters to adjust attention weights dynamically, and, in combination with More >

  • Open Access

    ARTICLE

    Grid-Supplied Load Prediction under Extreme Weather Conditions Based on CNN-BiLSTM-Attention Model with Transfer Learning

    Qingliang Wang1, Chengkai Liu1, Zhaohui Zhou1, Ye Han1, Luebin Fang2, Moxuan Zhao3, Xiao Cao3,*

    Energy Engineering, Vol.122, No.11, pp. 4715-4732, 2025, DOI:10.32604/ee.2025.068105 - 27 October 2025

    Abstract Grid-supplied load is the traditional load minus new energy generation, so grid-supplied load forecasting is challenged by uncertainties associated with the total energy demand and the energy generated off-grid. In addition, with the expansion of the power system and the increase in the frequency of extreme weather events, the difficulty of grid-supplied load forecasting is further exacerbated. Traditional statistical methods struggle to capture the dynamic characteristics of grid-supplied load, especially under extreme weather conditions. This paper proposes a novel grid-supplied load prediction model based on Convolutional Neural Network-Bidirectional LSTM-Attention mechanism (CNN-BiLSTM-Attention). The model utilizes transfer… More >

  • Open Access

    ARTICLE

    Short-Term Wind Power Prediction Based on Optimized VMD and LSTM

    Xinjian Li1, Yu Zhang1,2,*, Zewen Wang1, Zhenyun Song1

    Energy Engineering, Vol.122, No.11, pp. 4603-4619, 2025, DOI:10.32604/ee.2025.065799 - 27 October 2025

    Abstract Power prediction has been critical in large-scale wind power grid connections. However, traditional wind power prediction methods have long suffered from problems, for instance low prediction accuracy and poor reliability. For this purpose, a hybrid prediction model (VMD-LSTM-Attention) has been proposed, which integrates the variational modal decomposition (VMD), the long short-term memory (LSTM), and the attention mechanism (Attention), and has been optimized by improved dung beetle optimization algorithm (IDBO). Firstly, the algorithm’s performance has been significantly enhanced through the implementation of three key strategies, namely the elite group strategy of the Logistic-Tent map, the nonlinear… More >

  • Open Access

    ARTICLE

    A Lightweight Multimodal Deep Fusion Network for Face Antis Poofing with Cross-Axial Attention and Deep Reinforcement Learning Technique

    Diyar Wirya Omar Ameenulhakeem*, Osman Nuri Uçan

    CMC-Computers, Materials & Continua, Vol.85, No.3, pp. 5671-5702, 2025, DOI:10.32604/cmc.2025.070422 - 23 October 2025

    Abstract Face antispoofing has received a lot of attention because it plays a role in strengthening the security of face recognition systems. Face recognition is commonly used for authentication in surveillance applications. However, attackers try to compromise these systems by using spoofing techniques such as using photos or videos of users to gain access to services or information. Many existing methods for face spoofing face difficulties when dealing with new scenarios, especially when there are variations in background, lighting, and other environmental factors. Recent advancements in deep learning with multi-modality methods have shown their effectiveness in… More >

  • Open Access

    ARTICLE

    HERL-ViT: A Hybrid Enhanced Vision Transformer Based on Regional-Local Attention for Malware Detection

    Boyan Cui1,2, Huijuan Wang1,*, Yongjun Qi1,*, Hongce Chen1, Quanbo Yuan1,3, Dongran Liu1, Xuehua Zhou1

    CMC-Computers, Materials & Continua, Vol.85, No.3, pp. 5531-5553, 2025, DOI:10.32604/cmc.2025.070101 - 23 October 2025

    Abstract The proliferation of malware and the emergence of adversarial samples pose severe threats to global cybersecurity, demanding robust detection mechanisms. Traditional malware detection methods suffer from limited feature extraction capabilities, while existing Vision Transformer (ViT)-based approaches face high computational complexity due to global self-attention, hindering their efficiency in handling large-scale image data. To address these issues, this paper proposes a novel hybrid enhanced Vision Transformer architecture, HERL-ViT, tailored for malware detection. The detection framework involves five phases: malware image visualization, image segmentation with patch embedding, regional-local attention-based feature extraction, enhanced feature transformation, and classification. Methodologically,… More >

  • Open Access

    ARTICLE

    Prompt-Guided Dialogue State Tracking with GPT-2 and Graph Attention

    Muhammad Asif Khan1, Dildar Hussain2, Bhuyan Kaibalya Prasad3, Irfan Ullah4, Inayat Khan5, Jawad Khan6,*, Yeong Hyeon Gu2,*, Pavlos Kefalas7

    CMC-Computers, Materials & Continua, Vol.85, No.3, pp. 5451-5468, 2025, DOI:10.32604/cmc.2025.069134 - 23 October 2025

    Abstract Dialogue State Tracking (DST) is a critical component of task-oriented spoken dialogue systems (SDS), tasked with maintaining an accurate representation of the conversational state by predicting slots and their corresponding values. Recent advances leverage Large Language Models (LLMs) with prompt-based tuning to improve tracking accuracy and efficiency. However, these approaches often incur substantial computational and memory overheads and typically address slot extraction implicitly within prompts, without explicitly modeling the complex dependencies between slots and values. In this work, we propose PUGG, a novel DST framework that constructs schema-driven prompts to fine-tune GPT-2 and utilizes its tokenizer… More >

  • Open Access

    ARTICLE

    Prediction of Landslide Displacement Using a BiLSTM-RBF Model Based on a Hybrid Attention Mechanism

    Jiao Chen1, Xiao Wang1,*, Zhiqin He1, Yi Chen2, Chao Ma1

    CMC-Computers, Materials & Continua, Vol.85, No.3, pp. 5423-5450, 2025, DOI:10.32604/cmc.2025.067952 - 23 October 2025

    Abstract This research proposes an innovative solution to the inherent challenges faced by landslide displacement prediction models based on data-driven methods, such as the need for extensive historical datasets for training, the reliance on manual feature selection, and the difficulty in effectively utilizing landslide historical data. We have developed a dual-channel deep learning prediction model that integrates multimodal decomposition and an attention mechanism to overcome these challenges and improve prediction performance. The proposed methodology follows a three-stage framework: (1) Empirical Mode Decomposition (EMD) effectively segregates cumulative displacement and feature factors; (2) We have developed a Double… More >

Displaying 51-60 on page 6 of 553. Per Page