Wenfeng Zheng¹, Siyu Lu¹, Zhuohang Cai¹, Ruiyang Wang¹, Lei Wang², Lirong Yin^2,*

CMES-Computer Modeling in Engineering & Sciences, Vol.139, No.3, pp. 2729-2745, 2024, DOI:10.32604/cmes.2023.046692

Abstract In the field of natural language processing (NLP), there have been various pre-training language models in recent years, with question answering systems gaining significant attention. However, as algorithms, data, and computing power advance, the issue of increasingly larger models and a growing number of parameters has surfaced. Consequently, model training has become more costly and less efficient. To enhance the efficiency and accuracy of the training process while reducing the model volume, this paper proposes a first-order pruning model PAL-BERT based on the ALBERT model according to the characteristics of question-answering (QA) system and language model. Firstly, a first-order network… More >

Zhenxiang He^*, Xunxi Wang, Chunwei Li

CMC-Computers, Materials & Continua, Vol.78, No.1, pp. 845-871, 2024, DOI:10.32604/cmc.2023.046607

Abstract In the fast-evolving landscape of digital networks, the incidence of network intrusions has escalated alarmingly. Simultaneously, the crucial role of time series data in intrusion detection remains largely underappreciated, with most systems failing to capture the time-bound nuances of network traffic. This leads to compromised detection accuracy and overlooked temporal patterns. Addressing this gap, we introduce a novel SSAE-TCN-BiLSTM (STL) model that integrates time series analysis, significantly enhancing detection capabilities. Our approach reduces feature dimensionality with a Stacked Sparse Autoencoder (SSAE) and extracts temporally relevant features through a Temporal Convolutional Network (TCN) and Bidirectional Long Short-term Memory Network (Bi-LSTM). By… More >

Zhihua Liu, Shengquan Liu^*, Jian Zhang

CMC-Computers, Materials & Continua, Vol.78, No.1, pp. 411-433, 2024, DOI:10.32604/cmc.2023.046237

Abstract Network intrusion detection systems (NIDS) based on deep learning have continued to make significant advances. However, the following challenges remain: on the one hand, simply applying only Temporal Convolutional Networks (TCNs) can lead to models that ignore the impact of network traffic features at different scales on the detection performance. On the other hand, some intrusion detection methods consider multi-scale information of traffic data, but considering only forward network traffic information can lead to deficiencies in capturing multi-scale temporal features. To address both of these issues, we propose a hybrid Convolutional Neural Network that supports a multi-output strategy (BONUS) for… More >

Yulei Wang¹, Li Feng^1,*, Shumin Yao^1,2, Hong Liang¹, Haoxu Shi¹, Yuqiang Chen³

CMES-Computer Modeling in Engineering & Sciences, Vol.138, No.1, pp. 639-661, 2024, DOI:10.32604/cmes.2023.029565

Abstract Interference management is one of the most important issues in the device-to-device (D2D)-enabled heterogeneous cellular networks (HetCNets) due to the coexistence of massive cellular and D2D devices in which D2D devices reuse the cellular spectrum. To alleviate the interference, an efficient interference management way is to set exclusion zones around the cellular receivers. In this paper, we adopt a stochastic geometry approach to analyze the outage probabilities of cellular and D2D users in the D2D-enabled HetCNets. The main difficulties contain three aspects: 1) how to model the location randomness of base stations, cellular and D2D users in practical networks; 2)… More >

Tao Liu¹, Kejia Zhang^1,*, Jingsong Yin¹, Yan Zhang¹, Zihao Mu¹, Chunsheng Li¹, Yanan Hu²

Computer Systems Science and Engineering, Vol.47, No.2, pp. 2563-2582, 2023, DOI:10.32604/csse.2023.041228

Abstract Spatio-temporal heterogeneous data is the database for decision-making in many fields, and checking its accuracy can provide data support for making decisions. Due to the randomness, complexity, global and local correlation of spatiotemporal heterogeneous data in the temporal and spatial dimensions, traditional detection methods can not guarantee both detection speed and accuracy. Therefore, this article proposes a method for detecting the accuracy of spatiotemporal heterogeneous data by fusing graph convolution and temporal convolution networks. Firstly, the geographic weighting function is introduced and improved to quantify the degree of association between nodes and calculate the weighted adjacency value to simplify the… More >

Hanmin Ye^1,2, Yinghui Zhou¹, Xiaomei Tao^3,*

Computer Systems Science and Engineering, Vol.47, No.2, pp. 1709-1732, 2023, DOI:10.32604/csse.2023.039186

Abstract With the popularity of online learning and due to the significant influence of emotion on the learning effect, more and more researches focus on emotion recognition in online learning. Most of the current research uses the comments of the learning platform or the learner’s expression for emotion recognition. The research data on other modalities are scarce. Most of the studies also ignore the impact of instructional videos on learners and the guidance of knowledge on data. Because of the need for other modal research data, we construct a synchronous multimodal data set for analyzing learners’ emotional states in online learning… More >

Jian Kang¹, Wanshu Fan¹, Yijing Li², Rui Liu¹, Dongsheng Zhou^1,*

CMES-Computer Modeling in Engineering & Sciences, Vol.137, No.1, pp. 607-629, 2023, DOI:10.32604/cmes.2023.024420

Abstract With the advancement of image sensing technology, estimating 3D human pose from monocular video has become a hot research topic in computer vision. 3D human pose estimation is an essential prerequisite for subsequent action analysis and understanding. It empowers a wide spectrum of potential applications in various areas, such as intelligent transportation, human-computer interaction, and medical rehabilitation. Currently, some methods for 3D human pose estimation in monocular video employ temporal convolutional network (TCN) to extract inter-frame feature relationships, but the majority of them suffer from insufficient inter-frame feature relationship extractions. In this paper, we decompose the 3D joint location regression… More >

WEI WANG^1,#, YANRONG PEI^2,#, SHUI-HUA WANG¹, JUAN MANUEL GORRZ³, YU-DONG ZHANG^1,*

BIOCELL, Vol.47, No.2, pp. 373-384, 2023, DOI:10.32604/biocell.2023.025905

Abstract Since 2019, the coronavirus disease-19 (COVID-19) has been spreading rapidly worldwide, posing an unignorable threat to the global economy and human health. It is a disease caused by severe acute respiratory syndrome coronavirus 2, a single-stranded RNA virus of the genus Betacoronavirus. This virus is highly infectious and relies on its angiotensin-converting enzyme 2-receptor to enter cells. With the increase in the number of confirmed COVID-19 diagnoses, the difficulty of diagnosis due to the lack of global healthcare resources becomes increasingly apparent. Deep learning-based computer-aided diagnosis models with high generalisability can effectively alleviate this pressure. Hyperparameter tuning is essential in… More >

Walid El-Shafai¹, Anas M. Ali^1,2, El-Sayed M. El-Rabaie¹, Naglaa F. Soliman^3,*, Abeer D. Algarni³, Fathi E. Abd El-Samie^1,3

CMC-Computers, Materials & Continua, Vol.70, No.1, pp. 1141-1157, 2022, DOI:10.32604/cmc.2022.018547

Abstract In developing countries, medical diagnosis is expensive and time consuming. Hence, automatic diagnosis can be a good cheap alternative. This task can be performed with artificial intelligence tools such as deep Convolutional Neural Networks (CNNs). These tools can be used on medical images to speed up the diagnosis process and save the efforts of specialists. The deep CNNs allow direct learning from the medical images. However, the accessibility of classified data is still the largest challenge, particularly in the field of medical imaging. Transfer learning can deliver an effective and promising solution by transferring knowledge from universal object detection CNNs… More >

Maosen Wang¹, Shaozhang Niu^1,*, Zhenguang Gao²

CMC-Computers, Materials & Continua, Vol.60, No.2, pp. 781-794, 2019, DOI:10.32604/cmc.2019.05595

Abstract Scene text recognition is one of the most important techniques in pattern recognition and machine intelligence due to its numerous practical applications. Scene text recognition is also a sequence model task. Recurrent neural network (RNN) is commonly regarded as the default starting point for sequential models. Due to the non-parallel prediction and the gradient disappearance problem, the performance of the RNN is difficult to improve substantially. In this paper, a new TRDD network architecture which base on dilated convolution and residual block is proposed, using Convolutional Neural Networks (CNN) instead of RNN realizes the recognition task of sequence texts. Our… More >