Jingyi Mao, Yuchen Zhou, Yifan Wang, Junyu Li, Ziqing Liu, Fanliang Bu^*

CMC-Computers, Materials & Continua, Vol.79, No.1, pp. 837-855, 2024, DOI:10.32604/cmc.2024.048703

Abstract Voice portrait technology has explored and established the relationship between speakers’ voices and their facial features, aiming to generate corresponding facial characteristics by providing the voice of an unknown speaker. Due to its powerful advantages in image generation, Generative Adversarial Networks (GANs) have now been widely applied across various fields. The existing Voice2Face methods for voice portraits are primarily based on GANs trained on voice-face paired datasets. However, voice portrait models solely constructed on GANs face limitations in image generation quality and struggle to maintain facial similarity. Additionally, the training process is relatively unstable, thereby affecting the overall generative performance… More >

Chengkan Xu^1,2,4, Xiaofei Wang³, Yixuan Li², Guannan Wang^2,*, He Zhang^2,4,*

CMES-Computer Modeling in Engineering & Sciences, Vol.140, No.1, pp. 957-974, 2024, DOI:10.32604/cmes.2024.047327

Abstract Structural damage in heterogeneous materials typically originates from microstructures where stress concentration occurs. Therefore, evaluating the magnitude and location of localized stress distributions within microstructures under external loading is crucial. Repeating unit cells (RUCs) are commonly used to represent microstructural details and homogenize the effective response of composites. This work develops a machine learning-based micromechanics tool to accurately predict the stress distributions of extracted RUCs. The locally exact homogenization theory efficiently generates the microstructural stresses of RUCs with a wide range of parameters, including volume fraction, fiber/matrix property ratio, fiber shapes, and loading direction. Subsequently, the conditional generative adversarial network… More > Graphic Abstract

Yuanle Chen¹, Haobo Wang¹, Chunyu Liu¹, Linyi Wang², Jiaxin Liu¹, Wei Wu^1,*

CMES-Computer Modeling in Engineering & Sciences, Vol.139, No.3, pp. 2985-3009, 2024, DOI:10.32604/cmes.2023.046837

Abstract Recently, there have been significant advancements in the study of semantic communication in single-modal scenarios. However, the ability to process information in multi-modal environments remains limited. Inspired by the research and applications of natural language processing across different modalities, our goal is to accurately extract frame-level semantic information from videos and ultimately transmit high-quality videos. Specifically, we propose a deep learning-based Multi-Modal Mutual Enhancement Video Semantic Communication system, called M3E-VSC. Built upon a Vector Quantized Generative Adversarial Network (VQGAN), our system aims to leverage mutual enhancement among different modalities by using text as the main carrier of transmission. With it,… More >

Kun Fang, Julong Pan^*, Lingyi Li, Ruihan Xiang

CMC-Computers, Materials & Continua, Vol.78, No.1, pp. 493-514, 2024, DOI:10.32604/cmc.2023.045008

Abstract With the widespread use of Internet of Things (IoT) technology in daily life and the considerable safety risks of falls for elderly individuals, research on IoT-based fall detection systems has gained much attention. This paper proposes an IoT-based spatiotemporal data processing framework based on a depthwise separable convolution generative adversarial network using skip-connection (Skip-DSCGAN) for fall detection. The method uses spatiotemporal data from accelerometers and gyroscopes in inertial sensors as input data. A semisupervised learning approach is adopted to train the model using only activities of daily living (ADL) data, which can avoid data imbalance problems. Furthermore, a quantile-based approach… More >

Yue Mei^1,2,3, Jianwei Deng^1,2, Dongmei Zhao^1,2, Changjiang Xiao^1,2, Tianhang Wang⁴, Li Dong⁵, Xuefeng Zhu^1,6,*

CMES-Computer Modeling in Engineering & Sciences, Vol.139, No.1, pp. 911-935, 2024, DOI:10.32604/cmes.2023.043810

Abstract Elastography is a non-invasive medical imaging technique to map the spatial variation of elastic properties of soft tissues. The quality of reconstruction results in elastography is highly sensitive to the noise induced by imaging measurements and processing. To address this issue, we propose a deep learning (DL) model based on conditional Generative Adversarial Networks (cGANs) to improve the quality of nonhomogeneous shear modulus reconstruction. To train this model, we generated a synthetic displacement field with finite element simulation under known nonhomogeneous shear modulus distribution. Both the simulated and experimental displacement fields are used to validate the proposed method. The reconstructed… More >

Derwin Suhartono^1,*, Alif Tri Handoyo¹, Franz Adeta Junior²

CMC-Computers, Materials & Continua, Vol.77, No.3, pp. 3637-3657, 2023, DOI:10.32604/cmc.2023.045301

Abstract Sarcasm detection in text data is an increasingly vital area of research due to the prevalence of sarcastic content in online communication. This study addresses challenges associated with small datasets and class imbalances in sarcasm detection by employing comprehensive data pre-processing and Generative Adversial Network (GAN) based augmentation on diverse datasets, including iSarcasm, SemEval-18, and Ghosh. This research offers a novel pipeline for augmenting sarcasm data with Reverse Generative Adversarial Network (RGAN). The proposed RGAN method works by inverting labels between original and synthetic data during the training process. This inversion of labels provides feedback to the generator for generating… More >

Jongwook Si¹, Sungyoung Kim^2,*

CMC-Computers, Materials & Continua, Vol.77, No.3, pp. 3119-3138, 2023, DOI:10.32604/cmc.2023.043797

Abstract The objective of style transfer is to maintain the content of an image while transferring the style of another image. However, conventional methods face challenges in preserving facial features, especially in Korean portraits where elements like the “Gat” (a traditional Korean hat) are prevalent. This paper proposes a deep learning network designed to perform style transfer that includes the “Gat” while preserving the identity of the face. Unlike traditional style transfer techniques, the proposed method aims to preserve the texture, attire, and the “Gat” in the style image by employing image sharpening and face landmark, with the GAN. The color,… More >

Anwar Ullah¹, Xinguo Yu^1,*, Muhammad Numan²

CMC-Computers, Materials & Continua, Vol.77, No.2, pp. 2359-2383, 2023, DOI:10.32604/cmc.2023.041219

Abstract Generating realistic and synthetic video from text is a highly challenging task due to the multitude of issues involved, including digit deformation, noise interference between frames, blurred output, and the need for temporal coherence across frames. In this paper, we propose a novel approach for generating coherent videos of moving digits from textual input using a Deep Deconvolutional Generative Adversarial Network (DD-GAN). The DD-GAN comprises a Deep Deconvolutional Neural Network (DDNN) as a Generator (G) and a modified Deep Convolutional Neural Network (DCNN) as a Discriminator (D) to ensure temporal coherence between adjacent frames. The proposed research involves several steps.… More >

Xi Zhao¹, Haizheng Yu^1,*, Hong Bian²

CMC-Computers, Materials & Continua, Vol.77, No.1, pp. 181-198, 2023, DOI:10.32604/cmc.2023.041479

Abstract In recent years, Pix2Pix, a model within the domain of GANs, has found widespread application in the field of image-to-image translation. However, traditional Pix2Pix models suffer from significant drawbacks in image generation, such as the loss of important information features during the encoding and decoding processes, as well as a lack of constraints during the training process. To address these issues and improve the quality of Pix2Pix-generated images, this paper introduces two key enhancements. Firstly, to reduce information loss during encoding and decoding, we utilize the U-Net++ network as the generator for the Pix2Pix model, incorporating denser skip-connection to minimize… More >

Yalong Xie¹, Aiping Li^1,*, Biyin Hu², Liqun Gao¹, Hongkui Tu¹

CMC-Computers, Materials & Continua, Vol.76, No.3, pp. 2707-2726, 2023, DOI:10.32604/cmc.2023.037039

Abstract Credit Card Fraud Detection (CCFD) is an essential technology for banking institutions to control fraud risks and safeguard their reputation. Class imbalance and insufficient representation of feature data relating to credit card transactions are two prevalent issues in the current study field of CCFD, which significantly impact classification models’ performance. To address these issues, this research proposes a novel CCFD model based on Multifeature Fusion and Generative Adversarial Networks (MFGAN). The MFGAN model consists of two modules: a multi-feature fusion module for integrating static and dynamic behavior data of cardholders into a unified highdimensional feature space, and a balance module… More >