Jie Chen¹, Jiabao Xu¹, Xuefeng Xi^1,*, Zhiming Cui¹, Victor S. Sheng²

CMES-Computer Modeling in Engineering & Sciences, Vol.134, No.1, pp. 747-761, 2023, DOI:10.32604/cmes.2022.020771

Abstract Interpreting deep neural networks is of great importance to understand and verify deep models for natural language processing (NLP) tasks. However, most existing approaches only focus on improving the performance of models but ignore their interpretability. In this work, we propose a Randomly Wired Graph Neural Network (RWGNN) by using graph to model the structure of Neural Network, which could solve two major problems (word-boundary ambiguity and polysemy) of Chinese NER. Besides, we develop a pipeline to explain the RWGNN by using Saliency Map and Adversarial Attacks. Experimental results demonstrate that our approach can identify meaningful and reasonable interpretations for… More >

Maojian Chen^1,2,3, Xiong Luo^1,2,3,*, Hailun Shen⁴, Ziyang Huang⁴, Qiaojuan Peng^1,2,3

CMES-Computer Modeling in Engineering & Sciences, Vol.129, No.1, pp. 47-63, 2021, DOI:10.32604/cmes.2021.017491

Abstract In the era of big data, E-commerce plays an increasingly important role, and steel E-commerce certainly occupies a positive position. However, it is very difficult to choose satisfactory steel raw materials from diverse steel commodities online on steel E-commerce platforms in the purchase of staffs. In order to improve the efficiency of purchasers searching for commodities on the steel E-commerce platforms, we propose a novel deep learning-based loss function for named entity recognition (NER). Considering the impacts of small sample and imbalanced data, in our NER scheme, the focal loss, the label smoothing, and the cross entropy are incorporated into… More >

Qin Zhang¹, Xuyu Xiang^1,*, Jiaohua Qin¹, Yun Tan¹, Qiang Liu¹, Neal N. Xiong²

Intelligent Automation & Soft Computing, Vol.30, No.1, pp. 227-241, 2021, DOI:10.32604/iasc.2021.017648

Abstract With the rapid development of network media, the short text has become the main cover of information dissemination by quickly disseminating relevant entity information. However, the lack of context in the short text can easily lead to ambiguity, which will greatly reduce the efficiency of obtaining information and seriously affect the user’s experience, especially in the financial field. This paper proposed an entity disambiguation algorithm based on multi-word vector ensemble and decision to eliminate the ambiguity of entities and purify text information in information processing. First of all, we integrate a variety of unsupervised pre-trained word vector models as vector… More >

Shan Zhang¹, Bin Cao¹, Yueshen Xu^2,*, Jing Fan¹

CMES-Computer Modeling in Engineering & Sciences, Vol.127, No.1, pp. 309-323, 2021, DOI:10.32604/cmes.2021.014802

Abstract As a representative technique in natural language processing (NLP), named entity recognition is used in many tasks, such as dialogue systems, machine translation and information extraction. In dialogue systems, there is a common case for named entity recognition, where a lot of entities are composed of numbers, and are segmented to be located in different places. For example, in multiple rounds of dialogue systems, a phone number is likely to be divided into several parts, because the phone number is usually long and is emphasized. In this paper, the entity consisting of numbers is named as number entity. The discontinuous… More >

Norah Alsaaran^*, Maha Alrabiah

CMC-Computers, Materials & Continua, Vol.68, No.1, pp. 471-485, 2021, DOI:10.32604/cmc.2021.016054

Abstract Named Entity Recognition (NER) is one of the fundamental tasks in Natural Language Processing (NLP), which aims to locate, extract, and classify named entities into a predefined category such as person, organization and location. Most of the earlier research for identifying named entities relied on using handcrafted features and very large knowledge resources, which is time consuming and not adequate for resource-scarce languages such as Arabic. Recently, deep learning achieved state-of-the-art performance on many NLP tasks including NER without requiring hand-crafted features. In addition, transfer learning has also proven its efficiency in several NLP tasks by exploiting pretrained language models… More >

Tao Li¹, Yongjin Hu^1,*, Ankang Ju¹, Zhuoran Hu²

CMC-Computers, Materials & Continua, Vol.66, No.1, pp. 407-420, 2021, DOI:10.32604/cmc.2020.012023

Abstract Owing to the continuous barrage of cyber threats, there is a massive amount of cyber threat intelligence. However, a great deal of cyber threat intelligence come from textual sources. For analysis of cyber threat intelligence, many security analysts rely on cumbersome and time-consuming manual efforts. Cybersecurity knowledge graph plays a significant role in automatics analysis of cyber threat intelligence. As the foundation for constructing cybersecurity knowledge graph, named entity recognition (NER) is required for identifying critical threat-related elements from textual cyber threat intelligence. Recently, deep neural network-based models have attained very good results in NER. However, the performance of these… More >