Open Access iconOpen Access

ARTICLE

crossmark

Mathematical Named Entity Recognition Based on Adversarial Training and Self-Attention

Qiuyu Lai1,2, Wang Kang3, Lei Yang1,2, Chun Yang1,2,*, Delin Zhang2,*

1 Key Laboratory of the Evaluation and Monitoring of Southwest Land Resources (Sichuan Normal University), Ministry of Education, Chengdu, 610166, China
2 School of Mathematics and Science, Sichuan Normal University, Chengdu, 610166, China
3 Chengdu State-Owned Jinjiang Machine Factory, Chengdu, 610100, China

* Corresponding Authors: Chun Yang. Email: email; Delin Zhang. Email: email

Intelligent Automation & Soft Computing 2024, 39(4), 649-664. https://doi.org/10.32604/iasc.2024.051724

Abstract

Mathematical named entity recognition (MNER) is one of the fundamental tasks in the analysis of mathematical texts. To solve the existing problems of the current neural network that has local instability, fuzzy entity boundary, and long-distance dependence between entities in Chinese mathematical entity recognition task, we propose a series of optimization processing methods and constructed an Adversarial Training and Bidirectional long short-term memory-Selfattention Conditional random field (AT-BSAC) model. In our model, the mathematical text was vectorized by the word embedding technique, and small perturbations were added to the word vector to generate adversarial samples, while local features were extracted by Bi-directional Long Short-Term Memory (BiLSTM). The self-attentive mechanism was incorporated to extract more dependent features between entities. The experimental results demonstrated that the AT-BSAC model achieved a precision (P) of 93.88%, a recall (R) of 93.84%, and an F1-score of 93.74%, respectively, which is 8.73% higher than the F1-score of the previous Bi-directional Long Short-Term Memory Conditional Random Field (BiLSTM-CRF) model. The effectiveness of the proposed model in mathematical named entity recognition.

Keywords


Cite This Article

APA Style
Lai, Q., Kang, W., Yang, L., Yang, C., Zhang, D. (2024). Mathematical named entity recognition based on adversarial training and self-attention. Intelligent Automation & Soft Computing, 39(4), 649-664. https://doi.org/10.32604/iasc.2024.051724
Vancouver Style
Lai Q, Kang W, Yang L, Yang C, Zhang D. Mathematical named entity recognition based on adversarial training and self-attention. Intell Automat Soft Comput . 2024;39(4):649-664 https://doi.org/10.32604/iasc.2024.051724
IEEE Style
Q. Lai, W. Kang, L. Yang, C. Yang, and D. Zhang "Mathematical Named Entity Recognition Based on Adversarial Training and Self-Attention," Intell. Automat. Soft Comput. , vol. 39, no. 4, pp. 649-664. 2024. https://doi.org/10.32604/iasc.2024.051724



cc Copyright © 2024 The Author(s). Published by Tech Science Press.
This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 327

    View

  • 133

    Download

  • 0

    Like

Share Link