Open Access iconOpen Access

ARTICLE

crossmark

SSAG-Net: Syntactic and Semantic Attention-Guided Machine Reading Comprehension

Chenxi Yu, Xin Li*

Department of Information Technology and Cyber Security People’s Public Security University of China, Beijing, 102623, China

* Corresponding Author: Xin Li. Email: email

Intelligent Automation & Soft Computing 2022, 34(3), 2023-2034. https://doi.org/10.32604/iasc.2022.029447

Abstract

Machine reading comprehension (MRC) is a task in natural language comprehension. It assesses machine reading comprehension based on text reading and answering questions. Traditional attention methods typically focus on one of syntax or semantics, or integrate syntax and semantics through a manual method, leaving the model unable to fully utilize syntax and semantics for MRC tasks. In order to better understand syntactic and semantic information and improve machine reading comprehension, our study uses syntactic and semantic attention to conduct text modeling for tasks. Based on the BERT model of Transformer encoder, we separate a text into two branches: syntax part and semantics part. In syntactic component, an attention model with explicit syntactic constraints is linked with a self-attention model of context. In semantics component, after the framework semantic parsing, the lexical unit attention model is utilized to process the text in the semantic part. Finally, the vectors of the two branches converge into a new vector. And it can make answer predictions based on different types of data. Thus, a syntactic and semantic attention-guided machine reading comprehension (SSAG-Net) is formed. To test the model’s validity, we ran it through two MRC tasks on SQuAD 2.0 and MCTest, and the SSAG-Net model outperformed the baseline model in both.

Keywords


Cite This Article

APA Style
Yu, C., Li, X. (2022). Ssag-net: syntactic and semantic attention-guided machine reading comprehension. Intelligent Automation & Soft Computing, 34(3), 2023-2034. https://doi.org/10.32604/iasc.2022.029447
Vancouver Style
Yu C, Li X. Ssag-net: syntactic and semantic attention-guided machine reading comprehension. Intell Automat Soft Comput . 2022;34(3):2023-2034 https://doi.org/10.32604/iasc.2022.029447
IEEE Style
C. Yu and X. Li, "SSAG-Net: Syntactic and Semantic Attention-Guided Machine Reading Comprehension," Intell. Automat. Soft Comput. , vol. 34, no. 3, pp. 2023-2034. 2022. https://doi.org/10.32604/iasc.2022.029447



cc Copyright © 2022 The Author(s). Published by Tech Science Press.
This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 1068

    View

  • 623

    Download

  • 0

    Like

Share Link