Vol.28, No.2, 2021, pp.447-458, doi:10.32604/iasc.2021.016320
Leverage External Knowledge and Self-attention for Chinese Semantic Dependency Graph Parsing
  • Dianqing Liu1,2, Lanqiu Zhang1,2, Yanqiu Shao1,2,*, Junzhao Sun3
1 School of Information Science, Beijing Language and Culture University, Beijing, 100083, China
2 National Language Resources Monitoring and Research Center (CNLR) Print Media Language Branch, Beijing, 100083, China
3 Faculty of Applied Science and Technology, Sheridan College, Oakville, ON L6H 2L1, Canada
* Corresponding Author: Yanqiu Shao. Email:
Received 26 December 2020; Accepted 29 January 2021; Issue published 01 April 2021
Chinese semantic dependency graph (CSDG) parsing aims to analyze the semantic relationship between words in a sentence. Since it is a deep semantic analysis task, the parser needs a lot of prior knowledge about the real world to distinguish different semantic roles and determine the range of the head nodes of each word. Existing CSDG parsers usually use part-of-speech (POS) and lexical features, which can only provide linguistic knowledge, but not semantic knowledge about the word. To solve this problem, we propose an entity recognition method based on distant supervision and entity classification to recognize entities in sentences, and then we integrate the category information of entities as external knowledge feature into our CSDG parser. Furthermore, there are many long sentences in some domains, which makes it difficult for the parser to deal with long-distance dependence. In this paper, we combine self-attention mechanism with Bi-LSTM, which significantly improved the performance of the parser on long texts. We also adopt Bert model to generate more powerful sentence representation and alleviate the problem of unknown words. Experiment results show that both external knowledge and self-attention are beneficial for improving the accuracy of CSDG parser and our parser achieves state-of-the-art performance in the datasets of SemEval-2016 Task 9: Chinese Semantic Dependency Parsing.
Chinese semantic dependency graph paring; external knowledge; self-attention; Bert
Cite This Article
D. Liu, L. Zhang, Y. Shao and J. Sun, "Leverage external knowledge and self-attention for chinese semantic dependency graph parsing," Intelligent Automation & Soft Computing, vol. 28, no.2, pp. 447–458, 2021.
This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.