Vol.35, No.6, 2020, pp.423-430, doi:
OPEN ACCESS
ARTICLE
An Accurate Persian Part-of-Speech Tagger
  • Morteza Okhovvat1,∗, Mohsen Sharifi2,†, Behrouz Minaei Bidgoli2,‡
1 Health Management and Social Development Research Center, Golestan University of Medical Sciences, Gorgan, Iran
2 School of Computer Engineering, Iran University of Science and Technology, Tehran, Iran
† Mohsen Sharifi, msharifi@iust.ac.ir
‡ Behrouz Minaei Bidgoli, b_minaei@iust.ac.ir
* Corresponding Author: Morteza Okhovvat,
Abstract
The processing of any natural language requires that the grammatical properties of every word in that language are tagged by a part of speech (POS) tagger. To present a more accurate POS tagger for the Persian language, we propose an improved and accurate tagger called IAoM that supports properties of text to speech systems such as Lexical Stress Search, Homograph words Disambiguation, Break Phrase Detection, and main aspects of Persian morphology. IAoM uses Maximum Likelihood Estimation (MLE) to determine the tags of unknown words. In addition, it uses a few defined rules for the sake of achieving high accuracy. For tagging the input corpus, IAoM uses a Hidden Markov Model (HMM) alongside the Viterbi algorithm. To present a fair evaluation, we have performed various experiments on both homogeneous and heterogeneous Persian corpora and studied the effect of the size of training set on the accuracy of IAoM. Experimental results demonstrate the merit of the proposed tagger in achieving an overall accuracy of 97.6%.
Keywords
Hidden Markov Model, Maximum Likelihood Estimation, Morphology, POS Tagger, Viterbi Algorithm
Cite This Article
M. Okhovvat, M. Sharifi and B. M. Bidgoli, "An accurate persian part-of-speech tagger," Computer Systems Science and Engineering, vol. 35, no.6, pp. 423–430, 2020.
This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.