Open Access

ARTICLE

A Multi-Branch Transformer-Enhanced Neural Framework for Joint Morphological Representation Learning

Laura Baitenova¹, Gulnar Mukhamejanova², Gauhar Munaitbas^3,*, Saken Mambetov¹, Zhanna Mukanova¹

1 Higher School of Information Technology, Turan University, Almaty, Kazakhstan
2 School of Digital Technologies, Narxoz University, Almaty, Kazakhstan
3 Home Credit Bank JSC, Almaty, Kazakhstan

* Corresponding Author: Gauhar Munaitbas. Email:

Computers, Materials & Continua 2026, 88(3), 64 https://doi.org/10.32604/cmc.2026.081004

Received 21 February 2026; Accepted 21 May 2026; Issue published 23 July 2026

Abstract

Morphological parsing is a fundamental task in natural language processing, particularly for morphologically rich languages where words encode complex grammatical and semantic information. This paper proposes a multi-branch Transformer-enhanced neural framework for joint morphological representation learning, designed to improve segmentation and classification accuracy by integrating complementary feature extraction mechanisms. The proposed architecture combines convolutional layers for capturing local morphological patterns, recurrent layers for modeling sequential dependencies, and Transformer-based self-attention for learning global contextual relationships. This hybrid design enables the model to generate robust and context-aware representations that enhance morphological understanding. The framework is trained using morphologically annotated datasets and evaluated using standard performance metrics, including F1-score and classification accuracy. Experimental results demonstrate that the proposed model significantly outperforms conventional and single-architecture baselines in both segmentation and morphological classification tasks. The learned representations exhibit strong discriminative capability, allowing accurate identification of morpheme boundaries and grammatical features. Furthermore, the model demonstrates stable convergence behavior and strong generalization performance across diverse linguistic conditions. These findings confirm the effectiveness of integrating multi-level contextual and structural feature extraction mechanisms, establishing the proposed framework as a robust and scalable solution for advanced morphological parsing and representation learning in modern natural language processing applications.

---

Keywords

---