Open Access iconOpen Access

ARTICLE

crossmark

Solving Geometry Problems via Feature Learning and Contrastive Learning of Multimodal Data

Pengpeng Jian1, Fucheng Guo1,*, Yanli Wang2, Yang Li1

1 North China University of Water Resources and Electric Power, Zhengzhou, 450046, China
2 Henan University of Economics and Law, Zhengzhou, 450046, China

* Corresponding Author: Fucheng Guo. Email: email

(This article belongs to the Special Issue: Humanized Computing and Reasoning in Teaching and Learning)

Computer Modeling in Engineering & Sciences 2023, 136(2), 1707-1728. https://doi.org/10.32604/cmes.2023.023243

Abstract

This paper presents an end-to-end deep learning method to solve geometry problems via feature learning and contrastive learning of multimodal data. A key challenge in solving geometry problems using deep learning is to automatically adapt to the task of understanding single-modal and multimodal problems. Existing methods either focus on single-modal or multimodal problems, and they cannot fit each other. A general geometry problem solver should obviously be able to process various modal problems at the same time. In this paper, a shared feature-learning model of multimodal data is adopted to learn the unified feature representation of text and image, which can solve the heterogeneity issue between multimodal geometry problems. A contrastive learning model of multimodal data enhances the semantic relevance between multimodal features and maps them into a unified semantic space, which can effectively adapt to both single-modal and multimodal downstream tasks. Based on the feature extraction and fusion of multimodal data, a proposed geometry problem solver uses relation extraction, theorem reasoning, and problem solving to present solutions in a readable way. Experimental results show the effectiveness of the method.

Keywords


Cite This Article

APA Style
Jian, P., Guo, F., Wang, Y., Li, Y. (2023). Solving geometry problems via feature learning and contrastive learning of multimodal data. Computer Modeling in Engineering & Sciences, 136(2), 1707-1728. https://doi.org/10.32604/cmes.2023.023243
Vancouver Style
Jian P, Guo F, Wang Y, Li Y. Solving geometry problems via feature learning and contrastive learning of multimodal data. Comput Model Eng Sci. 2023;136(2):1707-1728 https://doi.org/10.32604/cmes.2023.023243
IEEE Style
P. Jian, F. Guo, Y. Wang, and Y. Li "Solving Geometry Problems via Feature Learning and Contrastive Learning of Multimodal Data," Comput. Model. Eng. Sci., vol. 136, no. 2, pp. 1707-1728. 2023. https://doi.org/10.32604/cmes.2023.023243



cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 918

    View

  • 488

    Download

  • 0

    Like

Share Link