Can Causal Circuits Enable Efficient Spatial Reasoning for Geoinformatics in Large Language Models?

Sahil Tripathi¹, Manaswi Kulahara², Abdul Khader Jilani Saudagar³, Hatoon S. AlSagri^3,*
1 Department of Computer Science and Engineering, Jamia Hamdard, New Delhi, India
2 Department of Geoinformatics, TERI School of Advanced Studies, Delhi, India
3 Information Systems Department, College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh, Saudi Arabia
* Corresponding Author: Hatoon S. AlSagri. Email: email
(This article belongs to the Special Issue: Applied NLP with Large Language Models: AI Applications Across Domains)

Computer Modeling in Engineering & Sciences https://doi.org/10.32604/cmes.2026.083755

Received 09 April 2026; Accepted 15 June 2026; Published online 13 July 2026

Download PDF

Abstract

Spatial reasoning, defined as the ability to infer and compose relations among entities—is fundamental to geoinformatics applications such as spatial querying and map understanding. However, existing works such as Bidirectional Encoder Representations from Transformers (BERT)-based spatial Question Answering (QA) models and neuro-symbolic models rely on dataset-specific patterns, leading to shortcut learning, where reliance on superficial lexical cues rather than true relational understanding. Recent Large Language Models (LLMs)-based works, including fine-tuning and Chain-of-Thought (CoT) prompting, partially alleviate shortcut learning but remain limited by non-causal reasoning, where predictions depend on spurious correlations rather than stable relational structure. To address these limitations, we propose Causal Inference and Reasoning via Compact sUbnetwork IdenTification (CIRCUIT-X), motivated by the hypothesis that spatial reasoning in LLMs is governed by compact causal parameter subsets (a.k.a causal circuits). CIRCUIT-X operates in two stages: (i) Causal Importance Estimation (Stage I) via structured interventions to mitigate shortcut learning, and (ii) Minimal Circuit Discovery (Stage II) via structured pruning to mitigate non-causal reasoning. Empirically, CIRCUIT-X achieves up to 91% accuracy on SPAtial Reasoning on Textual Question Answering (SPARTQA) and 87% on StepGame, outperforming State-of-the-Art (SOTA) methods while improving intervention robustness by up to +11% and causal consistency by up to +16%. Therefore, it retains up to 96% of full-model performance using only 3%–6% of active parameters, while demonstrating strong robustness under cross-domain transfer with improvements of up to +10% in accuracy and substantially higher intervention stability under distribution shifts.