TY  - EJOU
AU  - Tripathi, Sahil 
AU  - Kulahara, Manaswi 
AU  - Saudagar, Abdul Khader Jilani 
AU  - AlSagri, Hatoon S. 

TI  - Can Causal Circuits Enable Efficient Spatial Reasoning for Geoinformatics in Large Language Models?
T2  - Computer Modeling in Engineering \& Sciences

PY  - 
VL  - 
IS  - 
SN  - 1526-1506

AB  - Spatial reasoning, defined as the ability to infer and compose relations among entities—is fundamental to geoinformatics applications such as spatial querying and map understanding. However, existing works such as Bidirectional Encoder Representations from Transformers (BERT)-based spatial Question Answering (QA) models and neuro-symbolic models rely on dataset-specific patterns, leading to <i>shortcut learning</i>, where reliance on superficial lexical cues rather than true relational understanding. Recent Large Language Models (LLMs)-based works, including fine-tuning and Chain-of-Thought (CoT) prompting, partially alleviate <i>shortcut learning</i> but remain limited by <i>non-causal reasoning</i>, where predictions depend on spurious correlations rather than stable relational structure. To address these limitations, we propose <monospace>Causal Inference and Reasoning via Compact sUbnetwork IdenTification (CIRCUIT-X)</monospace>, motivated by the hypothesis that spatial reasoning in LLMs is governed by compact causal parameter subsets (a.k.a <i>causal circuits</i>). <monospace>CIRCUIT-X</monospace> operates in two stages: (i) Causal Importance Estimation (Stage I) via structured interventions to mitigate <i>shortcut learning</i>, and (ii) Minimal Circuit Discovery (Stage II) via structured pruning to mitigate <i>non-causal reasoning</i>. Empirically, <monospace>CIRCUIT-X</monospace> achieves up to 91% accuracy on SPAtial Reasoning on Textual Question Answering (SPARTQA) and 87% on StepGame, outperforming State-of-the-Art (SOTA) methods while improving intervention robustness by up to +11% and causal consistency by up to +16%. Therefore, it retains up to 96% of full-model performance using only 3%–6% of active parameters, while demonstrating strong robustness under cross-domain transfer with improvements of up to +10% in accuracy and substantially higher intervention stability under distribution shifts.
KW  - Causal circuits; geoinformatics; large language models; parameter-efficient learning; spatial reasoning; structured pruning

DO  - 10.32604/cmes.2026.083755