PiERN: Token-Level Routing for Integrating High-Precision Computation and Reasoning

ICLR 2026 Conference Submission13353 Authors

Keywords: Physically-isolated Experts Routing Network, high-precision scientific computation, joint computation–reasoning, token-level routing, scientific intelligence systems

TL;DR: PiERN integrates high-precision scientific computation and LLMs reasoning through token-level routing, achieving higher accuracy than finetuned LLMs and greater efficiency than mainstream multi-agent approaches.

Abstract: Tasks on complex systems require high-precision numerical computation to support decisions, but current large language models (LLMs) cannot integrate such computations as an intrinsic and interpretable capability with existing architectures. Multi-agent approaches can leverage external experts, but inevitably introduce communication overhead and suffer from inefficiency caused by limited scalability. To this end, we propose \textbf{Physically-isolated Experts Routing Network} (PiERN), an architecture for integrating computation and reasoning. Instead of the tool-use workflows or function-calling, PiERN endogenously integrates computational capabilities into neural networks after separately training experts, a text-to-computation module, and a router. At inference, the router directs computation and reasoning at the token level, thereby enabling iterative alternation within a single chain of thought. We evaluate PiERN on representative linear and nonlinear computation-reasoning tasks against LLM finetuning and the multi-agent system approaches. Results show that the PiERN architecture achieves not only higher accuracy than directly finetuning LLMs but also significant improvements in response latency, token usage, and GPU energy consumption compared with mainstream multi-agent approaches. PiERN offers an efficient, interpretable, and scalable paradigm for interfacing language models with scientific systems.

Primary Area: applications to physical sciences (physics, chemistry, biology, etc.)

Submission Number: 13353