Go to ACL ARR 2026 January homepageMeasHalu: Mitigation of Scientific Measurement Hallucinations for Large Language Models with Enhanced Reasoning
Keywords: hallucination mitigation; scientific measurement extraction; large language model
Abstract: The accurate extraction of scientific measurements from literature is a critical yet challenging task in AI4Science, enabling large-scale analysis and integration of quantitative research findings.
However, Large Language Models (LLMs) frequently exhibit severe hallucinations,
which significantly undermine the reliability of automated scientific document understanding systems.
To address this problem, we propose MeasHalu, a novel framework for mitigating scientific measurement hallucinations through enhanced reasoning and targeted optimization.
We first present a fine-grained taxonomy of measurement-specific hallucinations, categorizing errors across quantities, units, modifiers, and relations.
Our approach incorporates a two-stage reasoning-aware fine-tuning strategy using augmented scientific data and process-based supervision.
Furthermore, we introduce a progressive reward curriculum designed to penalize specific hallucination types, significantly improving extraction faithfulness.
Experimental results demonstrate that MeasHalu substantially reduces hallucination rates and improves overall accuracy on the MeasEval benchmark.
This work provides a targeted solution to a key bottleneck in automated scientific knowledge extraction, facilitating more trustworthy and scalable machine-assisted scientific literature analysis.
Paper Type: Long
Research Area: Information Extraction and Retrieval
Research Area Keywords: Information Extraction; NLP Applications
Contribution Types: Model analysis & interpretability, NLP engineering experiment, Data resources
Languages Studied: English
Submission Number: 8855
Loading