A Lightweight Explainable Guardrail for Prompt Safety

ICLR 2026 Conference Submission14754 Authors

Keywords: Guardrail, LLM safety, Explainability, Multi-task learning

TL;DR: This paper proposes LEG, a lightweight and explainable guardrail method for LLM prompt safety.

Abstract: We propose a lightweight explainable guardrail (LEG) method for the classification of unsafe prompts. LEG uses a multi-task learning architecture to jointly learn a prompt classifier and an explanation classifier, where the latter labels prompt words that explain the safe/unsafe overall decision. LEG is trained using synthetic data for explainability, which is generated using a novel strategy that counteracts the confirmation biases of LLMs. Lastly, LEG's training process uses a novel loss that captures global explanation priors and combines cross-entropy and focal losses with uncertainty-based weighting. LEG obtains equivalent or better performance than the state-of-the-art for both prompt classification and explainability, both in-domain and out-of-domain on three datasets, despite the fact that its model size is considerably smaller than current approaches. If accepted, we will release all models and the annotated dataset publicly.

Primary Area: alignment, fairness, safety, privacy, and societal considerations

Submission Number: 14754