Agent-Dice: Disentangling Knowledge Updates via Geometric Consensus for Agent Continual Learning

ACL ARR 2026 January Submission2649 Authors

Keywords: LLM, Agent, Continual Learning, GUI Agent, Tool-use

Abstract:

Large Language Model (LLM)-based agents significantly extend the utility of LLMs by interacting with dynamic environments.
However, enabling agents to continually learn new tasks without catastrophic forgetting remains a critical challenge, known as the stability–plasticity dilemma.
We argue that this dilemma fundamentally arises from the failure to explicitly distinguish between common knowledge shared across tasks and conflicting knowledge introduced by task-specific interference.
To address this, we propose Agent-Dice, a parameter fusion framework based on directional consensus evaluation.Concretely, Agent-Dice disentangles knowledge updates through a two-stage process: geometric consensus filtering to prune conflicting gradients, and curvature-based importance weighting to amplify shared semantics.
We provide a rigorous theoretical analysis that establishes the validity of the proposed fusion scheme and offers insight into the origins of the stability–plasticity dilemma.
Extensive experiments on GUI agents and tool-use agent domains demonstrate that Agent-Dice exhibits outstanding continual learning performance with minimal computational overhead and parameter updates.

Paper Type: Long

Research Area: AI/LLM Agents

Research Area Keywords: LLM agents, multi-modal agents, tool use,

Languages Studied: English

Submission Number: 2649