Optimized Model Editing Approach

Editing Task

The President of United States is
Biden
Trump

Key-Value Notation

FFN Module
Keys
Values

Our Method

Current Issue:

K
K
K
⚠️ Scattered Keys

Our Improvement:

Aggregated Keys
Matched Values
✓ Effective Extraction
Figure: Optimized approach for model editing with improved key aggregation and value matching