Bridging the Editing Gap in LLMs: FineEdit for Precise and Targeted Text Modifications

ACL ARR 2025 February Submission6393 Authors

Abstract:

Large Language Models (LLMs) have transformed natural language processing, yet they still struggle with direct text editing tasks that demand precise, context-aware modifications. While models like ChatGPT excel in text generation and analysis, their editing abilities often fall short, addressing only superficial issues rather than deeper structural or logical inconsistencies. In this work, we introduce a dual approach to enhance LLMs editing performance. First, we present InstrEditBench, a high-quality benchmark dataset comprising over 20,000 structured editing tasks spanning Wiki articles, LaTeX documents, code, and database Domain-specific Languages (DSL). InstrEditBench is generated using an innovative automated workflow that accurately identifies and evaluates targeted edits, ensuring that modifications adhere strictly to specified instructions without altering unrelated content. Second, we propose FineEdit, a specialized model trained on this curated benchmark. Experimental results demonstrate that FineEdit achieves significant improvements around {10\%} compared with Gemini on direct editing tasks, convincingly validating its
effectiveness.

Paper Type: Long

Research Area: Semantics: Lexical and Sentence-Level

Research Area Keywords: NLP datasets, text editing

Contribution Types: Data resources

Languages Studied: English

Submission Number: 6393