Towards the Generation of Structured Scientific Vector Graphics with Large Language Models

ICLR 2026 Conference Submission15308 Authors

Keywords: LLMs, vision and language, multimodal, vector graphics, image generation, benchmarking, prompting

TL;DR: We introduce a new benchmark for scientific vector graphic generation, apply it to evaluate recent LLMs, and propose a novel prompting method.

Abstract: We address the challenge of automatically visualizing scientific explanations. While prior work has explored large language model (LLM)-based vector graphic generation, existing approaches often overlook structural correctness, a key requirement for valid scientific diagrams. To achieve structurally correct generation, we make three key contributions. First, we introduce SSVG-Bench, a novel benchmark for evaluating the generation of Structured Scientific Vector Graphics. Unlike conventional visual similarity metrics, SSVG-Bench employs task-specific structural analysis for accurate evaluation, and it supports three vector formats: TikZ, SVG, and EPS. Second, we conduct an extensive benchmarking and analysis, revealing key findings such as the crucial role of LLM reasoning in ensuring structural validity. Third, we propose LLM-Oriented Orchestration Prompting (LOOP), a new prompting method that leverages LLMs' reasoning potential by combining familiar subtasks. Experiments demonstrate substantial improvements over existing prompting techniques, suggesting promising directions for scientific diagram generation. We will release our code and benchmark upon acceptance.

Primary Area: datasets and benchmarks

Submission Number: 15308