InfGen: Scenario Generation as Next Token Group Prediction

ICLR 2026 Conference Submission13757 Authors

Keywords: Autonomous driving, Closed-loop simulation, Scenario generation

TL;DR: InfGen models scenario generation as next token group prediction, enabling dynamic and realistic traffic simulation with a unified autoregressive model. It supports agent insertion, motion rollout, and improves RL policy robustness.

Abstract: Realistic and interactive traffic simulation is essential for training and evaluating autonomous driving systems. However, most existing data-driven simulation methods rely on static initialization or log-replay data, limiting their ability to model dynamic, long-horizon scenarios with evolving agent populations. We propose InfGen, a scenario generation framework that outputs agent states and trajectories in an autoregressive manner. InfGen represents the entire scene as a sequence of tokens—including traffic light signals, agent states, and motion vectors—and uses a transformer model to simulate traffic over time. This design enables InfGen to continuously insert new agents into traffic, supporting infinite scene generation. Experiments demonstrate that InfGen produces realistic, diverse, and adaptive traffic behaviors. Furthermore, reinforcement learning policies trained in InfGen-generated scenarios achieve superior robustness and generalization, validating its utility as a high-fidelity simulation environment for autonomous driving. Code and models will be made publicly available.

Primary Area: applications to robotics, autonomy, planning

Submission Number: 13757