Sora for Senarios Engineering of Intelligent Vehicles: V&V, C&C, and Beyonds

Xuan Li, Qinghai Miao, Lingxi Li, Qinghua Ni, Lili Fan, Yutong Wang, Yonglin Tian, Fei-Yue Wang

Abstract: The advent of Scenarios Engineering (SE) paves the way to a new era of intelligent vehicles (IVs), driven by Artificial Intelligence (AI)-enabled strategies. It aims at shaping the IVs to be a form that is more relevant to the underlying scenario, thereby accomplishing validation, verification (V&V), and calibration, certification (C&C) of each vehicle. However, such improved capabilities relies on the accumulation and analysis of an unprecedented volume of scenarios. Recently, Sora and other video generation models have opened up new horizons for Imaginative Intelligence. As an extension of TIV-DHW (Distributed/Decentralized Hybrid Workshop) on SE, this letter discusses the potential of Sora to change the scenario generation process by reducing physical shooting, increasing extreme scenario generation, thereby enabling more comprehensive training and testing of IVs. This letter also analyzes the limitations of Sora in accurately model physics and understand cause and effect, which may affect its effectiveness in SE applications. Last, through a comprehensive outlook, this letter aims to provide a potential direction for the development of Sora-like AI technology, thereby promoting the safety, efficiency, reliability, and sustainability of IVs.