Model 1
Model 2
Prompt

# PhysVidBench : Can Your Model Separate Yolks with a Water Bottle?
Physical Commonsense in Video Generation Models

GitHub Huggingface Dataset

### Real-World

Your browser does not support the video tag.

### Synthetically Generated

Your browser does not support the video tag.

Hands squeeze an empty plastic water bottle, place the opening over an egg yolk in a bowl, and release the squeeze, sucking the yolk into the bottle, leaving the white behind.

Tested concepts: fundamental physics (), object properties & affordances (), spatial reasoning (), action & procedural understanding (), force and motion ()

## Abstract

Recent progress in text-to-video (T2V) generation has enabled the synthesis of visually compelling and temporally coherent videos from natural language. However, these models often fall short in basic physical commonsense, producing outputs that violate intuitive expectations around causality, object behavior, and tool use. Addressing this gap, we present PhysVidBench, a benchmark designed to evaluate the physical reasoning capabilities of T2V systems. The benchmark includes 383 carefully curated prompts, emphasizing tool use, material properties, and procedural interactions, and domains where physical plausibility is crucial. For each prompt, we generate videos using diverse state-of-the-art models and adopt a three-stage evaluation pipeline: (1) formulate grounded physics questions from the prompt, (2) caption the generated video with a vision-language model, and (3) task a language model to answer several physics-involved questions using only the caption. This indirect strategy circumvents common hallucination issues in direct video-based evaluation. By highlighting affordances and tool-mediated actions, areas overlooked in current T2V evaluations, PhysVidBench provides a structured, interpretable framework for assessing physical commonsense in generative video models.

## Physical Commonsense Dimensions

Force and Motion Prompt: Conditioner is applied to a finger with a stuck ring, allowing the ring to slide off smoothly.
Fundamental Physics Prompt: Hands place several sheets of white styrofoam into the bottom of a terracotta planter.
Material Interaction and Transformation Prompt: A person attaches a binder clip to the end of a toothpaste tube and squeezes it to get more toothpaste out.
Object Properties and Affordances Prompt: Hands stuff dryer lint into cardboard toilet paper tubes.
Spatial Reasoning Prompt: Toothpaste is smeared onto the inner lens of swimming goggles and then wiped away with a soft cloth.
Temporal Dynamics Prompt: Toothpicks are pushed through slices of bread, securing them against the cut edges of a leftover cake.
Action & Procedural Understanding Prompt: Hands tear pages from a book and place the crumpled pages under logs in a fire pit.

Physical commonsense dimensions tested in PhysVidBench, illustrated through video examples generated by various state-of-the-art text-to-video (T2V) models. Prompts are designed to probe specific categories such as force and motion, object affordance, spatial containment, temporal progression, and material interaction.

## Demo Video

Your browser does not support the video tag.

## Video Generation Pipeline

Video Generation Pipeline. An overview of the four-stage pipeline used to construct PhysVidBench. We begin with correct solutions from the PIQA dataset and filter them using a large language model (LLM) to identify instances of secondary tool use and object affordances (Stage 1). These filtered solutions are converted into short, physically grounded video generation prompts via another LLM pass (Stage 2). Each base prompt is further upsampled to enhance its physical specificity and causal structure while preserving the original scene (Stage 3). Both base and upsampled prompts are fed into a diverse set of state-of-the-art text-to-video generation models, resulting in videos that probe tool interaction and physical commonsense (Stage 4).

## Evaluation Pipeline

Evaluation Pipeline. Overview of our three-stage evaluation framework designed to assess physical commonsense in generated videos. Using the upsampled prompts, we generate yes/no questions aligned with one or more of the seven physical commonsense dimensions in our ontology (Stage 1). Each generated video is captioned using AuroraCap, which produces a general-purpose and seven dimension-specific captions aimed at surfacing evidence relevant to different types of physical reasoning (Stage 2). The LLM is prompted to answer the targeted physics question using only the video captions (Stage 3).

## PhysVidBench Evaluation Results

Model | AU | FM | FP | MT | OP | SR | TD | Avg
--- | --- | --- | --- | --- | --- | --- | --- | ---
LTX-Video | 20.7 (-4.2) | 19.9 (-3.5) | 18.6 (-2.5) | 16.9 (-1.6) | 25.0 (-4.7) | 17.3 (-2.3) | 13.7 (-4.6) | 21.0 (-3.0)
VideoCrafter2 | 17.7 (-1.4) | 19.4 (-2.9) | 23.3 (-3.3) | 18.8 (-2.9) | 26.6 (-2.1) | 15.8 (-0.2) | 12.6 (-2.7) | 22.1 (-1.7)
CogVideoX (2B) | 22.6 (-1.8) | 24.6 (-4.5) | 23.8 (-2.7) | 22.6 (-0.3) | 28.9 (-3.5) | 19.6 (-1.3) | 16.8 (-1.5) | 25.6 (-3.1)
CogVideoX (5B) | 18.9 (-0.8) | 19.6 (-3.3) | 21.3 (-3.2) | 18.1 (-1.4) | 25.6 (-1.3) | 17.9 (-0.5) | 12.6 (+0.8) | 21.0 (-1.5)
Wan2.1 (1.3B) | 30.1 (-3.5) | 29.0 (-5.0) | 28.5 (-2.8) | 28.9 (-1.9) | 35.2 (-3.6) | 27.4 (-3.1) | 18.7 (+0.0) | 30.6 (-3.1)
Wan2.1 (14B) | 33.6 (-3.5) | 31.6 (-1.4) | 32.6 (-1.3) | 32.9 (-3.5) | 39.0 (-3.9) | 29.6 (-1.3) | 23.7 (-1.5) | 34.1 (-1.9)
MAGI-1 | 27.3 (-5.9) | 26.6 (-4.0) | 29.4 (-1.7) | 28.5 (-5.1) | 37.4 (-5.0) | 30.4 (-5.0) | 19.1 (-8.0) | 32.6 (-5.3)
Hunyuan Video | 26.7 (-0.5) | 26.2 (+0.2) | 28.1 (-0.1) | 32.3 (-4.8) | 36.1 (-1.9) | 23.9 (+2.1) | 21.8 (-5.3) | 30.0 (-0.9)
Cosmos (7B) | 32.5 (-8.2) | 32.8 (-9.3) | 33.6 (-8.9) | 36.1 (-10.6) | 40.1 (-10.6) | 31.6 (-10.0) | 21.4 (-8.4) | 35.0 (-8.3)
Cosmos (14B) | 35.6 (-5.9) | 33.3 (-6.1) | 31.7 (-3.9) | 37.4 (-5.9) | 40.9 (-9.6) | 32.5 (-5.3) | 21.0 (-0.4) | 36.2 (-7.1)
Sora | 28.6 (+2.4) | 30.0 (-1.1) | 29.9 (+0.2) | 33.1 (+0.3) | 37.0 (-1.1) | 24.8 (+1.7) | 16.7 (+2.6) | 31.4 (+0.3)
Veo-2 | 34.9 (-0.7) | 33.8 (-2.3) | 31.7 (-2.7) | 36.0 (-3.1) | 38.4 (-1.5) | 29.7 (+1.0) | 19.5 (+2.5) | 34.8 (-0.7)

AU: Action & Procedural Understanding, FM: Force and Motion, FP: Fundamental Physics, MT: Material Interaction & Transformation, OP: Object Properties & Affordances, SR: Spatial Reasoning, TD: Temporal Dynamics.

We present evaluation results for 12 state-of-the-art video generation models using PhysVidBench, which measures physical commonsense understanding across seven fine-grained dimensions, Action Understanding, Force & Motion, Fundamental Physics, Material Interaction, Object Properties, Spatial Reasoning, and Temporal Dynamics, along with an overall average. Each model is tested under two prompt variants: base prompts derived directly from PIQA answer texts, and upsampled prompts that enrich physical details and causal structure. Across all models, upsampled prompts consistently yield higher scores, particularly in dimensions that benefit from explicit physical context, such as Object Properties, Force & Motion, and Material Interaction. This suggests that prompt engineering remains a critical factor in eliciting stronger physical reasoning from generative models. Despite these gains, most models still underperform in Spatial Reasoning and Temporal Dynamics, reflecting limitations in current architectures' ability to encode geometry, continuity, and causal flow over time. Interestingly, while larger models such as Wan2.1 14B and Cosmos 14B generally achieve higher scores, size alone does not guarantee robust physical understanding highlighting the need for improved objective functions, data, or inductive biases tailored to physical commonsense. Overall, PhysVidBench provides a clear and interpretable framework for diagnosing such gaps and benchmarking progress in physically grounded video generation.

##

D3 Radar Chart – Tooltip + Alt Legend + Highlight
D3 Radar Chart – Tooltip + Alt Legend + Highlight