For the best experience, it's better to use a desktop computer to view this website.

# STANCE: Motion Coherent Video generation Via Sparse-To-dense ANChored Encoding

Generating dynamic videos from single frames with controllable object motion

## STANCE Showcase

These videos demonstrate STANCE's ability to generate dynamic sequences from a single input frame. Each pair shows the initial frame (left) and the generated video (right).

### Velocity and Mass Variations

Demonstrating how STANCE can generate different motion patterns from the same initial frame.

Initial condition
Vary Case 1-1
Initial condition
Vary Case 1-2
Initial condition
Vary Case 2-1
Initial condition
Vary Case 2-2
Initial condition
Vary Case 2-3
Initial condition
Vary Case 2-4
Velocity and Mass Variations: Different velocity patterns and mass properties applied to identical initial conditions, showing the model's ability to generate diverse motion trajectories with varying physical properties.

### Multi-Object Scenarios

STANCE's capability in handling complex scenes with multiple interacting objects.

Initial condition
Multi-Object Scene 1
Initial condition
Multi-Object Scene 2
Initial condition
Multi-Object Scene 3
Initial condition
Multi-Object Scene 4
Multi-Object Cases (Row 1): Demonstrating STANCE's ability to generate coherent motion for scenes with multiple interacting objects, maintaining spatial relationships and realistic dynamics.
Initial condition
Multi-Object Scene 5
Initial condition
Multi-Object Scene 6
Multi-Object Cases (Row 2): Additional complex multi-object scenarios showcasing diverse interaction patterns and motion coordination between multiple entities in the scene.

### Composite Scenes

Controllable object interactions in composite scenarios with precise motion dynamics control.

Initial condition
Keep Green Static 1
Initial condition
Keep Green Static 2
Initial condition
Slow Collision 1
Initial condition
Slow Collision 2
Composite Scene Control: Precise control over object behavior including keeping specific objects static (让绿色不动) and controlling collision dynamics with speed variations (速度变慢，撞到一起).
Initial condition
Direction Change 1
Initial condition
Direction Change 2
Initial condition
Avoid Collision 1
Initial condition
Avoid Collision 2
Direction Control: Fine-grained control over motion direction (改变速度方向) and collision avoidance (vary速度方向，没撞上), demonstrating precise trajectory control capabilities.
Initial condition
Direction Change 1-1
Initial condition
Direction Change 1-2
Initial condition
Vel Direction 1
Initial condition
Vel Direction 2
Direction Variants: Additional variants including 改变速度方向_1 and 改变vel方向 to further demonstrate directional control diversity.

## Real World Captures

STANCE applied to real-world scenarios captured from actual environments, demonstrating the model's capability to handle authentic natural scenes.

Initial condition
Real World Scene 1
Initial condition
Real World Scene 2
Initial condition
Real World Scene 3
Initial condition
Real World Scene 4
Real World Captures: STANCE applied to authentic real-world scenarios, demonstrating robust performance on natural environments and diverse object interactions captured from actual scenes.

## Comparison

Comparative analysis between STANCE and other video generation methods.

Initial condition
First Frame
Ours
DragAny
SGI2V
MotionPro
MoFA
Case 1: Five baseline methods for direct comparison.
Initial condition
First Frame
Ours
DragAny
SGI2V
MotionPro
MoFA
Case 2: Five baseline methods for direct comparison.
Initial condition
First Frame
Ours
DragAny
SGI2V
MotionPro
MoFA
Case 3: Five baseline methods for direct comparison.