For the best experience, it's better to use a desktop computer to view this website.

# VisualCanvas: Unified Video Completion from Arbitrary Spatiotemporal Patches via In-Context Conditioning

## Anonymous Submission

## Please stay tuned for all video loading...

## Teaser Video

### Hover on the video to see corresponding text prompts

Condition

Generated Video

Frame 0

Frame 40

Frame 80

Frame 156

A blue airplane roars at high speed over the vast ocean, slices between towering ice glaciers, hurtles through a narrow canyon with cliffs on both sides, and finally streaks into the heart of a bustling city filled with skyscrapers.

Condition

Generated Video

Frame 0

Frame 52

Frame 104

Frame 156

A blue airplane roars at high speed over the vast ocean, slices between towering ice glaciers, hurtles through a narrow canyon with cliffs on both sides, and finally streaks into the heart of a bustling city filled with skyscrapers.

Condition

Generated Video

Frame 20

Frame 60

Frame 120

Frame 156

A blue airplane roars at high speed over the vast ocean, slices between towering ice glaciers, hurtles through a narrow canyon with cliffs on both sides, and finally streaks into the heart of a bustling city filled with skyscrapers.

Condition

Generated Video

Frame 40

Frame 80

Frame 120

Frame 156

A blue airplane roars at high speed over the vast ocean, slices between towering ice glaciers, hurtles through a narrow canyon with cliffs on both sides, and finally streaks into the heart of a bustling city filled with skyscrapers.

## More Patch-level Showcases

### Hover on the video to see corresponding text prompts

Condition

Generated Video

Frame 0

Frame 60

Frame 140

A red-and-white car drives from a forest road to a seaside highway and finally into a snowy forest.

Condition

Generated Video

Frame 0

Frame 40

Frame 76

A continuous high-speed journey. The camera rushes past the first hiker on a frozen lake, then soars over the mountains. It dives down to find the second hiker on a forest trail. Without stopping, the camera then rockets upwards and over another mountain range, finally landing behind the third hiker on a triumphant peak.

Condition

Generated Video

Frame 0

Frame 80

Frame 156

In a single, unbroken shot, the camera starts with a head-on view of a yellow Le Mans prototype race car speeding down a winding, sunlit forest road. The camera tracks it smoothly, and as the car takes a corner, the lush green scenery is replaced by a stark, snow-covered woodland. Continuing to follow the car, the camera pans to a side-profile view, and as the car emerges from the snowy trees, its path opens directly onto a breathtaking coastal highway, with blue ocean waves crashing against the rocky shore.

Condition

Generated Video

Frame 0

Frame 76

A seamless, in-motion morph. A yellow VW van drives towards the camera, leaving a rocky path. As it transitions onto a paved forest road, its boxy frame fluidly reshapes, the yellow paint melting into vibrant red. The transformation completes as it speeds past, now a sleek Alfa Romeo.

Condition

Generated Video

Frame 0

Frame 76

A kangaroo takes a powerful leap. In a magical mid-air transformation, its form seamlessly morphs into a fluffy white golden retriever. As it descends, the dry field below simultaneously transforms into a lush green lawn, where the dog lands gracefully. A seamless, photorealistic evolution.

Condition

Generated Video

Frame 0

Frame 76

A seamless in-motion morph: A cheetah sprints across grass. Its spotted fur blurs, body reshapes, and legs extend into wheels. Mid-run, it transforms into a racing car, now parked in a stadium, with the savannah background dissolving into a racetrack.

Condition

Generated Video

Frame 0

Frame 76

A continuous shot follows a snipe as it takes flight from a shore. In mid-air, the bird and its natural surroundings seamlessly morph. The snipe transforms into a person on a motorcycle, while the coastline evolves into a quaint city street. The shot ends following the motorcycle. Photorealistic.

Condition

Generated Video

Frame 40

Frame 76

A seamless shot pushes forward into the bright halo of a lightbulb. The intense glow dissolves, acting as a transition. The camera emerges from this light into the darkness of a vast cave tunnel, revealing the brightly lit entrance far behind. Cinematic, photorealistic.

Condition

Generated Video

Frame 0

Frame 76

A continuous shot: An elderly man walks right past an old house. As he moves, the house dissolves, morphing into a modern café, and his form shifts to another walker.

Condition

Generated Video

Frame 40

A young couple is walking hand in hand along a dirt path in a natural, open area. They are dressed casually in denim jackets and jeans, with the woman wearing ripped jeans and the man in regular ones. A small dog is trotting beside them, occasionally looking up at the couple. The scene is set in a serene, slightly hilly landscape with sparse trees and dry grass, suggesting a late autumn or early winter setting. The main subjects are a young couple and their small dog. The couple is holding hands, walking side by side on the dirt path. The woman has long hair and wears a denim jacket and ripped jeans, while the man also wears a denim jacket and regular jeans. The dog is small, with light brown fur, and walks close to the couple, occasionally looking up at them. The couple and the dog maintain a close proximity throughout the video. The background features a natural, outdoor setting with a dirt path winding through a slightly hilly terrain. Sparse trees and dry grass dominate the landscape, indicating a late autumn or early winter season. The sky is overcast, providing soft, diffused lighting that enhances the calm and serene atmosphere of the scene.

## More Image-level Showcases

### Hover on the video to see corresponding text prompts

Condition

Generated Video

Frame 0

Frame 40

Frame 76

A lone tree stands on rocks. The camera zooms, branches glow, morphing to a burning object. Then, the object erupts, turning to a volcano. Seamless transitions.

Condition

Generated Video

Frame 0

Frame 40

Frame 76

A continuous tracking shot follows the jet trail. The camera drifts past, leaving the trail, and glides to the soaring eagle. Moving further, it exits the sky, revealing a white rabbit on green grass, each transition driven by smooth motion.

Condition

Generated Video

Frame 0

Frame 76

A seamless, single-shot camera push travels through a child's open closet. As the camera moves forward, the interior partitions dissolve, revealing a vast city street. The camera emerges into the bustling nightscape, the closet door now a fence overlooking the view.

Condition

Generated Video

Frame 0

Frame 76

The camera follows raindrops streaking down a windowpane. As they flow downwards, the drops converge and morph into a school of tiny, silver fish. The glass window dissolves into a clear, underwater stream, where the fish now swim among weeds. Magical, seamless.

Condition

Generated Video

Frame 0

Frame 76

a young child sitting in the shallow waters of a beach. The child is happily playing in the water, and the camera pans around to capture their joyful expression as they splash and play with the waves. There are droplets of water splashing around them, and the sunlight is reflecting off the water, creating a shimmering effect. In the background, there are rocks and the sea waves crashing, adding to the ambiance of the scene.

Condition

Generated Video

Frame 0

Frame 76

As the camera pans across the cozy interior space, it gradually zooms in on a warm and inviting coffee cup, sitting on a wooden table amidst the rustic ambiance. The amber-colored pendant lights above cast a soft glow, while the potted plants and textured walls create a serene and welcoming atmosphere. The camera's focus is now on the coffee cup, its contents steaming gently, as the natural light pours in from outside, adding to the cozy ambiance.

Condition

Generated Video

Frame 0

Frame 40

A zebra gallops across a green savanna. It leaps powerfully into the air, and in a magical mid-air transformation, its black and white stripes seamlessly morph into the vibrant, colorful patterns of a large, horse-shaped kite floating in a bright blue sky.

Condition

Generated Video

Frame 16

Frame 40

a white Tesla car accelerates, splashing water as it drives on the surface of a lake. The car is positioned near a shoreline with trees in the background, and the sky above is partly cloudy with the sun setting or rising, casting a golden hue on the scene. The camera follows the car as it gains speed, capturing the water splashing and the car's tires leaving a trail of ripples behind it.

Condition

Generated Video

Frame 0

a young woman with long brown hair, ruffled by the breeze, standing outdoors near a creek. She is holding a bunch of purple flowers, which are gently falling from her grasp, and wearing a dress adorned with floral patterns. The sunlight appears to be shining on her, casting a warm glow on her face and hair. The creek flows slowly in the background, creating a soothing and peaceful atmosphere.

Condition

Generated Video

Frame 40

three people glide down a snowy slope. The camera captures a bird's-eye view of the scene, showing the skiers' figures moving smoothly across the snow-covered terrain. The mountains rise up in the background, their peaks and ridges stretching upwards towards the sky. The skiers are wearing protective gear, including helmets and goggles, and are using ski poles to aid in their descent.

Condition

Generated Video

Frame 76

a person, possibly an astronaut, standing in front of a vibrant and colorful background. The background appears to be a representation of space, with stars, planets, and other celestial bodies. The astronaut is wearing a suit that seems to be technologically advanced, with various lights and details. The suit also appears to have a reflective surface, which is reflecting the colors of the background. As the camera zooms out, the astronaut begins to fly deep into the starry sky, the suit's reflective surface glistening as it moves further away from the colorful background.

## More Video-level Showcases

### Hover on the video to see corresponding text prompts

Video Inpainting

Source

Generated Video

On the left side of the rooftop, facing the camera, stands a tall cartoon bear with round golden fur and a small red shirt. The bear raises both hands high in surrender, eyes wide with comic fear, as the gunman aims at it. Its innocent and goofy expression adds absurd humor to the tense standoff.

Source

Generated Video

The hitman Léon walks purposefully down a narrow city street, carrying his case. In perfect step beside him, a large, fluffy cartoon bear walks with the same serious expression. The bear is carefully cradling a small green plant in a terracotta flowerpot, mirroring Léon's own famous plant, creating a surreal and heartwarming duo of two unlikely friends on a mission.
Video Outpainting

Source

Generated Video

A fantasy snow-covered landscape, majestic snowy mountains in the distance, swirling snowflakes, a silver-haired sorceress in a flowing white cloak holding a glowing staff, dramatic winter sky, ethereal atmosphere, cinematic wide shot.

Source

Generated Video

A desolate plain of cracked, black volcanic rock. In the background, a colossal dormant volcano looms under an apocalyptic orange sky. A surreal, fine ash falls like snow, while the ground is fractured with fissures of faintly glowing magma.
Video Transition

Source

Generated Video

A high-speed, first-person motorcycle POV. The camera rushes down a winding country road, capturing the pure sense of speed as the scenery blurs past. The shot is continuous and uninterrupted.

Source

Generated Video

A first-person shot ascends an escalator. At the top, the ceiling opens, revealing an arctic sky. The camera exits, now tracking a woman running across a desolate, snowy landscape.

Source

Generated Video

A low-angle tracking shot of a black Lamborghini speeding on a highway. In a seamless, in-motion morph, its angular body fluidly reshapes and recolors, transforming into a sleek, vibrant red Ferrari at high speed.

Source

Generated Video

Source

Generated Video

A continuous, high-speed drone shot chases a white off-road vehicle on a sunny dirt track. As it kicks up a thick cloud of dust, the vehicle's form seamlessly morphs within the dust cloud, transforming into a sleek leopard. The camera viewpoint then shifts, becoming a frantic, first-person view as the leopard sprints through a dense, dark jungle.

Source

Generated Video

A continuous shot from a drone flying to a butterfly.

## Comparisons

Condition

Generated Video

Frame 0

Frame 40

Frame 76

Replace.[1][2]

Channel.[3][4]

ICC(Ours)

Condition

Generated Video

Frame 0

Frame 40

Frame 76

Replace.[1][2]

Channel.[3][4]

ICC(Ours)

Condition

Generated Video

Frame 0

Frame 76

Replace.[1][2]

Channel.[3][4]

ICC(Ours)

Condition

Generated Video

Frame 0

Frame 76

Replace.[1][2]

Channel.[3][4]

ICC(Ours)

Condition

Generated Video

Frame 0

Frame 40

Frame 76

Replace.[1][2]

Channel.[3][4]

ICC(Ours)

Condition

Generated Video

Frame 0

Frame 40

Frame 76

Replace.[1][2]

Channel.[3][4]

ICC(Ours)

Condition

Generated Video

Frame 0

Frame 40

Replace.[1][2]

Channel.[3][4]

ICC(Ours)

Condition

Generated Video

Frame 0

Frame 76

Replace.[1][2]

Channel.[3][4]

ICC(Ours)

Condition

Generated Video

Start Video

End Video

Replace.[1][2]

Channel.[3][4]

ICC(Ours)

Source

Generated Video

Start Video

End Video

Replace.[1][2]

Channel.[3][4]

ICC(Ours)

## References

1. Yoav HaCohen, Nisan Chiprut, Benny Brazowski, Daniel Shalem, Dudu Moshe, Eitan Richardson, Eran Levin, Guy Shiran, Nir Zabari, Ori Gordon, et al. LTX-Video: Realtime Video Latent Diffusion. https://arxiv.org/abs/2501.00103
2. Weijie Kong, Qi Tian, Zijian Zhang, Rox Min, Zuozhuo Dai, Jin Zhou, Jiangfeng Xiong, Xin Li, Bo Wu, Jianwei Zhang, et al. HunyuanVideo: A Systematic Framework for Large Video Generative Models. https://arxiv.org/abs/2412.03603
3. Zhuoyi Yang, Jiayan Teng, Wendi Zheng, Ming Ding, Shiyu Huang, Jiazheng Xu, Yuanming Yang, Wenyi Hong, Xiaohan Zhang, Guanyu Feng, et al. CogVideoX: Text-to-Video Diffusion Models with an Expert Transformer. https://arxiv.org/abs/2408.06072
4. Ang Wang, Baole Ai, Bin Wen, Chaojie Mao, Chen-Wei Xie, Di Chen, Feiwu Yu, Haiming Zhao, Jianxiao Yang, Jianyuan Zeng, Jiayu Wang, et al. Wan: Open and Advanced Large-Scale Video Generative Models. https://arxiv.org/abs/2503.20314