CamI2V: Camera-Controlled Image-to-Video Diffusion Model

Due to the direct cross-frame interactions (epipolar attention or 3D full attention), CamI2V and 3D full attention succeed in panning right with a large camera movement, while CameraCtrl and MotionCtrl fail. However, we can see some blur or color shift in the left of the 3D full attention, this is because 3D full attention have access to all the noisy features (noisy condition) across frames, leading to incorrect absorbing in color. Epipolar only on reference frame (CamCo-like) also fails not only because the limited access to noisy condition (the newly appeared pixels have no intersections on the reference frame) but also too much copy of reference image leads to static scene.