
## Installation

```
conda create -n real_dpo python=3.10

pip install torch==2.5.1 torchvision==0.20.1 torchaudio==2.5.1 --index-url https://download.pytorch.org/whl/cu118

pip install -r requirements.txt
```

## Training
```
cd finetune
sh train_zero_i2v_real_dpo.sh
```

## Infer


```bash
sh scripts/i2v_reject_sampling
#pipe.transformer.load_state_dict(torch.load("../output/real_dpo/mp_rank_00_model_states.pt",map_location='cpu')['module'])
sh scripts/i2v_val_sampling.py
```

