# Value Memory Graph: A Graph-Structured World Model for Offline Reinforcement Learning
Code for ICLR submission. For review only. Not final releasing version.

## Install the Environment
Please run the following commands to install the environment via conda.

```
conda create -n vmg python=3.9
conda activate vmg
conda install pytorch torchvision torchaudio cudatoolkit=11.3 -c pytorch
conda install pytorch-scatter -c pyg

conda install -c conda-forge mesalib
conda install -c conda-forge patchelf

pip install -r requirement.txt
```

## Usage
To train a model, run
```
python main.py --dataset dataset-you-want --gpu desired-gpu-idx
```

For evaluation, run
```
python eval_script/eval_policy.py  --model_path /path/to/model --dataset dataset-you-want --ckpt checkpoint-you-want --gpu desired-gpu-idx --other-hyperparameters-setting
```




