### Libraries

Here we store external libraries that we use in our project. We might make changes to them, so we custom install it via `pip install -e .` from the root directory.


# NOTE: 

Current VeRL library won't run inside the conda environment described in README.md for our repository. There seems to library version conflicts among the dependencies of TRL and VeRL. 