# Bayes Adaptive Monte Carlo Tree Search for Offline Model-based Reinforcement Learning

- Please download the dynamics/reward models and hyperparameter files from [data](https://drive.google.com/drive/folders/1o7CHVK0kDTpgkjscPpEkSi23sXxMSC7I?usp=sharing) to the folder 'data'.

- The raw data corresponding to the performance of BA-MCTS in Table 11 (which are labeled with *) is stored in the file 'calculator.py'. To reproduce the statistics, please run:
    ```bash
    python calculator.py
    ```

- The raw data can be generated by running:
    ```bash
    python run_bambrl.py
    ```
    - Please change the variable "load_path_id" in Line 327 of the file 'run_bambrl.py' to train a policy for a specific env under a certain random seed.