Please follow below instructions to reproduce our experimental results.

To obtain regret results:
Experiment 1: run UCBVI_CUCBVI.py
Experiment 2: run UCBVI_CUCBVI_m.py
Experiment 3: run three_algo_d.py

To obtain regret plots for all experiments as our paper:
Run plotting.py