To run the experiments, simply use runscript.sh that calls runfile.py.
Use the Movielens_plot.ipynb notebook to generate the plots. 
Use Movielens_plot_instance.ipynb to vizualize the instances under different visible contexts.

To regenerate the reward data from scratch, download the Movielens 1M dataset into the Dataset folder and run Movielens_data_fill.ipynb to generate the new reward statistics.