Dear reader,

This supplementary material contains the code to reproduce first two columns of Figure 2 and it contains two Jupyter notebooks:

dTS-LL.ipynb
* dTS experiments on synthetic linear diffusion problems with linear rewards (first column in Figure 2)

dTS-LN.ipynb
* dTS experiments on synthetic linear diffusion problems with nonlinear rewards (second column in Figure 2)

We would be happy to share the notebooks to reproduce third and fourth columns of Figure 2 upon request during rebuttals.

Sincerely yours,

The authors
