
## Reproducibility Challenge (RC2021 spring): AdaBelief Optimizer

The following repository contains code for the experiments we reporoduced in the [AdaBelief paper](https://juntang-zhuang.github.io/adabelief/) as part of [ML Reproducibility Challenge Spring 2021]([https://paperswithcode.com/rc2020](https://paperswithcode.com/rc2020)). The paper was one of the spotlight papers at NeurIPS 2020.

### How to Run
Create a conda environment from `adabelief.yml` as follows:
```
conda env create -f adabelief.yml
```
Unless stated otherwise, activate and use this environment and follow the instructions mentioned in subdirectories.

### Acknowledgment
We make use of  [official repository](https://github.com/juntang-zhuang/Adabelief-Optimizer), [SN-GAN repository](https://github.com/juntang-zhuang/SNGAN-AdaBelief),  [RL toy repository]( https://github.com/juntang-zhuang/rainbow-adabelief) provided by the author. We would also like to thank the authors for their invaluable inputs that help us reproduce the experiments.

### Summary of experiment performed

![experiment_performed](imgs/contribution_summary.png)

### Hyperparameter values

![hyperparameters](imgs/HP_values.png)

