## LinBERT

Run following commands:
```(bash)
docker build -t linbert .
docker run --gpus=all -v path_to_lin_bert/LinBERT/data:/LinBERT/data -v path_to_lin_bert/LinBERT/wandb:/LinBERT/wandb -i -t linbert
```
To download MNIST run:
```(nash)
bash scripts/download_mnist.sh
```
To start training, run script `train.py`. Params can be found in `.yaml` files in `sweeps` dir. For instance to run LinBERT on MNIST with FastRPB run:
```(bash)
CUDA_VISIBLE_DEVICES=0 python train.py --dataset=mnist --is_linear --pos_bias_type=fft_2d --bias_base_type=full --x_shape=28 --y_shape=28
``` 
