# Main Results

## Pre-trained Models

All checkpoints can be found here. Place folders under `outputs/`.

## Commands

The following make command runs all the main results described in our reproducibility report.

    make cifar10 DENSITY=0.05,0.1,0.2,0.5
    make cifar100 DENSITY=0.05,0.1,0.2,0.5
    make cifar10_tune DENSITY=0.05,0.1,0.2,0.5

Use the `-n` flag to see which commands are executed. Note that these runs are executed sequentially, although we include parallel processes for cifar10 runs of a particular method. Eg: `cifar10.Random.RigL` runs RigL Random for densities `0.05,0.1,0.2,0.5`, `seed=0` in parallel.

It may be preferable to run specific make commands in parallel for this reason. See make help for an exhaustive list.

## Table of Results

Shown for 80% sparsity (20% density) on CIFAR10. For exhaustive results and their analysis refer to our report.

Method | Accuracy (Test) | FLOPS (Train, Test)
--- | --- | ---
Small Dense | 91.0 ± 0.07 | 0.20x, 0.20x
Static | 91.2 ± 0.16 | 0.20x, 0.20x
SET | 92.7 ± 0.28 | 0.20x, 0.20x
RigL | 92.6 ± 0.10 | 0.20x, 0.20x
SET (ERK) | 92.9 ± 0.16 | 0.35x, 0.35x
RigL (ERK) | 93.1 ± 0.09 | 0.35x, 0.35x
Pruning | 93.2 ± 0.27 | 0.41x, 0.27x
RigL_2x | 93.0 ± 0.21 | 0.41x, 0.20x
RigL_2x (ERK) | 93.3 ± 0.09 | 0.70x, 0.35x