## Plot generation
To generate all plots run `python make_plots.py`. All experimental data is found in `exp_data/`. Models will be released as public artifacts but are omitted. 

## Training
Training targets the open_lm repo (https://github.com/mlfoundations/open_lm), with a wrapper included in this supplement `overtraining/training`.

## Evaluation
Evaluation targets LLM-Foundry (https://github.com/mosaicml/llm-foundry) using a wapper in open_lm (https://github.com/mlfoundations/open_lm).

## License
MIT license. See `LICENSE`