# Numeric LMs analyses

This repository contains scripts necessary to reproduce the probing analyses in our paper.

Each of the attached notebooks should be runnable with intentionally minimal dependencies: `pip install torch transformers`. Note that an access to some of the models requireusing and setting your personal HF token: `export HF_TOKEN=XXX`.
If you encounter problems with dependencies, we recommend using the attached pyproject.toml or poetry.lock, e.g. as:

```shell
conda create -n numllama python=3.12
conda activate numllama
pip install poetry
poetry install
```

Names of the notebooks should correspond to the titles of our experiments.

The attached code bases will be made public and incorporated into a larger repository, and referenced from the paper upon the acceptance

