we have modified the lmms-eval package to support STAVEQ2.
first install the lmms-eval package:

$ cd lmms-eval && pip install -e .

for running Qwen2-VL and STAVEQ2 benchmarks, install:

$ pip install transformers==4.46.1

for running Qwen2.5-VL install:

$ pip install transformers==4.51.3

then run the scripts.