transformers
sentencepiece
datasets
faiss-gpu
tensorboard
deepspeed==0.6.5
tqdm==4.62.1
torch==1.10.0