# BOFormer

### Env installation 
```
conda create -n seq_qt python=3.9.7
conda activate seq_qt
conda install git pip
pip install platypus-opt
pip install git+https://github.com/naught101/sobol_seq@v0.2.0#egg=sobol_seq
pip install pymoo~=0.5.0
conda install -c anaconda scikit-learn
conda install ffmpeg
pip install --upgrade setuptools
conda install torchvision torchaudio pytorch-cuda=12.1 -c pytorch -c nvidia
conda install torchvision torchaudio pytorch-cuda=11.8 -c pytorch -c nvidia
conda install transformers
conda install tensorboard
conda install jupyter
conda install botorch -c pytorch -c gpytorch -c conda-forge
pip install sentencepiece
pip install yahpo_gym
torch.cuda.is_available() 不知道為啥都會裝到CPU版本的torch
conda uninstall pytorch
uninstall pytorch 再裝一次

```
### Usage
```
python Q_value_Transformer/q_value_transformer.py # Traning
python Q_value_Transformer/q_value_transformer_testing_offpolicy.py # Testing
# Use data.ipynb to see the result
```


### optformer

pip install sentencepiece
