DPO: lr=0.001
ZSPO: mu=0.5, lr=0.05
ZPG: mu=0.5, lr=0.02
ES: mu=0.5