mirror of
https://github.com/open-thought/reasoning-gym.git
synced 2026-04-27 17:23:19 +00:00
51c2afc1fc
* updated verl ex * updated script * removed curriculum verl and updated * updatied linting errors * renamed * updated config |
||
|---|---|---|
| .. | ||
| multi_env | ||
| .gitignore | ||
| README.md | ||
env setup
conda create --name verl python=3.11 -y
conda activate verl
pip install flash-attn --no-build-isolation
pip install ray wandb
# pip3 install vllm==0.7.0
pip3 install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
Regarding vllm>0.7 see: docs
clone and install veRL
tested with verl HEAD c34206925e2a50fd452e474db857b4d488f8602d
git clone https://github.com/volcengine/verl.git
cd verl
pip install -e .
Optionally log in to huggingface hub and wandb with your keys:
huggingface-cli login
wandb login