mirror of
https://github.com/open-thought/reasoning-gym.git
synced 2026-04-19 12:58:07 +00:00
32 lines
625 B
Markdown
32 lines
625 B
Markdown
### env setup
|
|
|
|
```
|
|
conda create --name verl python=3.11 -y
|
|
conda activate verl
|
|
|
|
pip install flash-attn --no-build-isolation
|
|
pip install ray wandb
|
|
# pip3 install vllm==0.7.0
|
|
pip3 install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
|
|
```
|
|
|
|
Regarding vllm>0.7 see: [docs](https://verl.readthedocs.io/en/latest/README_vllm0.7.html)
|
|
|
|
|
|
### clone and install veRL
|
|
|
|
tested with verl HEAD 0dfcb7f99e299940e1792a386df13c7591df351a
|
|
|
|
```
|
|
git clone https://github.com/volcengine/verl.git
|
|
cd verl
|
|
pip install -e .
|
|
```
|
|
|
|
|
|
Optionally log in to huggingface hub and wandb with your keys:
|
|
|
|
```
|
|
huggingface-cli login
|
|
wandb login
|
|
```
|