open-thought/reasoning-gym
1
0
Fork 0
mirror of https://github.com/open-thought/reasoning-gym.git synced 2026-04-19 12:58:07 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
reasoning-gym/examples/veRL
History
Andreas Koepf 8202f234be reduce veRL example size
2025-02-01 23:56:11 +00:00
..
config first bits of veRL example 2025-02-01 21:20:36 +00:00
.gitignore first bits of veRL example 2025-02-01 21:20:36 +00:00
launch_on_4gpu.sh first bits of veRL example 2025-02-01 21:20:36 +00:00
main_ppo_custom_reward.py reduce veRL example size 2025-02-01 23:56:11 +00:00
README.md add deps for veRL experiment in README 2025-02-01 21:27:33 +00:00
train.sh first bits of veRL example 2025-02-01 21:20:36 +00:00

README.md

env setup

conda create --name verl python=3.12 -y
conda activate verl

pip install flash-attn --no-build-isolation
pip install vllm==0.7.0 ray wandb

clone and install veRL

tested with verl HEAD a65c9157bc0b85b64cd753de19f94e80a11bd871

git clone https://github.com/volcengine/verl.git
cd verl
pip install -e .