open-thought/reasoning-gym
1
0
Fork 0
mirror of https://github.com/open-thought/reasoning-gym.git synced 2026-04-22 16:49:06 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
1226 commits 21 branches 5 tags 37 MiB
Commit graph

4 commits

Author SHA1 Message Date
Andreas Köpf
677a2af03e Add eval configs, small fixes to eval script & rush-hour score_answer 2025-03-16 09:18:05 +01:00
Andreas Köpf
424ee6751a Eval N completions per prompt (#374) 
* feat: Add support for generating multiple completions per prompt
* feat: Track best and mean scores for multiple completions per prompt
* feat: Add checkpoint and resume functionality to evaluation script
 2025-03-15 16:39:36 +01:00
Andreas Koepf
1d813c9acd update eval yaml config files 2025-03-10 00:48:32 +01:00
Andreas Köpf
0b108efac1 Generate eval config tool (#240) 
* feat: Add generate_config.py script to create eval  configurations
 2025-02-27 21:40:53 +01:00