open-thought/reasoning-gym
1
0
Fork 0
mirror of https://github.com/open-thought/reasoning-gym.git synced 2026-04-19 12:58:07 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

added r1 evaluation logic

Browse source
This commit is contained in:
joesharratt1229 2025-02-11 03:46:56 +00:00
parent 03f87dbc07
commit a3ea4449d1
6 changed files with 208 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

11
eval/r1/yaml/logic.yaml Normal file
View file

@ -0,0 +1,11 @@
model: deepseek/deepseek-r1
category: logic
datasets:
- propositional_logic
- self_reference
- syllogism
- zebra_puzzles
eval_dir: eval/r1
dataset_size: 50
dataset_seed: 42
developer_role: system