Commit graph

21 commits

Author SHA1 Message Date
Zafir Stojanovski
6d9e14729a
fix rubiks cube prompt (#433) 2025-05-15 21:31:21 +01:00
joesharratt1229
d0ef136d5b
Feat/intragen experiments (#414)
* added curriculum

* readapted readme

* corrected small errors

* Delete eval/eval/r1/algorithmic/word_sorting.json

* removed redundant argument

* added spell

* removed duplicated fit

* changed config

* added composite changes

* added composite changes

* updated yaml

* added spell backward

* updated read me

* added qwen2.5

* added

* Add files via upload

* updated missing trainer func

* updated curr

* updated spell back

* updated correctness score func

* updated configs

* added local evals

* added updates

* updated datasets

* added fsdp to hf utility

* added algorithmic qwen 3b yaml

* updated read me

* updated configs

* added preappend token

* updated with thinking token

* updated test score board

* resolved comments

* added evaluation scripts

* removed results from pr

* added config

* added partial reward scoring

* added evaluation composites

* added training configs

* added games eval

* added rubriks cube

* resolved merge cinflicts

* added games config

* added latest eval configs

* updated strucutre

* Delete training/evaluations/eval_graphs_composite.yaml

---------

Co-authored-by: joesharratt1229 <joesharrat1229@gmail.com>
2025-04-16 08:04:52 +02:00
Zafir Stojanovski
290bfc4fdd
(evals): Medium configs (#415)
* updated medium configs

* fix problematic curriculum values / small issues causing exceptions to be raised

* optimus alpha config

* all configs so far

* fix tests
2025-04-14 08:25:31 +02:00
Zafir Stojanovski
dced3bfc45
fix(curriculum): Make boundaries in curriculum more sensible (#407)
* init

* fix tests

* unify codeio

* filtered for libraries not present in reasoning-gym

* fix more bounds

* puzzle24

* knight swap curriculum

* fix number sorting

* fix attributes

* add validation of config in creation of dataset

* dry run for instantiating and validating the datasets

* remove unused imports

* fix curriculum tests to reference newly updated attribute names
2025-04-04 20:24:14 +02:00
Zafir Stojanovski
ce0a6c4878
fix(envs): Add source dataset and index to metadata (#388)
* add source dataset and index to metadata

* fix typo

* fix coach class and its test
2025-03-20 11:12:14 +00:00
Oliver Stanley
7475a20700
include ranges rather than sampled values in difficulty metadata dicts (#387)
* update difficulty metadata for logic datasets

* update difficulty metadata for graph datasets

* update difficulty metadata for geometry datasets

* update difficulty metadata for games datasets

* update difficulty metadata for cognition datasets

* update difficulty metadata for arithmetic datasets

* update difficulty metadata for arc datasets

* update difficulty metadata for algorithmic datasets

* update difficulty metadata for algebra datasets

* use tuples

* update tests

* update tests
2025-03-20 10:27:03 +01:00
Andreas Köpf
d2c895f1d3
Refactor Curriculum Attributes (#335)
* remove min_value from AttributeDefinition
* remove type from AttributeDefinition
* Add CurriculumContext
* add ensure_interval option for RangeAttributes
* docs: Add legend explaining curriculum indicators in dataset gallery
* update GALLERY.md
2025-03-16 15:40:28 +01:00
Zafir Stojanovski
099ea88402
feat(env): Rubiks Cube Curriculum (#357) 2025-03-13 21:12:32 +01:00
Rich Jones
633a1aa1ba expand more 2025-02-27 10:41:30 +01:00
Rich Jones
f0ca949aaf support expanded notation anyway 2025-02-26 13:17:03 +01:00
Rich Jones
285e2b20cc rubiks cube instructions 2025-02-26 13:07:17 +01:00
Andreas Koepf
3e7ff3b084 use native types List->list, Dict->dict, Set->set, Tuple->tuple 2025-02-21 15:15:38 +01:00
Andreas Koepf
5b35ea51a7 fix chain_sum unit test 2025-01-30 10:57:55 +01:00
Andreas Koepf
a6bf23e655 catch exception in RubiksCube score_answer 2025-01-30 10:25:04 +01:00
Andreas Koepf
fc775eda7e lint, seed & size for figlet 2025-01-30 00:58:34 +01:00
Andreas Koepf
25505e3a75 add seed & size params to RubicsCubeConfig 2025-01-30 00:49:41 +01:00
Andreas Koepf
2653a28903 make sure rubiks cube is scrambled deterministically based on seed+idx 2025-01-30 00:36:34 +01:00
Rich Jones
74dcd57235 lint 2025-01-29 16:09:39 +01:00
Rich Jones
cc69d90a4f cleanup 2025-01-29 16:07:27 +01:00
Rich Jones
ebcd6d5e43 dont use that cubestring 2025-01-29 16:05:41 +01:00
Rich Jones
0d67fc102b inital stab at rubikscube 2025-01-29 15:53:29 +01:00