theblackcat102
235b5629f7
Fix/cryptarithm multiple solutions ( #517 )
...
* [fix] issue #516 of `cryptarithm` validation issue
---------
Co-authored-by: Andreas Koepf <andreas.koepf@provisio.com>
2026-03-15 13:53:26 +01:00
SII-Whereby
7d68a6cc70
Fix(reasoning_gym/games/countdown): Resolve SymPy parsing conflict for 10+ input numbers ( #514 )
...
* Refactor expression generation and substitution logic
Updated symbol naming and added safe replacement for expressions.
* Add expr_str to return values in countdown.py
Modified return statement to include the modified expression string.
* Implement test for min_numbers exceeding 10
Add test for CountdownDataset with more than 10 numbers
* Remove trailing-whitespace
* Improve readability of CountdownDataset initialization
Refactor CountdownDataset initialization for readability.
2025-12-15 11:05:38 +00:00
Kumar Anant
b0815043a2
Add probability dataset (initial: Coin Flip dataset + curriculum) ( #505 )
2025-09-06 15:59:23 +01:00
Zafir Stojanovski
a969d8ef05
feat(curriculum): Knights and Knaves configs ( #488 )
...
* configs
* reduce complexity of curriculum
* update lower bound
* add failure threshold
* update last_k
* update thresholds for success and failure
* update curriculum file as well
* update run name for noncurriculum
* lint
* dtype model eval
* return binary scoring
* set eval repeats to 3
* fix tests
2025-07-31 10:18:05 +02:00
joesharratt1229
4b60c32978
Curr exp ( #487 )
...
* began curr exp
* added holdout words
* updated config
* added context
* updated base curriculum
* updaed
* updated curriculum
* updated
* updated
* updated automatic flag
* updated ray trainer
* update
2025-07-25 20:38:47 +01:00
theblackcat102
2d19f13e0f
[ fix #484 ] resolve basic_arithmetic fails when size is large ( #485 )
...
* [fix] resolve basic_arithmetic fails when size is large by replacing zero divisor with 1
2025-07-07 09:46:23 +01:00
joesharratt1229
876e0aa440
corrected countdown issue ( #479 )
2025-06-25 13:37:04 -07:00
Adefioye
9e79fc84b6
fix: Rounding issues in score_answer and add unit tests ( #462 )
2025-06-09 19:18:11 +01:00
Oliver Stanley
602e4be0a2
add survo env ( #461 )
...
* add survo env
* add survo curriculum
* add survo tests
2025-06-08 11:56:33 +01:00
Oliver Stanley
c2fdb11980
add kakurasu env ( #460 )
...
* add kakurasu env
* add kakurasu curriculum
* add kakurasu tests
2025-06-08 09:20:53 +01:00
Adefioye
9053009dbe
Fix bug in normalize_answer method ( #444 )
2025-06-02 08:58:54 +02:00
Oliver Stanley
c0e98f93b4
make task entries json serializable ( #443 )
...
* make sympy-based task entries json serializable
* remove datetime objs from time_intervals metadata
* make adv geometry json serializable
* make futoshiki metadata json serializable
* fixes
* futoshiki tweaks
* fix adv geometry
* deal with fractions in str representations
* fix
* restore start_time, end_time as str
2025-06-02 08:57:15 +02:00
Oliver Stanley
3df26e0fb2
fix decimal arithmetic curriculum to respect constraints ( #430 )
...
* fix decimal arithmetic curriculum to respect constraints
* update test accordingly
2025-05-06 19:23:19 +01:00
rasdani
72e45e9401
Feat: expose score_answer function without needing to instantiate a dataset ( #422 )
...
* feat: get `score_answer` for a given dataset
* fix: `self` error
* add test
2025-04-18 10:36:44 +02:00
joesharratt1229
d0ef136d5b
Feat/intragen experiments ( #414 )
...
* added curriculum
* readapted readme
* corrected small errors
* Delete eval/eval/r1/algorithmic/word_sorting.json
* removed redundant argument
* added spell
* removed duplicated fit
* changed config
* added composite changes
* added composite changes
* updated yaml
* added spell backward
* updated read me
* added qwen2.5
* added
* Add files via upload
* updated missing trainer func
* updated curr
* updated spell back
* updated correctness score func
* updated configs
* added local evals
* added updates
* updated datasets
* added fsdp to hf utility
* added algorithmic qwen 3b yaml
* updated read me
* updated configs
* added preappend token
* updated with thinking token
* updated test score board
* resolved comments
* added evaluation scripts
* removed results from pr
* added config
* added partial reward scoring
* added evaluation composites
* added training configs
* added games eval
* added rubriks cube
* resolved merge cinflicts
* added games config
* added latest eval configs
* updated strucutre
* Delete training/evaluations/eval_graphs_composite.yaml
---------
Co-authored-by: joesharratt1229 <joesharrat1229@gmail.com>
2025-04-16 08:04:52 +02:00
Zafir Stojanovski
290bfc4fdd
(evals): Medium configs ( #415 )
...
* updated medium configs
* fix problematic curriculum values / small issues causing exceptions to be raised
* optimus alpha config
* all configs so far
* fix tests
2025-04-14 08:25:31 +02:00
Zafir Stojanovski
dced3bfc45
fix(curriculum): Make boundaries in curriculum more sensible ( #407 )
...
* init
* fix tests
* unify codeio
* filtered for libraries not present in reasoning-gym
* fix more bounds
* puzzle24
* knight swap curriculum
* fix number sorting
* fix attributes
* add validation of config in creation of dataset
* dry run for instantiating and validating the datasets
* remove unused imports
* fix curriculum tests to reference newly updated attribute names
2025-04-04 20:24:14 +02:00
Zafir Stojanovski
dafdee621e
fix(env): Unify CodeIO datasets ( #405 )
...
* unify codeio
* filtered for libraries not present in reasoning-gym
2025-04-02 22:40:03 +02:00
joesharratt1229
43c739cb3e
Feat/curr adj ( #394 )
2025-04-02 06:39:14 +01:00
Adefioye
e3af2dd2bd
Add curriculum for arc_agi ( #372 )
...
* Add curriculum for arc_agi
* Resolve conflicts
* Remove code smell
* Remove unwanted code
2025-04-01 21:17:52 +02:00
Zafir Stojanovski
50846c3534
fix(env): ARC 1D curriculum ( #402 )
...
* Add arc_1d curriculum
* Add difficulty to metadata
* use range attribute instead of scalar
---------
Co-authored-by: abdulhakeem <abdulhakeemadefioye@gmail.com>
Co-authored-by: Oliver Stanley <olivergestanley@gmail.com>
2025-04-01 13:01:15 +02:00
vncntt
cd85c2d632
add knights knaves curriculum ( #401 )
...
* add knights knaves curriculum
* add metadata + width constraints
2025-04-01 12:20:58 +02:00
Zafir Stojanovski
2a970390e8
remove coach and update tests ( #393 )
2025-03-24 00:10:01 +01:00
Zafir Stojanovski
ce0a6c4878
fix(envs): Add source dataset and index to metadata ( #388 )
...
* add source dataset and index to metadata
* fix typo
* fix coach class and its test
2025-03-20 11:12:14 +00:00
Oliver Stanley
7475a20700
include ranges rather than sampled values in difficulty metadata dicts ( #387 )
...
* update difficulty metadata for logic datasets
* update difficulty metadata for graph datasets
* update difficulty metadata for geometry datasets
* update difficulty metadata for games datasets
* update difficulty metadata for cognition datasets
* update difficulty metadata for arithmetic datasets
* update difficulty metadata for arc datasets
* update difficulty metadata for algorithmic datasets
* update difficulty metadata for algebra datasets
* use tuples
* update tests
* update tests
2025-03-20 10:27:03 +01:00
Zafir Stojanovski
29bf78293f
figlet font curriculum
2025-03-18 13:51:43 +01:00
Jean Kaddour
d6aad5a329
fix: add score_answer() to number_sorting ( #380 )
...
* fix: add score_answer() to number_sorting
* chore: run pre-commit
* fix: use json.loads()
* fix: run isort()
2025-03-17 23:04:13 +01:00
Andreas Koepf
c760da6b1b
adapt needle_haystack test to curriculum changes
2025-03-16 17:35:16 +01:00
Andreas Köpf
d2c895f1d3
Refactor Curriculum Attributes ( #335 )
...
* remove min_value from AttributeDefinition
* remove type from AttributeDefinition
* Add CurriculumContext
* add ensure_interval option for RangeAttributes
* docs: Add legend explaining curriculum indicators in dataset gallery
* update GALLERY.md
2025-03-16 15:40:28 +01:00
Andreas Köpf
d6f399b8e4
Add eval configs, small fixes to eval script & rush-hour score_answer
2025-03-16 09:18:05 +01:00
Adefioye
8a0cacc054
Add jugs curriculum ( #369 )
2025-03-14 18:04:33 +01:00
Zafir Stojanovski
f72ecaf411
circuit logic curriculum ( #368 )
2025-03-14 16:17:00 +01:00
Rich Jones
e7d05d6510
GoL-Halt Curricula ( #366 )
...
* GoL-Halt Curricula
* trivial
2025-03-14 16:15:45 +01:00
Zafir Stojanovski
d33c667c3d
feat(env): Propositional Logic Curriculum ( #365 )
...
* propositional logic curriculum
* lint
* difficulty meta
2025-03-14 16:12:39 +01:00
Zafir Stojanovski
41f3ef876c
time intervals curriculum ( #363 )
2025-03-14 16:11:55 +01:00
Oliver Stanley
a71994ad03
add rush hour curriculum ( #362 )
...
* add rush hour curriculum
* add to __init__.py
2025-03-14 16:11:23 +01:00
Oliver Stanley
b5651e5e2c
add word ladder curriculum ( #361 )
...
* add word ladder curriculum
* add to __init__.py
2025-03-14 16:10:52 +01:00
Oliver Stanley
8f8bd9d756
add sudoku curriculum ( #360 )
...
* sudoku curriculum
* add test
* add to __init__.py
2025-03-14 16:09:49 +01:00
joesharratt1229
80ac138455
added family relatinship curriculum ( #359 )
2025-03-14 16:08:49 +01:00
joesharratt1229
fa7d8e66b3
added boxnet generator and curr ( #364 )
2025-03-14 08:48:57 +01:00
Adefioye
5bfe730c3b
Simple equations curriculum ( #340 )
...
* Add curriculum to simple_equations and unit tests
* Add difficulty to metadata
2025-03-13 21:17:14 +01:00
joesharratt1229
6354ca5d35
added rearc curr ( #358 )
2025-03-13 21:14:03 +01:00
Zafir Stojanovski
099ea88402
feat(env): Rubiks Cube Curriculum ( #357 )
2025-03-13 21:12:32 +01:00
joesharratt1229
d603d8b72b
added aiw curric ( #356 )
...
added metadata
2025-03-13 21:10:52 +01:00
Zafir Stojanovski
93793f5416
feat(env): Needle in Haystack Curriculum ( #355 )
...
* needle haystack curriculum
2025-03-13 21:09:45 +01:00
Adefioye
adea7a255e
Add gol curriculum ( #354 )
...
* Add gol curriculum
* Add difficulty
* Make levels of grid size of x and y be valid
2025-03-13 21:09:09 +01:00
Zafir Stojanovski
fa2b04f4de
feat(env): Advanced Geometry Curriculum ( #350 )
...
* advanced geometry curriculum
* metadata
---------
Co-authored-by: Andreas Köpf <andreas.koepf@xamla.com>
2025-03-13 21:07:49 +01:00
Zafir Stojanovski
ee001f38a4
fraction simplification curriculum ( #349 )
2025-03-13 21:05:50 +01:00
Zafir Stojanovski
db3868150f
lcm curriculum ( #348 )
2025-03-13 21:05:06 +01:00
Zafir Stojanovski
9fcc277101
color cube rotation curriculum ( #347 )
2025-03-13 21:04:34 +01:00
