Commit graph

240 commits

Author SHA1 Message Date
Zafir Stojanovski
ede43c58ba number filtering curriculum (#333) 2025-03-11 23:56:06 +01:00
Zafir Stojanovski
b926800267 spell backward curriculum (#327)
Co-authored-by: Andreas Köpf <andreas.koepf@xamla.com>
2025-03-11 00:22:28 +01:00
Zafir Stojanovski
2cd2ec3dec sentence reordering curriculum (#326) 2025-03-11 00:21:41 +01:00
Zafir Stojanovski
5cd4c57823 palindrome generation curriculum (#322) 2025-03-11 00:19:11 +01:00
Zafir Stojanovski
f9fa667d82 feat(env): Number Sorting Curriculum (#321)
* number sorting curriculum

* metadata
2025-03-11 00:18:20 +01:00
Zafir Stojanovski
80d74d96fb feat(env): Letter Jumble Curriculum (#319)
* base curriculum

* tests
2025-03-11 00:16:05 +01:00
Rich Jones
a49ed1342f Correct Graph Coloring Difficulty (#318)
* correct gcolor difficulty

* refactor test
2025-03-11 00:14:38 +01:00
Rich Jones
da309310e5 Fix GoL-Halt Determinism (#317)
* test alt case

* fix determinism of gol-halt
2025-03-11 00:13:40 +01:00
Andreas Koepf
cd634a3755 use file stem name of palindrome_generation dataset 2025-03-10 00:39:29 +01:00
Zafir Stojanovski
9bd4f03dbd feat(env): String Synthesis Curriculum (#308)
* string synthesis curriculum

* difficulty metadata
2025-03-10 00:27:03 +01:00
Zafir Stojanovski
01f69e06c2 string splitting curriculum (#307) 2025-03-10 00:25:56 +01:00
Zafir Stojanovski
04f0f7deb7 letter counting curriculum (#312) 2025-03-10 00:24:42 +01:00
Zafir Stojanovski
6aa7547abd feat(env): Word Sequence Reversal curriculum (#313)
* word sequence reversal curriculum

* metadata
2025-03-10 00:24:05 +01:00
Zafir Stojanovski
7c7c783883 string manipulation curriculum (#306) 2025-03-09 18:12:35 +01:00
Zafir Stojanovski
e1e05884ee string insertion curriculum (#305) 2025-03-09 18:11:29 +01:00
vncntt
91aa3f3ae2 add metadata for caesar cipher, graph coloring, decimal arithmetic (#304)
* add metadata for caesar cipher, graph coloring, decimal arithmetic

* delete comma

* clean up variables
2025-03-09 18:08:56 +01:00
vncntt
1f360917fc Caesar cipher curriculum (#302)
* caesar cipher curriculum + tests
2025-03-09 08:23:32 +01:00
vncntt
2bcc06717c graph color curriculum (#303) 2025-03-09 08:20:47 +01:00
Zafir Stojanovski
b58371c533 ransom note curriculum (#300)
Co-authored-by: Andreas Köpf <andreas.koepf@xamla.com>
2025-03-08 21:00:13 +01:00
Zafir Stojanovski
501f2d8322 palindrome partitioning curriculum (#299)
Co-authored-by: Andreas Köpf <andreas.koepf@xamla.com>
2025-03-08 20:58:59 +01:00
Zafir Stojanovski
9f57132c2c pool matrix curriculum (#298) 2025-03-08 20:57:22 +01:00
Zafir Stojanovski
cbd223d7ca rotten oranges curriculum (#297) 2025-03-08 20:56:46 +01:00
Zafir Stojanovski
e4e516a949 spiral matrix curriculum (#296) 2025-03-08 20:56:08 +01:00
Andreas Köpf
d82c73b6f8 Show curricula (#295)
* feat: Add debug_curricula.py script to generate CURRICULA.md with dataset curriculum details
2025-03-08 14:21:50 +01:00
Zafir Stojanovski
9525f2588b rotate matrix curriculum (#294) 2025-03-08 01:58:54 +01:00
Zafir Stojanovski
f8d4914cf5 manipulate matrix curriculum (#293) 2025-03-08 01:57:37 +01:00
Zafir Stojanovski
03ce955eab feat(env): Isomorphic Strings Curriculum (#292)
* isomorphic strings curriculum

---------

Co-authored-by: Andreas Köpf <andreas.koepf@xamla.com>
2025-03-08 01:56:14 +01:00
joesharratt1229
88a3d065bd added word sort curriculum (#289) 2025-03-08 01:50:13 +01:00
Zafir Stojanovski
e8601a63b4 feat(env): Group Anagrams Curriculum (#288)
* group anagrams curriculum
2025-03-08 01:49:12 +01:00
Zafir Stojanovski
07eb434d61 feat(env): Count Primes Curriculum (#287)
* count primes curriculum
2025-03-08 01:48:00 +01:00
Zafir Stojanovski
488b72f6f1 base conversion curriculum (#286) 2025-03-08 01:46:32 +01:00
Zafir Stojanovski
dc657b5ed4 feat(env): Binary Matrix Curriculum (#279)
* binary matrix curriculum

* register BinaryMatrixCurriculum

---------

Co-authored-by: Andreas Koepf <andreas.koepf@provisio.com>
2025-03-07 22:58:47 +01:00
Zafir Stojanovski
dfc28c94d6 feat(env): Binary Alternation Curriculum (#278)
* binary alternation

---------

Co-authored-by: Andreas Koepf <andreas.koepf@provisio.com>
2025-03-07 22:44:32 +01:00
Andreas Koepf
2b1f7ce5ee use relative import for reasoning_gym.data 2025-03-07 15:56:45 +01:00
Rich Jones
11c9790a25 [Env] Game of Life Halting Prediction (#272)
This is a variant of the Game of Life task, which rather than trying to test the algorithmic simulation, tests the ability of the model to do explanatory reasoning of the board. The idea is that a model with good explanatory reasoning will be able to see that a game will not halt without simulating it into the future.

The task presents a GoL board, and the model is asked to predict if the board will halt (die, all cells zero) after n steps. Sometimes, the board will be made up of 'oscillators', isolated structures which never die. Othertimes, it is filled with non-oscillators, structures which will always die after a few steps. The model should deduce which case the presented board is.
2025-03-07 10:05:12 +01:00
joesharratt1229
1893691c57 updated algorithmics dataset (#269)
* updated algorithmic datasets
* added changes to symbolic and power
* updated power function test
2025-03-05 23:32:53 +01:00
Andreas Köpf
b2904ccab9 Minor question template & score_answer improvements (#261)
* math prompt improvements
* ignore brackets in complex_arithmetic results
* improve additional instruction in prompt of polynomial_equations
* more strict tests for score_answer in polynomial_equations
* simplify special reward handling
* fix test_intermediate_integration
* fix sokoban dataset
* add common dataset score_answer consistency test
2025-03-04 21:55:09 +01:00
Rich Jones
e3b7365f50 Game of Life partial scoring and rule-clarification (#258)
* partial scoring and rule clarification
* better ql scoring
* word seq reverse typos
2025-03-03 22:22:39 +01:00
Zafir Stojanovski
2f9d94c1e7 fix: Unify Prompts (#254)
* remove cot
* fix prompt template
* fix pool matrix
* spiral matrix fixed
2025-03-03 21:55:53 +01:00
joesharratt1229
976e1710a6 small change to word sequence reversal prompt (#252)
corrected ansewr format
2025-03-02 17:34:35 +01:00
Zafir Stojanovski
1bc9f6f09f fix manipulate matrix (#247) 2025-03-01 23:00:29 +01:00
Rich Jones
80aafda8e5 more dynamic scoring for jumble (#246) 2025-03-01 18:50:59 +01:00
Rich Jones
ca5372dcc1 rm typo 2025-02-27 13:44:33 +01:00
Rich Jones
9a8e398f22 fix graph color example template 2025-02-27 13:43:01 +01:00
AhmedSaif2
e9e36f3a23 Fix primes representation in count_primes dataset metadata 2025-02-26 14:58:21 +02:00
Andreas Köpf
6b923d5ea0 Fix PoolMatrixConfigs::score_answer(), add unit tests (#215) 2025-02-26 00:43:18 +01:00
Andreas Koepf
ba6bdb7d6b fix score_answer of pool_matrix (if -> elif), remove print 2025-02-25 23:43:29 +01:00
Andreas Koepf
969ec6a208 add try-except to GraphColorDataset.score_answer() 2025-02-25 23:43:29 +01:00
Andreas Koepf
d1f2f30d8a add None/empty check to score_answer of cryptarithm 2025-02-25 23:43:29 +01:00
Andreas Koepf
74f590e24f more native type hints 2025-02-21 21:23:14 +01:00