Commit graph

310 commits

Author SHA1 Message Date
joesharratt1229
ba58ecf8ea corrected failing airthmetic test 2025-02-16 12:01:54 +00:00
Andreas Köpf
af84d4453c
Merge pull request #134 from zafstojano/fix/string-insertion
fix(env): String Insertion
2025-02-15 21:20:05 +01:00
Andreas Köpf
9dc63330c2
Merge pull request #133 from zafstojano/fix/binary-matrix
fix(env): Binary Matrix
2025-02-15 21:19:23 +01:00
Zafir Stojanovski
85b4601b57 fix score function 2025-02-15 17:40:37 +01:00
Zafir Stojanovski
c28b04d159 pre-commit 2025-02-15 16:15:09 +01:00
Zafir Stojanovski
c72f4583cb test for parsing answer as python list 2025-02-15 16:14:13 +01:00
Zafir Stojanovski
b46e445ada fix score function and add test 2025-02-15 16:09:08 +01:00
Zafir Stojanovski
7ffb6ab3f6 update tests for min_n 2025-02-15 15:34:48 +01:00
Andreas Köpf
77108ad7a9
Merge pull request #113 from Iron-Bound/rush_hour
Rush Hour Gym
2025-02-14 23:32:51 +01:00
Andreas Koepf
a5d784c6ef fix handling of walls, add unit test 2025-02-14 23:29:17 +01:00
Zafir Stojanovski
660b70c8e5 add seed for knight swap 2025-02-14 22:08:46 +01:00
Zafir Stojanovski
1a5f4b88b2 remove template from test 2025-02-14 21:58:45 +01:00
Zafir Stojanovski
3275538fa1 Merge branch 'main' of https://github.com/open-thought/reasoning-gym into env/string-splitting 2025-02-14 21:55:23 +01:00
Andreas Koepf
044da9687f adapt unit tests to partial match changes 2025-02-14 21:30:50 +01:00
Zafir Stojanovski
ba9b81ab45 Merge branch 'main' of https://github.com/open-thought/reasoning-gym into env/string-splitting 2025-02-14 17:51:18 +01:00
Zafir Stojanovski
10481312f7 string splitting 2025-02-14 17:50:07 +01:00
Andreas Koepf (aider)
316aebfadc feat: Add score_answer method to RushHourDataset with input validation 2025-02-14 17:33:01 +01:00
Andreas Koepf (aider)
ca5e23e195 test: Add comprehensive unit tests for RushHourDataset 2025-02-14 17:29:43 +01:00
Andreas Koepf
f0ad47a29a test: Add partial move sequence test for Rush Hour board 2025-02-14 17:27:19 +01:00
Andreas Koepf
27a945dd07 add unit test for RushHour Board::perform_moves() 2025-02-14 16:59:19 +01:00
Andreas Köpf
0169c0fba4
Merge pull request #128 from open-thought/rich/scorefixes
[Ongoing] Eval Template and Score Fixes
2025-02-14 16:15:37 +01:00
Andreas Koepf
0a660a3409 ignore single whitespace at beginning and end of answer, use reward = len(oracle_answer) / len(answer) 2025-02-14 15:40:12 +01:00
Rich Jones
5e1b419ba7 word sorting score func 2025-02-14 12:57:31 +01:00
Rich Jones
f2d4417019 fix letter jumble 2025-02-14 12:21:56 +01:00
Rich Jones
9c12701e7a lint 2025-02-14 12:17:50 +01:00
Rich Jones
aae6a58e35 clean up ransom note 2025-02-14 12:15:55 +01:00
Andreas Koepf (aider)
d60d608192 feat: Add comprehensive unit tests for Game of Life dataset 2025-02-14 07:28:41 +01:00
Andreas Koepf
8960d66beb move game_of_life from games to algorithmic 2025-02-14 07:26:47 +01:00
Andreas Köpf
312291f2a7
Merge pull request #126 from zafstojano/env/string-synthesis
String Synthesis
2025-02-14 07:11:25 +01:00
Andreas Köpf
b64d0af2bc
Merge branch 'main' into rich/graphcolor 2025-02-14 07:09:38 +01:00
Adefioye
ecb0ee2315
Merge branch 'main' into koko/eval 2025-02-13 22:27:16 -06:00
abdulhakeem
58e03067f9 Fix formatting of added instructions 2025-02-13 21:26:58 -06:00
abdulhakeem
b7a721fce0 Fix more conflict 2025-02-13 21:24:05 -06:00
abdulhakeem
3493703c33 Fix conflict during rebasing 2025-02-13 21:21:11 -06:00
Andreas Koepf (aider)
6ec029c030 test: Add test to verify perfect score for PolynomialEquationsDataset 2025-02-13 21:15:17 -06:00
Zafir Stojanovski
6f9036631a lint 2025-02-13 21:15:17 -06:00
Zafir Stojanovski
12af794381 string insertion 2025-02-13 21:15:17 -06:00
Andreas Koepf
5410bb78a0 add ProductsDataset (multiplication tasks) 2025-02-13 17:59:02 +01:00
Andreas Koepf (aider)
ce30536627 test: Add scoring tests for Products dataset 2025-02-13 17:52:32 +01:00
Andreas Koepf (aider)
bdcaeff42a feat: Add ProductsDataset with configurable terms and digits 2025-02-13 17:50:19 +01:00
Andreas Köpf
de8101aef1
Merge pull request #125 from open-thought/rich/gol2
Game of Life Output Formatting
2025-02-13 17:42:22 +01:00
Zafir Stojanovski
3a2edf71c3 string synthesis 2025-02-13 16:33:28 +01:00
Rich Jones
48e19795ad
Merge branch 'main' into rich/graphcolor 2025-02-13 13:43:34 +01:00
Rich Jones
deba814211 Merge branch 'main' into rich/graphcolor 2025-02-13 13:42:54 +01:00
Rich Jones
0adde9853f json gol 2025-02-13 13:25:38 +01:00
Andreas Köpf
971782308f
Merge branch 'main' into env/string-insertion 2025-02-13 13:07:29 +01:00
Andreas Köpf
9dc031e704
Merge pull request #119 from zafstojano/env/string-modification
String Manipulation
2025-02-13 13:03:42 +01:00
Andreas Koepf
66df77aca6 format answer in polynomial_equations to match expected format, add unit test 2025-02-13 12:09:20 +01:00
Andreas Koepf (aider)
997f4fc829 test: Add test to verify perfect score for PolynomialEquationsDataset 2025-02-13 11:48:16 +01:00
Rich Jones
3ec4c15c51 add graph coloring 2025-02-13 01:28:09 +01:00