Commit graph

302 commits

Author SHA1 Message Date
Andreas Köpf
2c56960ff8 Merge pull request #113 from Iron-Bound/rush_hour
Rush Hour Gym
2025-02-14 23:32:51 +01:00
Andreas Koepf
14f67cb7e7 fix handling of walls, add unit test 2025-02-14 23:29:17 +01:00
Zafir Stojanovski
cb763bc043 add seed for knight swap 2025-02-14 22:08:46 +01:00
Zafir Stojanovski
ed4f9dee13 remove template from test 2025-02-14 21:58:45 +01:00
Zafir Stojanovski
7cf8b9c512 Merge branch 'main' of https://github.com/open-thought/reasoning-gym into env/string-splitting 2025-02-14 21:55:23 +01:00
Andreas Koepf
9a21e6776d adapt unit tests to partial match changes 2025-02-14 21:30:50 +01:00
Zafir Stojanovski
f9e846871b Merge branch 'main' of https://github.com/open-thought/reasoning-gym into env/string-splitting 2025-02-14 17:51:18 +01:00
Zafir Stojanovski
60ebb1329d string splitting 2025-02-14 17:50:07 +01:00
Andreas Koepf (aider)
d5ce2bfdf5 feat: Add score_answer method to RushHourDataset with input validation 2025-02-14 17:33:01 +01:00
Andreas Koepf (aider)
8278a9521c test: Add comprehensive unit tests for RushHourDataset 2025-02-14 17:29:43 +01:00
Andreas Koepf
819cab53d0 test: Add partial move sequence test for Rush Hour board 2025-02-14 17:27:19 +01:00
Andreas Koepf
417e71cd17 add unit test for RushHour Board::perform_moves() 2025-02-14 16:59:19 +01:00
Andreas Köpf
2d38493a55 Merge pull request #128 from open-thought/rich/scorefixes
[Ongoing] Eval Template and Score Fixes
2025-02-14 16:15:37 +01:00
Andreas Koepf
2726caf2fe ignore single whitespace at beginning and end of answer, use reward = len(oracle_answer) / len(answer) 2025-02-14 15:40:12 +01:00
Rich Jones
28d89df935 word sorting score func 2025-02-14 12:57:31 +01:00
Rich Jones
b3438d9976 fix letter jumble 2025-02-14 12:21:56 +01:00
Rich Jones
f945bc5d88 lint 2025-02-14 12:17:50 +01:00
Rich Jones
ab51228f35 clean up ransom note 2025-02-14 12:15:55 +01:00
Andreas Koepf (aider)
e24093c9f0 feat: Add comprehensive unit tests for Game of Life dataset 2025-02-14 07:28:41 +01:00
Andreas Koepf
80719c7201 move game_of_life from games to algorithmic 2025-02-14 07:26:47 +01:00
Andreas Köpf
3ceb7310ca Merge pull request #126 from zafstojano/env/string-synthesis
String Synthesis
2025-02-14 07:11:25 +01:00
Andreas Köpf
25e7bf140a Merge branch 'main' into rich/graphcolor 2025-02-14 07:09:38 +01:00
Adefioye
0738d3fd17 Merge branch 'main' into koko/eval 2025-02-13 22:27:16 -06:00
abdulhakeem
b2ca8016fb Fix formatting of added instructions 2025-02-13 21:26:58 -06:00
abdulhakeem
3b1ab9eb86 Fix more conflict 2025-02-13 21:24:05 -06:00
abdulhakeem
1a0530fc2b Fix conflict during rebasing 2025-02-13 21:21:11 -06:00
Andreas Koepf (aider)
368fe678cb test: Add test to verify perfect score for PolynomialEquationsDataset 2025-02-13 21:15:17 -06:00
Zafir Stojanovski
c64a32155a lint 2025-02-13 21:15:17 -06:00
Zafir Stojanovski
aaf1df285e string insertion 2025-02-13 21:15:17 -06:00
Andreas Koepf
1996ffa6d8 add ProductsDataset (multiplication tasks) 2025-02-13 17:59:02 +01:00
Andreas Koepf (aider)
17485fad67 test: Add scoring tests for Products dataset 2025-02-13 17:52:32 +01:00
Andreas Koepf (aider)
583ebfd5de feat: Add ProductsDataset with configurable terms and digits 2025-02-13 17:50:19 +01:00
Andreas Köpf
db00818e76 Merge pull request #125 from open-thought/rich/gol2
Game of Life Output Formatting
2025-02-13 17:42:22 +01:00
Zafir Stojanovski
3202908c50 string synthesis 2025-02-13 16:33:28 +01:00
Rich Jones
9004e89bc3 Merge branch 'main' into rich/graphcolor 2025-02-13 13:43:34 +01:00
Rich Jones
b5df965d06 Merge branch 'main' into rich/graphcolor 2025-02-13 13:42:54 +01:00
Rich Jones
55b75602ed json gol 2025-02-13 13:25:38 +01:00
Andreas Köpf
1a7d248607 Merge branch 'main' into env/string-insertion 2025-02-13 13:07:29 +01:00
Andreas Köpf
aeeba4e3f9 Merge pull request #119 from zafstojano/env/string-modification
String Manipulation
2025-02-13 13:03:42 +01:00
Andreas Koepf
07bb87d872 format answer in polynomial_equations to match expected format, add unit test 2025-02-13 12:09:20 +01:00
Andreas Koepf (aider)
257c865c1c test: Add test to verify perfect score for PolynomialEquationsDataset 2025-02-13 11:48:16 +01:00
Rich Jones
14052133bb add graph coloring 2025-02-13 01:28:09 +01:00
Zafir Stojanovski
b45d777e2c string manipulation 2025-02-12 22:28:23 +01:00
Zafir Stojanovski
4f11003ab7 lint 2025-02-12 17:26:23 +01:00
Zafir Stojanovski
4c5bc58a29 string insertion 2025-02-12 15:18:51 +01:00
Andreas Köpf
1669bba91b Merge branch 'main' into env/pool_matrix 2025-02-12 14:07:25 +01:00
Zafir Stojanovski
41556dd054 min matrix size, fixed question template 2025-02-12 11:20:55 +01:00
Andreas Koepf (aider)
59461aaec8 fix: Add validation for size parameter in ABConfig 2025-02-11 23:39:57 +01:00
Andreas Koepf (aider)
38922c7e6e fix: Add missing random import in test_ab.py 2025-02-11 23:37:49 +01:00
Andreas Koepf (aider)
2e3e01eda0 test: Add comprehensive unit tests for ABDataset 2025-02-11 23:37:40 +01:00