open-thought/reasoning-gym
1
0
Fork 0
mirror of https://github.com/open-thought/reasoning-gym.git synced 2026-04-22 16:49:06 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
790 commits 21 branches 5 tags 37 MiB
Commit graph

314 commits

Author SHA1 Message Date
Andreas Koepf
6bf2dfa36c formatting 2025-02-16 16:18:39 +01:00
joesharratt1229
d2d4b3a644 added another assertion to test 2025-02-16 13:10:43 +00:00
joesharratt1229
cc7d422d78 merged remoted 
Merge remote-tracking branch 'origin/main' into feat/score-answer-impl
 2025-02-16 12:03:25 +00:00
joesharratt1229
569517664f corrected failing airthmetic test 2025-02-16 12:01:54 +00:00
Andreas Koepf
c7b41acf14 add configuration option for ArcAgiDataset 2025-02-16 12:49:21 +01:00
Andreas Köpf
a409cf3778 Merge pull request #134 from zafstojano/fix/string-insertion 
fix(env): String Insertion
 2025-02-15 21:20:05 +01:00
Andreas Köpf
53bb55c26c Merge pull request #133 from zafstojano/fix/binary-matrix 
fix(env): Binary Matrix
 2025-02-15 21:19:23 +01:00
Zafir Stojanovski
467300f7f9 fix score function 2025-02-15 17:40:37 +01:00
Zafir Stojanovski
6c3b5a8ad2 pre-commit 2025-02-15 16:15:09 +01:00
Zafir Stojanovski
815b3c4ee5 test for parsing answer as python list 2025-02-15 16:14:13 +01:00
Zafir Stojanovski
95d367bc17 fix score function and add test 2025-02-15 16:09:08 +01:00
Zafir Stojanovski
84ca05b8f5 update tests for min_n 2025-02-15 15:34:48 +01:00
Andreas Köpf
2c56960ff8 Merge pull request #113 from Iron-Bound/rush_hour 
Rush Hour Gym
 2025-02-14 23:32:51 +01:00
Andreas Koepf
14f67cb7e7 fix handling of walls, add unit test 2025-02-14 23:29:17 +01:00
Zafir Stojanovski
cb763bc043 add seed for knight swap 2025-02-14 22:08:46 +01:00
Zafir Stojanovski
ed4f9dee13 remove template from test 2025-02-14 21:58:45 +01:00
Zafir Stojanovski
7cf8b9c512 Merge branch 'main' of https://github.com/open-thought/reasoning-gym into env/string-splitting 2025-02-14 21:55:23 +01:00
Andreas Koepf
9a21e6776d adapt unit tests to partial match changes 2025-02-14 21:30:50 +01:00
Zafir Stojanovski
f9e846871b Merge branch 'main' of https://github.com/open-thought/reasoning-gym into env/string-splitting 2025-02-14 17:51:18 +01:00
Zafir Stojanovski
60ebb1329d string splitting 2025-02-14 17:50:07 +01:00
Andreas Koepf (aider)
d5ce2bfdf5 feat: Add score_answer method to RushHourDataset with input validation 2025-02-14 17:33:01 +01:00
Andreas Koepf (aider)
8278a9521c test: Add comprehensive unit tests for RushHourDataset 2025-02-14 17:29:43 +01:00
Andreas Koepf
819cab53d0 test: Add partial move sequence test for Rush Hour board 2025-02-14 17:27:19 +01:00
Andreas Koepf
417e71cd17 add unit test for RushHour Board::perform_moves() 2025-02-14 16:59:19 +01:00
Andreas Köpf
2d38493a55 Merge pull request #128 from open-thought/rich/scorefixes 
[Ongoing] Eval Template and Score Fixes
 2025-02-14 16:15:37 +01:00
Andreas Koepf
2726caf2fe ignore single whitespace at beginning and end of answer, use reward = len(oracle_answer) / len(answer) 2025-02-14 15:40:12 +01:00
Rich Jones
28d89df935 word sorting score func 2025-02-14 12:57:31 +01:00
Rich Jones
b3438d9976 fix letter jumble 2025-02-14 12:21:56 +01:00
Rich Jones
f945bc5d88 lint 2025-02-14 12:17:50 +01:00
Rich Jones
ab51228f35 clean up ransom note 2025-02-14 12:15:55 +01:00
Andreas Koepf (aider)
e24093c9f0 feat: Add comprehensive unit tests for Game of Life dataset 2025-02-14 07:28:41 +01:00
Andreas Koepf
80719c7201 move game_of_life from games to algorithmic 2025-02-14 07:26:47 +01:00
Andreas Köpf
3ceb7310ca Merge pull request #126 from zafstojano/env/string-synthesis 
String Synthesis
 2025-02-14 07:11:25 +01:00
Andreas Köpf
25e7bf140a Merge branch 'main' into rich/graphcolor 2025-02-14 07:09:38 +01:00
Adefioye
0738d3fd17 Merge branch 'main' into koko/eval 2025-02-13 22:27:16 -06:00
abdulhakeem
b2ca8016fb Fix formatting of added instructions 2025-02-13 21:26:58 -06:00
abdulhakeem
3b1ab9eb86 Fix more conflict 2025-02-13 21:24:05 -06:00
abdulhakeem
1a0530fc2b Fix conflict during rebasing 2025-02-13 21:21:11 -06:00
Andreas Koepf (aider)
368fe678cb test: Add test to verify perfect score for PolynomialEquationsDataset 2025-02-13 21:15:17 -06:00
Zafir Stojanovski
c64a32155a lint 2025-02-13 21:15:17 -06:00
Zafir Stojanovski
aaf1df285e string insertion 2025-02-13 21:15:17 -06:00
Andreas Koepf
1996ffa6d8 add ProductsDataset (multiplication tasks) 2025-02-13 17:59:02 +01:00
Andreas Koepf (aider)
17485fad67 test: Add scoring tests for Products dataset 2025-02-13 17:52:32 +01:00
Andreas Koepf (aider)
583ebfd5de feat: Add ProductsDataset with configurable terms and digits 2025-02-13 17:50:19 +01:00
Andreas Köpf
db00818e76 Merge pull request #125 from open-thought/rich/gol2 
Game of Life Output Formatting
 2025-02-13 17:42:22 +01:00
Zafir Stojanovski
3202908c50 string synthesis 2025-02-13 16:33:28 +01:00
Rich Jones
9004e89bc3 Merge branch 'main' into rich/graphcolor 2025-02-13 13:43:34 +01:00
Rich Jones
b5df965d06 Merge branch 'main' into rich/graphcolor 2025-02-13 13:42:54 +01:00
Rich Jones
55b75602ed json gol 2025-02-13 13:25:38 +01:00
Andreas Köpf
1a7d248607 Merge branch 'main' into env/string-insertion 2025-02-13 13:07:29 +01:00