open-thought/reasoning-gym
1
0
Fork 0
mirror of https://github.com/open-thought/reasoning-gym.git synced 2026-04-23 16:55:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
858 commits 21 branches 5 tags 37 MiB
Commit graph

338 commits

Author SHA1 Message Date
Rich Jones
a76e56fccc implement decimal precision 2025-02-19 12:30:07 +01:00
Rich Jones
0cd2eb50d7 Merge branch 'rich/decimalmath' of github.com:open-thought/reasoning-gym into rich/decimalmath 2025-02-19 03:34:57 +01:00
Rich Jones
c3bc7937dc [wip] more flexible api 2025-02-19 03:29:40 +01:00
Rich Jones
36b2bceda3 Merge branch 'main' into rich/decimalmath 2025-02-18 20:53:36 +01:00
Rich Jones
bd56a7b1fe lint 2025-02-18 19:22:03 +01:00
Rich Jones
e2bdfb4c1c decimal math 2025-02-18 19:20:33 +01:00
Zafir Stojanovski
ed606631bb Merge branch 'main' of https://github.com/open-thought/reasoning-gym into env/palindrome-partitioning 2025-02-18 14:08:00 +01:00
Andreas Köpf
54d52ef6ae Merge pull request #147 from Adefioye/koko/question-template-tinkering 
Tweaking some question templates
 2025-02-17 18:22:49 +01:00
Andreas Koepf
aa794253fe minor formatting changes 2025-02-17 18:20:18 +01:00
Andreas Köpf
5654f300b9 Merge pull request #106 from tohskai/multivariate-polynomial-multiplication 
Better support for multivariate polynomials in PolynomialMultiplicationDataset
 2025-02-17 18:08:36 +01:00
tohskai
28fcf4d481 Refactor PolynomialMultiplicationDataset and fix issues with score_answer 2025-02-17 17:04:48 +01:00
abdulhakeem
ff8cd11a2d Fix unit test 2025-02-17 03:13:06 -06:00
Andreas Köpf
79758a31de Merge pull request #105 from open-thought/circuit_logic 
initial draft for circuit_logic dataset generator
 2025-02-16 22:54:43 +01:00
Andreas Koepf (aider)
0051c266d4 feat: Add scoring method & unit tests for circuit logic dataset 2025-02-16 22:48:51 +01:00
Zafir Stojanovski
a27704b44e fix template 2025-02-16 19:51:24 +01:00
Andreas Köpf
33f888dce7 Merge pull request #140 from theblackcat102/cryptarithm 
New task : Verbal arithmetic
 2025-02-16 16:41:44 +01:00
Andreas Koepf
839c830c2a formatting 2025-02-16 16:30:28 +01:00
Andreas Köpf
66ddb41bbd Merge pull request #141 from joesharratt1229/feat/score-answer-impl 
Added score answer implementations `spell_backward` and `sentence reordering`
 2025-02-16 16:24:48 +01:00
Andreas Koepf
6bf2dfa36c formatting 2025-02-16 16:18:39 +01:00
Zafir Stojanovski
1a3e4372ef update prompt and score answer 2025-02-16 15:18:45 +01:00
Andreas Koepf
5803a2962e more tolerant parsing of futoshiki answers 2025-02-16 14:23:40 +01:00
joesharratt1229
d2d4b3a644 added another assertion to test 2025-02-16 13:10:43 +00:00
theblackcat102
9fe04f7c16 [feat] add include example params 2025-02-16 20:45:19 +08:00
Andreas Koepf (aider)
5c786eb7fe test: Add comprehensive unit tests for FutoshikiDataset 2025-02-16 13:28:36 +01:00
joesharratt1229
cc7d422d78 merged remoted 
Merge remote-tracking branch 'origin/main' into feat/score-answer-impl
 2025-02-16 12:03:25 +00:00
joesharratt1229
569517664f corrected failing airthmetic test 2025-02-16 12:01:54 +00:00
Andreas Koepf
c7b41acf14 add configuration option for ArcAgiDataset 2025-02-16 12:49:21 +01:00
Andreas Köpf
a409cf3778 Merge pull request #134 from zafstojano/fix/string-insertion 
fix(env): String Insertion
 2025-02-15 21:20:05 +01:00
Andreas Köpf
53bb55c26c Merge pull request #133 from zafstojano/fix/binary-matrix 
fix(env): Binary Matrix
 2025-02-15 21:19:23 +01:00
Zafir Stojanovski
467300f7f9 fix score function 2025-02-15 17:40:37 +01:00
Zafir Stojanovski
6c3b5a8ad2 pre-commit 2025-02-15 16:15:09 +01:00
Zafir Stojanovski
815b3c4ee5 test for parsing answer as python list 2025-02-15 16:14:13 +01:00
Zafir Stojanovski
95d367bc17 fix score function and add test 2025-02-15 16:09:08 +01:00
Zafir Stojanovski
84ca05b8f5 update tests for min_n 2025-02-15 15:34:48 +01:00
Andreas Köpf
2c56960ff8 Merge pull request #113 from Iron-Bound/rush_hour 
Rush Hour Gym
 2025-02-14 23:32:51 +01:00
Andreas Koepf
14f67cb7e7 fix handling of walls, add unit test 2025-02-14 23:29:17 +01:00
Zafir Stojanovski
cb763bc043 add seed for knight swap 2025-02-14 22:08:46 +01:00
Zafir Stojanovski
ed4f9dee13 remove template from test 2025-02-14 21:58:45 +01:00
Zafir Stojanovski
7cf8b9c512 Merge branch 'main' of https://github.com/open-thought/reasoning-gym into env/string-splitting 2025-02-14 21:55:23 +01:00
Andreas Koepf
9a21e6776d adapt unit tests to partial match changes 2025-02-14 21:30:50 +01:00
Zafir Stojanovski
f9e846871b Merge branch 'main' of https://github.com/open-thought/reasoning-gym into env/string-splitting 2025-02-14 17:51:18 +01:00
Zafir Stojanovski
60ebb1329d string splitting 2025-02-14 17:50:07 +01:00
Andreas Koepf (aider)
d5ce2bfdf5 feat: Add score_answer method to RushHourDataset with input validation 2025-02-14 17:33:01 +01:00
Andreas Koepf (aider)
8278a9521c test: Add comprehensive unit tests for RushHourDataset 2025-02-14 17:29:43 +01:00
Andreas Koepf
819cab53d0 test: Add partial move sequence test for Rush Hour board 2025-02-14 17:27:19 +01:00
Andreas Koepf
417e71cd17 add unit test for RushHour Board::perform_moves() 2025-02-14 16:59:19 +01:00
Andreas Köpf
2d38493a55 Merge pull request #128 from open-thought/rich/scorefixes 
[Ongoing] Eval Template and Score Fixes
 2025-02-14 16:15:37 +01:00
Andreas Koepf
2726caf2fe ignore single whitespace at beginning and end of answer, use reward = len(oracle_answer) / len(answer) 2025-02-14 15:40:12 +01:00
Rich Jones
28d89df935 word sorting score func 2025-02-14 12:57:31 +01:00
Rich Jones
b3438d9976 fix letter jumble 2025-02-14 12:21:56 +01:00