388 commits

Author	SHA1	Message	Date
theblackcat102	9a2e9e949e	[fix] normalize to <answer></answer>	2025-02-19 08:40:31 +08:00
Rich Jones	2532cdce8e	Merge branch 'main' into rich/decimalmath	2025-02-18 20:53:36 +01:00
Rich Jones	46cdfc71cf	lint	2025-02-18 19:22:03 +01:00
Rich Jones	80d8dbcc36	decimal math	2025-02-18 19:20:33 +01:00
theblackcat102	bbc31e4291	[fix] pre-commit fix	2025-02-18 21:48:54 +08:00
theblackcat102	c612e2abc1	[feat] add test case	2025-02-18 21:45:51 +08:00
Zafir Stojanovski	525c9f6378	Merge branch 'main' of https://github.com/open-thought/reasoning-gym into env/palindrome-partitioning	2025-02-18 14:08:00 +01:00
Andreas Köpf	79c5e53ef0	Merge pull request #147 from Adefioye/koko/question-template-tinkering ... Tweaking some question templates	2025-02-17 18:22:49 +01:00
Andreas Koepf	203394314e	minor formatting changes	2025-02-17 18:20:18 +01:00
Andreas Köpf	5c89cb872f	Merge pull request #106 from tohskai/multivariate-polynomial-multiplication ... Better support for multivariate polynomials in PolynomialMultiplicationDataset	2025-02-17 18:08:36 +01:00
tohskai	5afd82fdc3	Refactor PolynomialMultiplicationDataset and fix issues with score_answer	2025-02-17 17:04:48 +01:00
abdulhakeem	5f279be306	Fix unit test	2025-02-17 03:13:06 -06:00
Andreas Köpf	72fcb36cb4	Merge pull request #105 from open-thought/circuit_logic ... initial draft for circuit_logic dataset generator	2025-02-16 22:54:43 +01:00
Andreas Koepf (aider)	63bd662acf	feat: Add scoring method & unit tests for circuit logic dataset	2025-02-16 22:48:51 +01:00
Zafir Stojanovski	b47b6f94c9	fix template	2025-02-16 19:51:24 +01:00
Andreas Köpf	2bec5cdf5a	Merge pull request #140 from theblackcat102/cryptarithm ... New task : Verbal arithmetic	2025-02-16 16:41:44 +01:00
Andreas Koepf	c832e2a438	formatting	2025-02-16 16:30:28 +01:00
Andreas Köpf	c858d1f236	Merge pull request #141 from joesharratt1229/feat/score-answer-impl ... Added score answer implementations `spell_backward` and `sentence reordering`	2025-02-16 16:24:48 +01:00
Andreas Koepf	44f8d7b6af	formatting	2025-02-16 16:18:39 +01:00
Zafir Stojanovski	5da45015c9	update prompt and score answer	2025-02-16 15:18:45 +01:00
Andreas Koepf	3f98afe47d	more tolerant parsing of futoshiki answers	2025-02-16 14:23:40 +01:00
joesharratt1229	20e0fb45bd	added another assertion to test	2025-02-16 13:10:43 +00:00
theblackcat102	0e4b6a9026	[feat] add include example params	2025-02-16 20:45:19 +08:00
Andreas Koepf (aider)	6fccc95479	test: Add comprehensive unit tests for FutoshikiDataset	2025-02-16 13:28:36 +01:00
joesharratt1229	73910f0f61	merged remoted ... Merge remote-tracking branch 'origin/main' into feat/score-answer-impl	2025-02-16 12:03:25 +00:00
joesharratt1229	ba58ecf8ea	corrected failing airthmetic test	2025-02-16 12:01:54 +00:00
Andreas Koepf	52b1fd1cae	add configuration option for ArcAgiDataset	2025-02-16 12:49:21 +01:00
Andreas Köpf	af84d4453c	Merge pull request #134 from zafstojano/fix/string-insertion ... fix(env): String Insertion	2025-02-15 21:20:05 +01:00
Andreas Köpf	9dc63330c2	Merge pull request #133 from zafstojano/fix/binary-matrix ... fix(env): Binary Matrix	2025-02-15 21:19:23 +01:00
Zafir Stojanovski	85b4601b57	fix score function	2025-02-15 17:40:37 +01:00
Zafir Stojanovski	c28b04d159	pre-commit	2025-02-15 16:15:09 +01:00
Zafir Stojanovski	c72f4583cb	test for parsing answer as python list	2025-02-15 16:14:13 +01:00
Zafir Stojanovski	b46e445ada	fix score function and add test	2025-02-15 16:09:08 +01:00
Zafir Stojanovski	7ffb6ab3f6	update tests for min_n	2025-02-15 15:34:48 +01:00
Andreas Köpf	77108ad7a9	Merge pull request #113 from Iron-Bound/rush_hour ... Rush Hour Gym	2025-02-14 23:32:51 +01:00
Andreas Koepf	a5d784c6ef	fix handling of walls, add unit test	2025-02-14 23:29:17 +01:00
Zafir Stojanovski	660b70c8e5	add seed for knight swap	2025-02-14 22:08:46 +01:00
Zafir Stojanovski	1a5f4b88b2	remove template from test	2025-02-14 21:58:45 +01:00
Zafir Stojanovski	3275538fa1	Merge branch 'main' of https://github.com/open-thought/reasoning-gym into env/string-splitting	2025-02-14 21:55:23 +01:00
Andreas Koepf	044da9687f	adapt unit tests to partial match changes	2025-02-14 21:30:50 +01:00
Zafir Stojanovski	ba9b81ab45	Merge branch 'main' of https://github.com/open-thought/reasoning-gym into env/string-splitting	2025-02-14 17:51:18 +01:00
Zafir Stojanovski	10481312f7	string splitting	2025-02-14 17:50:07 +01:00
Andreas Koepf (aider)	316aebfadc	feat: Add score_answer method to RushHourDataset with input validation	2025-02-14 17:33:01 +01:00
Andreas Koepf (aider)	ca5e23e195	test: Add comprehensive unit tests for RushHourDataset	2025-02-14 17:29:43 +01:00
Andreas Koepf	f0ad47a29a	test: Add partial move sequence test for Rush Hour board	2025-02-14 17:27:19 +01:00
Andreas Koepf	27a945dd07	add unit test for RushHour Board::perform_moves()	2025-02-14 16:59:19 +01:00
Andreas Köpf	0169c0fba4	Merge pull request #128 from open-thought/rich/scorefixes ... [Ongoing] Eval Template and Score Fixes	2025-02-14 16:15:37 +01:00
Andreas Koepf	0a660a3409	ignore single whitespace at beginning and end of answer, use reward = len(oracle_answer) / len(answer)	2025-02-14 15:40:12 +01:00
Rich Jones	5e1b419ba7	word sorting score func	2025-02-14 12:57:31 +01:00
Rich Jones	f2d4417019	fix letter jumble	2025-02-14 12:21:56 +01:00