321 commits

Author	SHA1	Message	Date
Andreas Köpf	2bec5cdf5a	Merge pull request #140 from theblackcat102/cryptarithm ... New task : Verbal arithmetic	2025-02-16 16:41:44 +01:00
Andreas Koepf	c832e2a438	formatting	2025-02-16 16:30:28 +01:00
Andreas Köpf	c858d1f236	Merge pull request #141 from joesharratt1229/feat/score-answer-impl ... Added score answer implementations `spell_backward` and `sentence reordering`	2025-02-16 16:24:48 +01:00
Andreas Koepf	44f8d7b6af	formatting	2025-02-16 16:18:39 +01:00
Zafir Stojanovski	5da45015c9	update prompt and score answer	2025-02-16 15:18:45 +01:00
Andreas Koepf	3f98afe47d	more tolerant parsing of futoshiki answers	2025-02-16 14:23:40 +01:00
joesharratt1229	20e0fb45bd	added another assertion to test	2025-02-16 13:10:43 +00:00
theblackcat102	0e4b6a9026	[feat] add include example params	2025-02-16 20:45:19 +08:00
Andreas Koepf (aider)	6fccc95479	test: Add comprehensive unit tests for FutoshikiDataset	2025-02-16 13:28:36 +01:00
joesharratt1229	73910f0f61	merged remoted ... Merge remote-tracking branch 'origin/main' into feat/score-answer-impl	2025-02-16 12:03:25 +00:00
joesharratt1229	ba58ecf8ea	corrected failing airthmetic test	2025-02-16 12:01:54 +00:00
Andreas Koepf	52b1fd1cae	add configuration option for ArcAgiDataset	2025-02-16 12:49:21 +01:00
Andreas Köpf	af84d4453c	Merge pull request #134 from zafstojano/fix/string-insertion ... fix(env): String Insertion	2025-02-15 21:20:05 +01:00
Andreas Köpf	9dc63330c2	Merge pull request #133 from zafstojano/fix/binary-matrix ... fix(env): Binary Matrix	2025-02-15 21:19:23 +01:00
Zafir Stojanovski	85b4601b57	fix score function	2025-02-15 17:40:37 +01:00
Zafir Stojanovski	c28b04d159	pre-commit	2025-02-15 16:15:09 +01:00
Zafir Stojanovski	c72f4583cb	test for parsing answer as python list	2025-02-15 16:14:13 +01:00
Zafir Stojanovski	b46e445ada	fix score function and add test	2025-02-15 16:09:08 +01:00
Zafir Stojanovski	7ffb6ab3f6	update tests for min_n	2025-02-15 15:34:48 +01:00
Andreas Köpf	77108ad7a9	Merge pull request #113 from Iron-Bound/rush_hour ... Rush Hour Gym	2025-02-14 23:32:51 +01:00
Andreas Koepf	a5d784c6ef	fix handling of walls, add unit test	2025-02-14 23:29:17 +01:00
Zafir Stojanovski	660b70c8e5	add seed for knight swap	2025-02-14 22:08:46 +01:00
Zafir Stojanovski	1a5f4b88b2	remove template from test	2025-02-14 21:58:45 +01:00
Zafir Stojanovski	3275538fa1	Merge branch 'main' of https://github.com/open-thought/reasoning-gym into env/string-splitting	2025-02-14 21:55:23 +01:00
Andreas Koepf	044da9687f	adapt unit tests to partial match changes	2025-02-14 21:30:50 +01:00
Zafir Stojanovski	ba9b81ab45	Merge branch 'main' of https://github.com/open-thought/reasoning-gym into env/string-splitting	2025-02-14 17:51:18 +01:00
Zafir Stojanovski	10481312f7	string splitting	2025-02-14 17:50:07 +01:00
Andreas Koepf (aider)	316aebfadc	feat: Add score_answer method to RushHourDataset with input validation	2025-02-14 17:33:01 +01:00
Andreas Koepf (aider)	ca5e23e195	test: Add comprehensive unit tests for RushHourDataset	2025-02-14 17:29:43 +01:00
Andreas Koepf	f0ad47a29a	test: Add partial move sequence test for Rush Hour board	2025-02-14 17:27:19 +01:00
Andreas Koepf	27a945dd07	add unit test for RushHour Board::perform_moves()	2025-02-14 16:59:19 +01:00
Andreas Köpf	0169c0fba4	Merge pull request #128 from open-thought/rich/scorefixes ... [Ongoing] Eval Template and Score Fixes	2025-02-14 16:15:37 +01:00
Andreas Koepf	0a660a3409	ignore single whitespace at beginning and end of answer, use reward = len(oracle_answer) / len(answer)	2025-02-14 15:40:12 +01:00
Rich Jones	5e1b419ba7	word sorting score func	2025-02-14 12:57:31 +01:00
Rich Jones	f2d4417019	fix letter jumble	2025-02-14 12:21:56 +01:00
Rich Jones	9c12701e7a	lint	2025-02-14 12:17:50 +01:00
Rich Jones	aae6a58e35	clean up ransom note	2025-02-14 12:15:55 +01:00
Andreas Koepf (aider)	d60d608192	feat: Add comprehensive unit tests for Game of Life dataset	2025-02-14 07:28:41 +01:00
Andreas Koepf	8960d66beb	move game_of_life from games to algorithmic	2025-02-14 07:26:47 +01:00
Andreas Köpf	312291f2a7	Merge pull request #126 from zafstojano/env/string-synthesis ... String Synthesis	2025-02-14 07:11:25 +01:00
Andreas Köpf	b64d0af2bc	Merge branch 'main' into rich/graphcolor	2025-02-14 07:09:38 +01:00
Adefioye	ecb0ee2315	Merge branch 'main' into koko/eval	2025-02-13 22:27:16 -06:00
abdulhakeem	58e03067f9	Fix formatting of added instructions	2025-02-13 21:26:58 -06:00
abdulhakeem	b7a721fce0	Fix more conflict	2025-02-13 21:24:05 -06:00
abdulhakeem	3493703c33	Fix conflict during rebasing	2025-02-13 21:21:11 -06:00
Andreas Koepf (aider)	6ec029c030	test: Add test to verify perfect score for PolynomialEquationsDataset	2025-02-13 21:15:17 -06:00
Zafir Stojanovski	6f9036631a	lint	2025-02-13 21:15:17 -06:00
Zafir Stojanovski	12af794381	string insertion	2025-02-13 21:15:17 -06:00
Andreas Koepf	5410bb78a0	add ProductsDataset (multiplication tasks)	2025-02-13 17:59:02 +01:00
Andreas Koepf (aider)	ce30536627	test: Add scoring tests for Products dataset	2025-02-13 17:52:32 +01:00