720 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Zafir Stojanovski	7a12f45d53	string manipulation	2025-02-12 22:28:23 +01:00
Zafir Stojanovski	50f5b50845	lint	2025-02-12 17:26:23 +01:00
Andreas Koepf	ab9f781d97	use *args param for _define_attributes()	2025-02-12 16:59:09 +01:00
Zafir Stojanovski	a79d3d06f2	string insertion	2025-02-12 15:18:51 +01:00
Andreas Köpf	c9b39fdab1	Merge pull request #116 from zafstojano/env/pool_matrix ... (Max/Average) Pool Matrix	2025-02-12 14:07:38 +01:00
Andreas Köpf	c73d241ae1	Merge branch 'main' into env/pool_matrix	2025-02-12 14:07:25 +01:00
Andreas Köpf	8e5caf6efb	Merge pull request #117 from zafstojano/fix/eval-system-prompt ... fix(eval): System prompt and parse response	2025-02-12 14:05:34 +01:00
Zafir Stojanovski	58a641e59f	lint	2025-02-12 11:21:46 +01:00
Zafir Stojanovski	3be5252d92	min matrix size, fixed question template	2025-02-12 11:20:55 +01:00
Zafir Stojanovski	7c43b8ee47	reset eval.sh	2025-02-12 10:58:49 +01:00
Zafir Stojanovski	3d84816f95	system prompt for structured output, and parse such outputs	2025-02-12 10:44:42 +01:00
ironbound	071d790e1c	v1 bounds checking	2025-02-12 05:13:10 +01:00
Andreas Koepf	56ba500959	update GALLERY.md & bump version	2025-02-11 23:43:56 +01:00
Andreas Koepf (aider)	c6ef97ec0b	fix: Add validation for size parameter in ABConfig	2025-02-11 23:39:57 +01:00
Andreas Koepf (aider)	06e2745ceb	fix: Add missing random import in test_ab.py	2025-02-11 23:37:49 +01:00
Andreas Koepf (aider)	abdedece33	test: Add comprehensive unit tests for ABDataset	2025-02-11 23:37:40 +01:00
Andreas Koepf	afb50fdf69	test: Add test for ABConfig dataset generation	2025-02-11 23:37:38 +01:00
Andreas Köpf	5f28608982	Merge pull request #112 from open-thought/rich/ab ... Add A::B Challenges	2025-02-11 23:34:55 +01:00
Andreas Köpf	27938ce13a	Merge branch 'main' into rich/ab	2025-02-11 23:34:48 +01:00
Andreas Köpf	626b5aa007	Merge pull request #115 from zafstojano/env/count-primes ... (env): Count primes in an interval	2025-02-11 23:19:03 +01:00
Andreas Köpf	d6f12af695	Merge pull request #114 from zafstojano/fix/simplify-rotate-matrix ... fix(env): Simplify rotate matrix core function	2025-02-11 23:03:17 +01:00
Andreas Köpf	4b8df3e087	Merge pull request #111 from open-thought/rich/rectanglecount ... Add Rectangle Count Dataset	2025-02-11 22:57:44 +01:00
Andreas Köpf	411a1789b1	Merge pull request #110 from open-thought/rich/dice ... Adds Dice Probability Dataset	2025-02-11 22:54:02 +01:00
Andreas Köpf	3f8380d93a	Merge pull request #99 from open-thought/curriculum_basics ... Add foundation for auto-curriculum	2025-02-11 22:52:14 +01:00
Zafir Stojanovski	15bd9cb544	pool matrix	2025-02-11 22:22:39 +01:00
ironbound	2e2c5744df	working board	2025-02-11 19:41:45 +01:00
Rich Jones	d44d076ae3	Add A::B Challenges	2025-02-11 18:08:25 +01:00
Rich Jones	0a4799d99a	clarity	2025-02-11 16:22:53 +01:00
Andreas Köpf	858e5bba51	Merge pull request #108 from rishabhranawat/eval-v2 ... Eval V1: improve speed using async	2025-02-11 16:07:47 +01:00
Zafir Stojanovski	5a8ce7d2af	lint	2025-02-11 14:44:46 +01:00
Zafir Stojanovski	1dc0a29eae	count primes	2025-02-11 14:44:38 +01:00
Rich Jones	c2fb8bb6cc	add rectangle count dataset	2025-02-11 13:56:27 +01:00
Zafir Stojanovski	e9a492e9a5	Merge branch 'main' of https://github.com/open-thought/reasoning-gym into fix/simplify-rotate-matrix	2025-02-11 13:55:05 +01:00
Zafir Stojanovski	21b845ebef	simplify rotate method	2025-02-11 13:54:54 +01:00
Rich Jones	b208dc664e	lint again	2025-02-11 13:00:12 +01:00
Rich Jones	f7cf015e3b	commit test	2025-02-11 12:59:16 +01:00
Rich Jones	945207da43	fmt	2025-02-11 12:54:23 +01:00
Rich Jones	852ddfcea3	add dice dataset	2025-02-11 12:53:13 +01:00
Andreas Köpf	d56d2e25fb	Merge pull request #109 from joesharratt1229/feat/r1-evals ... added r1 evaluation logic	2025-02-11 11:35:46 +01:00
Andreas Koepf	014ee03e35	fix typo	2025-02-11 11:03:55 +01:00
joesharratt1229	1a3728ec3a	corrected small linting err in cognition.yaml	2025-02-11 06:56:04 +00:00
joesharratt1229	bf00437aae	converted answer to string	2025-02-11 06:48:59 +00:00
rishabhranawat	d7b69190ba	commit formatting	2025-02-10 22:05:45 -08:00
rishabhranawat	1dc7af587f	[eval-v1] benchmark with 50 samples	2025-02-10 22:05:09 -08:00
rishabhranawat	fb40c8ca55	[eval-v1] add a simple readme with some details	2025-02-10 21:57:00 -08:00
rishabhranawat	9e4870125d	[eval-v1] pre commit formatting	2025-02-10 21:50:22 -08:00
rishabhranawat	df5438498e	[eval-v1] add timer	2025-02-10 21:48:44 -08:00
rishabhranawat	247464a47d	[eval-v1] async to speed up inference/evaluation	2025-02-10 21:35:46 -08:00
joesharratt1229	42e02640a3	added r1 evaluation logic	2025-02-11 03:46:56 +00:00
Andreas Koepf	4abcd1f1df	update gallery, lower default config values for PowerFunctionDataset	2025-02-10 22:42:04 +01:00