Commit graph

13 commits

Author SHA1 Message Date
Zafir Stojanovski
4c47527130 fix(envs): Add source dataset and index to metadata (#388)
* add source dataset and index to metadata

* fix typo

* fix coach class and its test
2025-03-20 11:12:14 +00:00
Oliver Stanley
c6d01541aa include ranges rather than sampled values in difficulty metadata dicts (#387)
* update difficulty metadata for logic datasets

* update difficulty metadata for graph datasets

* update difficulty metadata for geometry datasets

* update difficulty metadata for games datasets

* update difficulty metadata for cognition datasets

* update difficulty metadata for arithmetic datasets

* update difficulty metadata for arc datasets

* update difficulty metadata for algorithmic datasets

* update difficulty metadata for algebra datasets

* use tuples

* update tests

* update tests
2025-03-20 10:27:03 +01:00
Andreas Köpf
ed766028fb Refactor Curriculum Attributes (#335)
* remove min_value from AttributeDefinition
* remove type from AttributeDefinition
* Add CurriculumContext
* add ensure_interval option for RangeAttributes
* docs: Add legend explaining curriculum indicators in dataset gallery
* update GALLERY.md
2025-03-16 15:40:28 +01:00
Zafir Stojanovski
04f0f7deb7 letter counting curriculum (#312) 2025-03-10 00:24:42 +01:00
Andreas Köpf
a607db79f7 Add Coaching & ScoreBoard class (result tracking) (#72)
* feat: Add Coach and ScoreBoard classes for performance tracking and difficulty adjustment
* feat: Add GroupedScores class to wrap aggregated scores
* refactor: Create ScoreStats class with tuple-based score statistics
* feat: Add unit test for Coach with CompositeDataset and multiple datasets
* fix: Add difficulty metadata to leg counting dataset
* feat: Add clear() method to ScoreBoard to reset all stored data
* feat: Add __len__ method to ScoreBoard to return number of scores
* feat: Add update_dataset_config method to CompositeDataset
* cleanup __init__ & imports
2025-02-06 23:15:28 +01:00
Andreas Koepf
9b33522b41 use sorted() for repeatable generation outputs (e.g. GALLERY.md) 2025-01-30 23:33:43 +01:00
Andreas Koepf
519e411fa5 add reasoning_gym.create_dataset({name}, ...) global factory function 2025-01-25 00:58:34 +01:00
Andreas Koepf
0d2d8ba6a0 pass config to ProceduralDataset base 2025-01-25 00:23:05 +01:00
Andreas Koepf
5c5d46b4bd formatting, cleanup 2025-01-24 17:12:42 +01:00
Andreas Koepf (aider)
981ff73ed7 refactor: Inherit NumberFilteringDataset and LetterCountingDataset from ProceduralDataset 2025-01-24 11:13:32 +01:00
Andreas Koepf
aaabc05ace formatting 2025-01-24 10:34:07 +01:00
Andreas Koepf (aider)
cd0bc93092 fix: Ensure letter counting dataset extracts only alphanumeric words 2025-01-23 19:17:45 +01:00
Andreas Koepf (aider)
a929bc3d1d feat: Add letter counting algorithmic task with configurable text span generation 2025-01-23 19:11:15 +01:00