Commit graph

14 commits

Author SHA1 Message Date
joesharratt1229
43c739cb3e
Feat/curr adj (#394) 2025-04-02 06:39:14 +01:00
Zafir Stojanovski
ce0a6c4878
fix(envs): Add source dataset and index to metadata (#388)
* add source dataset and index to metadata

* fix typo

* fix coach class and its test
2025-03-20 11:12:14 +00:00
Oliver Stanley
7475a20700
include ranges rather than sampled values in difficulty metadata dicts (#387)
* update difficulty metadata for logic datasets

* update difficulty metadata for graph datasets

* update difficulty metadata for geometry datasets

* update difficulty metadata for games datasets

* update difficulty metadata for cognition datasets

* update difficulty metadata for arithmetic datasets

* update difficulty metadata for arc datasets

* update difficulty metadata for algorithmic datasets

* update difficulty metadata for algebra datasets

* use tuples

* update tests

* update tests
2025-03-20 10:27:03 +01:00
Andreas Köpf
d2c895f1d3
Refactor Curriculum Attributes (#335)
* remove min_value from AttributeDefinition
* remove type from AttributeDefinition
* Add CurriculumContext
* add ensure_interval option for RangeAttributes
* docs: Add legend explaining curriculum indicators in dataset gallery
* update GALLERY.md
2025-03-16 15:40:28 +01:00
Zafir Stojanovski
83cd34e21b
letter counting curriculum (#312) 2025-03-10 00:24:42 +01:00
Andreas Köpf
3f6b2fc807
Add Coaching & ScoreBoard class (result tracking) (#72)
* feat: Add Coach and ScoreBoard classes for performance tracking and difficulty adjustment
* feat: Add GroupedScores class to wrap aggregated scores
* refactor: Create ScoreStats class with tuple-based score statistics
* feat: Add unit test for Coach with CompositeDataset and multiple datasets
* fix: Add difficulty metadata to leg counting dataset
* feat: Add clear() method to ScoreBoard to reset all stored data
* feat: Add __len__ method to ScoreBoard to return number of scores
* feat: Add update_dataset_config method to CompositeDataset
* cleanup __init__ & imports
2025-02-06 23:15:28 +01:00
Andreas Koepf
a577f7cdf6 use sorted() for repeatable generation outputs (e.g. GALLERY.md) 2025-01-30 23:33:43 +01:00
Andreas Koepf
0dcff77b37 add reasoning_gym.create_dataset({name}, ...) global factory function 2025-01-25 00:58:34 +01:00
Andreas Koepf
e9549f2a63 pass config to ProceduralDataset base 2025-01-25 00:23:05 +01:00
Andreas Koepf
3dc80be7d2 formatting, cleanup 2025-01-24 17:12:42 +01:00
Andreas Koepf (aider)
8b49af5535 refactor: Inherit NumberFilteringDataset and LetterCountingDataset from ProceduralDataset 2025-01-24 11:13:32 +01:00
Andreas Koepf
20069b2a7d formatting 2025-01-24 10:34:07 +01:00
Andreas Koepf (aider)
102d4dae00 fix: Ensure letter counting dataset extracts only alphanumeric words 2025-01-23 19:17:45 +01:00
Andreas Koepf (aider)
dd6fc96891 feat: Add letter counting algorithmic task with configurable text span generation 2025-01-23 19:11:15 +01:00