open-thought/reasoning-gym
1
0
Fork 0
mirror of https://github.com/open-thought/reasoning-gym.git synced 2026-04-19 12:58:07 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
1327 commits 21 branches 5 tags 37 MiB
Commit graph

21 commits

Author SHA1 Message Date
Zafir Stojanovski
dced3bfc45
fix(curriculum): Make boundaries in curriculum more sensible (#407) 
* init

* fix tests

* unify codeio

* filtered for libraries not present in reasoning-gym

* fix more bounds

* puzzle24

* knight swap curriculum

* fix number sorting

* fix attributes

* add validation of config in creation of dataset

* dry run for instantiating and validating the datasets

* remove unused imports

* fix curriculum tests to reference newly updated attribute names
 2025-04-04 20:24:14 +02:00
Zafir Stojanovski
ce0a6c4878
fix(envs): Add source dataset and index to metadata (#388) 
* add source dataset and index to metadata

* fix typo

* fix coach class and its test
 2025-03-20 11:12:14 +00:00
Oliver Stanley
7475a20700
include ranges rather than sampled values in difficulty metadata dicts (#387) 
* update difficulty metadata for logic datasets

* update difficulty metadata for graph datasets

* update difficulty metadata for geometry datasets

* update difficulty metadata for games datasets

* update difficulty metadata for cognition datasets

* update difficulty metadata for arithmetic datasets

* update difficulty metadata for arc datasets

* update difficulty metadata for algorithmic datasets

* update difficulty metadata for algebra datasets

* use tuples

* update tests

* update tests
 2025-03-20 10:27:03 +01:00
Andreas Köpf
d2c895f1d3
Refactor Curriculum Attributes (#335) 
* remove min_value from AttributeDefinition
* remove type from AttributeDefinition
* Add CurriculumContext
* add ensure_interval option for RangeAttributes
* docs: Add legend explaining curriculum indicators in dataset gallery
* update GALLERY.md
 2025-03-16 15:40:28 +01:00
Zafir Stojanovski
e560cb3c46
feat(env): Leg Counting Curriculum (#275) 
* leg  counting curriculum

---------

Co-authored-by: Andreas Koepf <andreas.koepf@provisio.com>
 2025-03-07 19:15:18 +01:00
Andreas Köpf
c69bc5d4e6
Basic curriculum (#198) 
* feat: Add optional curriculum support to dataset registration and creation
* docs: Add docstrings to create_curriculum() and register_dataset()
* feat: Add curriculum configuration classes for CurriculumExperiment
* feat: Add weight parameter to CurriculumAttributeConfig and use in DatasetSpec
* refactor: Simplify CurriculumAttributeConfig with "*" attribute level support
* test: Add unit tests for CurriculumExperiment class
* feat: Add from_yaml() method to CurriculumExperimentConfig with unit test
 2025-03-07 11:22:12 +01:00
Zafir Stojanovski
01e1c8f9af
fix: Unify Prompts (#254) 
* remove cot
* fix prompt template
* fix pool matrix
* spiral matrix fixed
 2025-03-03 21:55:53 +01:00
Andreas Koepf
eeb9fa31d5 more native type hints 2025-02-21 21:23:14 +01:00
Andreas Koepf
3e7ff3b084 use native types List->list, Dict->dict, Set->set, Tuple->tuple 2025-02-21 15:15:38 +01:00
Zafir Stojanovski
881c48b145 fix leg counting prompt template 2025-02-16 09:58:36 +01:00
Andreas Köpf
3f6b2fc807
Add Coaching & ScoreBoard class (result tracking) (#72) 
* feat: Add Coach and ScoreBoard classes for performance tracking and difficulty adjustment
* feat: Add GroupedScores class to wrap aggregated scores
* refactor: Create ScoreStats class with tuple-based score statistics
* feat: Add unit test for Coach with CompositeDataset and multiple datasets
* fix: Add difficulty metadata to leg counting dataset
* feat: Add clear() method to ScoreBoard to reset all stored data
* feat: Add __len__ method to ScoreBoard to return number of scores
* feat: Add update_dataset_config method to CompositeDataset
* cleanup __init__ & imports
 2025-02-06 23:15:28 +01:00
Andreas Koepf
0dcff77b37 add reasoning_gym.create_dataset({name}, ...) global factory function 2025-01-25 00:58:34 +01:00
Andreas Koepf
e9549f2a63 pass config to ProceduralDataset base 2025-01-25 00:23:05 +01:00
Andreas Koepf
20069b2a7d formatting 2025-01-24 10:34:07 +01:00
Andreas Koepf (aider)
44fd0d4a25 refactor: Inherit LegCountingDataset from ProceduralDataset 2025-01-24 10:19:11 +01:00
Andreas Koepf
1f93058834 refactor: Simplify imports in leg_counting.py 2025-01-24 10:19:10 +01:00
Andreas Koepf (aider)
8db31dc87c refactor: Remove centipede from ANIMALS due to variable leg count 2025-01-23 22:18:59 +01:00
Andreas Koepf (aider)
23d420bbfe refactor: Sort ANIMALS dictionary by leg count with alphabetical order within groups 2025-01-23 22:17:27 +01:00
Andreas Koepf (aider)
84951f5730 feat: Add more 4-legged and 6-legged animals to ANIMALS dictionary 2025-01-23 22:16:08 +01:00
Andreas Koepf (aider)
0e4b4bb602 feat: Add more diverse animals to leg counting dataset 2025-01-23 22:14:15 +01:00
Andreas Koepf (aider)
b0d4ffb07b feat: Add leg counting arithmetic task generator with animal leg counting functionality 2025-01-23 22:08:42 +01:00