Commit graph

62 commits

Author SHA1 Message Date
Oliver Stanley
7475a20700
include ranges rather than sampled values in difficulty metadata dicts (#387)
* update difficulty metadata for logic datasets

* update difficulty metadata for graph datasets

* update difficulty metadata for geometry datasets

* update difficulty metadata for games datasets

* update difficulty metadata for cognition datasets

* update difficulty metadata for arithmetic datasets

* update difficulty metadata for arc datasets

* update difficulty metadata for algorithmic datasets

* update difficulty metadata for algebra datasets

* use tuples

* update tests

* update tests
2025-03-20 10:27:03 +01:00
Andreas Köpf
d2c895f1d3
Refactor Curriculum Attributes (#335)
* remove min_value from AttributeDefinition
* remove type from AttributeDefinition
* Add CurriculumContext
* add ensure_interval option for RangeAttributes
* docs: Add legend explaining curriculum indicators in dataset gallery
* update GALLERY.md
2025-03-16 15:40:28 +01:00
Adefioye
5bfe730c3b
Simple equations curriculum (#340)
* Add curriculum to simple_equations and unit tests
* Add difficulty to metadata
2025-03-13 21:17:14 +01:00
Adefioye
cad255e31b
Add polynomial multiplication curriculum (#338)
* Add polynomial multiplication curriculum and unit tests

* Add difficulty metadata

* Add curriculum class for complex_arithmetic and polynomial_multiplication
2025-03-12 00:03:46 +01:00
joesharratt1229
be75c3aa5f
added intermediate integration (#334) 2025-03-11 23:57:51 +01:00
joesharratt1229
105374183f
Algebra/curr (#320)
* add polynomial equation curriculum

* added simple integration

* addded metadata to config
2025-03-11 00:17:07 +01:00
Adefioye
f5141b32c5
Add complex arithmetic curriculum (#310)
* Add complex arithmetic curriculum
2025-03-10 00:28:51 +01:00
Andreas Köpf
5d7fbac0ad
Minor question template & score_answer improvements (#261)
* math prompt improvements
* ignore brackets in complex_arithmetic results
* improve additional instruction in prompt of polynomial_equations
* more strict tests for score_answer in polynomial_equations
* simplify special reward handling
* fix test_intermediate_integration
* fix sokoban dataset
* add common dataset score_answer consistency test
2025-03-04 21:55:09 +01:00
Andreas Koepf (aider)
941da618d8 feat: Add comprehensive unit tests for parse_string_to_complex() method 2025-02-26 21:44:32 +01:00
Andreas Koepf
eeb9fa31d5 more native type hints 2025-02-21 21:23:14 +01:00
Andreas Koepf
3e7ff3b084 use native types List->list, Dict->dict, Set->set, Tuple->tuple 2025-02-21 15:15:38 +01:00
Andreas Köpf
5c89cb872f
Merge pull request #106 from tohskai/multivariate-polynomial-multiplication
Better support for multivariate polynomials in PolynomialMultiplicationDataset
2025-02-17 18:08:36 +01:00
tohskai
5afd82fdc3 Refactor PolynomialMultiplicationDataset and fix issues with score_answer 2025-02-17 17:04:48 +01:00
abdulhakeem
94d4bc03fc Remove play file and format with pre-commit 2025-02-13 22:39:21 -06:00
abdulhakeem
58e03067f9 Fix formatting of added instructions 2025-02-13 21:26:58 -06:00
abdulhakeem
fc5fb85537 Fix more conflict 2025-02-13 21:26:54 -06:00
abdulhakeem
3493703c33 Fix conflict during rebasing 2025-02-13 21:21:11 -06:00
abdulhakeem
8811598a17 Add useful instructions to question template of some datasets 2025-02-13 00:49:31 -06:00
Andreas Koepf
014ee03e35 fix typo 2025-02-11 11:03:55 +01:00
tohskai
2a0baef313 Improve support for multivariate polynomials 2025-02-11 01:58:07 +01:00
rishabhranawat
40e5a7cffa [poly-reward] run pre-commit hooks 2025-02-09 07:30:18 -08:00
rishabhranawat
8c6c7f9ca7 [poly-reward] minor updates to the docstrings 2025-02-08 21:41:18 -08:00
rishabhranawat
adfcf52bca Merge branch 'main' of https://github.com/rishabhranawat/reasoning-gym into poly-reward 2025-02-08 21:37:21 -08:00
rishabhranawat
1cc55b3f96 [poly-reward] add a greedy strategy scoring function for polynomial equations 2025-02-08 21:36:21 -08:00
Andreas Koepf
127f505798 add ArcAgiDataset class, fix score_entry() metadata params 2025-02-08 23:18:18 +01:00
Andreas Koepf
4d9afcaba2 clarify number_filtering task 2025-02-08 19:32:45 +01:00
Andreas Koepf
848997ee47 add complex_arithmetic 2025-02-07 17:53:30 +01:00
Aayam
2170ff1c23 pre commit run changes 2025-02-07 07:42:03 -08:00
Aayam
7ddc6390e6 All number are integers now. 2025-02-07 07:34:17 -08:00
Aayam
e2ce20bcbb Apply pre-commit fixes 2025-02-07 07:01:20 -08:00
Aayam
f93c00a16b added explicit check for answer to metadata result match 2025-02-07 07:01:20 -08:00
tohskai
847442ef0a
Add PolynomialMultiplicationDataset (#64)
* Add PolynomialMultiplicationDataset
2025-02-07 14:06:41 +01:00
Andreas Köpf
3f6b2fc807
Add Coaching & ScoreBoard class (result tracking) (#72)
* feat: Add Coach and ScoreBoard classes for performance tracking and difficulty adjustment
* feat: Add GroupedScores class to wrap aggregated scores
* refactor: Create ScoreStats class with tuple-based score statistics
* feat: Add unit test for Coach with CompositeDataset and multiple datasets
* fix: Add difficulty metadata to leg counting dataset
* feat: Add clear() method to ScoreBoard to reset all stored data
* feat: Add __len__ method to ScoreBoard to return number of scores
* feat: Add update_dataset_config method to CompositeDataset
* cleanup __init__ & imports
2025-02-06 23:15:28 +01:00
Andreas Köpf
334f43df53
Revert "feat: Add Complex Arithmetic Dataset and Tests" 2025-02-06 08:12:52 +01:00
Aayam
9280d22b83 Apply pre-commit fixes 2025-02-05 22:53:36 -08:00
Aayam
5be79bcb1b feat: Add Complex Arithmetic Dataset and Tests
This commit introduces a new dataset for complex number arithmetic operations:

- Implements ComplexArithmeticDataset for generating complex number problems
- Supports addition, subtraction, multiplication, and division operations

Part of the algebra tasks collection in reasoning-gym.
2025-02-05 08:53:06 -08:00
Andreas Koepf
057b9f2034 auto-load simple/intermediate integration tasks, stable order for n_queens (set was not stable) 2025-02-02 22:18:54 +01:00
joesharratt1229
b0d21cf664 added score_answer implementation and tests 2025-02-02 17:18:56 +00:00
joesharratt1229
420a44bd79 added impl of simple integration dataset generator 2025-02-02 15:29:24 +00:00
joesharratt1229
0eb0247ebd added register dataset to script 2025-02-02 15:28:52 +00:00
joesharratt1229
8528e39764 added intermediate integration dataset generator 2025-02-02 15:27:08 +00:00
Andreas Koepf
0dcff77b37 add reasoning_gym.create_dataset({name}, ...) global factory function 2025-01-25 00:58:34 +01:00
Andreas Koepf
e9549f2a63 pass config to ProceduralDataset base 2025-01-25 00:23:05 +01:00
Andreas Koepf
a07df085cf pre-commit 2025-01-24 23:55:43 +01:00
panispani
c992ac95c7 Add polynomial equations dataset and config 2025-01-24 20:37:20 +00:00
Andreas Koepf
1b43579448 fix operators configuration 2025-01-24 19:44:46 +01:00
Andreas Koepf (aider)
3c6e0679af feat: Add operators configuration and corresponding unit tests to simple_equations 2025-01-24 19:42:57 +01:00
Andreas Koepf
6533cbc961 simplify simple_equation generation 2025-01-24 19:41:51 +01:00
Andreas Koepf
6a1340e11b refactor: Replace unnamed loop variable with named index in equation generation 2025-01-24 19:27:19 +01:00
Andreas Koepf (aider)
cf2434b3aa fix: Remove operators configuration from simple equations dataset 2025-01-24 19:15:28 +01:00