Commit graph

48 commits

Author SHA1 Message Date
abdulhakeem
2dad5a56f3 Remove play file and format with pre-commit 2025-02-13 22:39:21 -06:00
abdulhakeem
b2ca8016fb Fix formatting of added instructions 2025-02-13 21:26:58 -06:00
abdulhakeem
09ea24d84d Fix more conflict 2025-02-13 21:26:54 -06:00
abdulhakeem
1a0530fc2b Fix conflict during rebasing 2025-02-13 21:21:11 -06:00
abdulhakeem
62a0d14355 Add useful instructions to question template of some datasets 2025-02-13 00:49:31 -06:00
Andreas Koepf
6e22e5d56d fix typo 2025-02-11 11:03:55 +01:00
rishabhranawat
04b3323844 [poly-reward] run pre-commit hooks 2025-02-09 07:30:18 -08:00
rishabhranawat
7a6f7ea9da [poly-reward] minor updates to the docstrings 2025-02-08 21:41:18 -08:00
rishabhranawat
0f4ab53bd3 Merge branch 'main' of https://github.com/rishabhranawat/reasoning-gym into poly-reward 2025-02-08 21:37:21 -08:00
rishabhranawat
0dd4c05897 [poly-reward] add a greedy strategy scoring function for polynomial equations 2025-02-08 21:36:21 -08:00
Andreas Koepf
4e49806d22 add ArcAgiDataset class, fix score_entry() metadata params 2025-02-08 23:18:18 +01:00
Andreas Koepf
15fecda148 clarify number_filtering task 2025-02-08 19:32:45 +01:00
Andreas Koepf
f79d4ab5e8 add complex_arithmetic 2025-02-07 17:53:30 +01:00
Aayam
fa102721f2 pre commit run changes 2025-02-07 07:42:03 -08:00
Aayam
cf25ca94b9 All number are integers now. 2025-02-07 07:34:17 -08:00
Aayam
d675ea843e Apply pre-commit fixes 2025-02-07 07:01:20 -08:00
Aayam
50b96bff73 added explicit check for answer to metadata result match 2025-02-07 07:01:20 -08:00
tohskai
998d142d9f Add PolynomialMultiplicationDataset (#64)
* Add PolynomialMultiplicationDataset
2025-02-07 14:06:41 +01:00
Andreas Köpf
a607db79f7 Add Coaching & ScoreBoard class (result tracking) (#72)
* feat: Add Coach and ScoreBoard classes for performance tracking and difficulty adjustment
* feat: Add GroupedScores class to wrap aggregated scores
* refactor: Create ScoreStats class with tuple-based score statistics
* feat: Add unit test for Coach with CompositeDataset and multiple datasets
* fix: Add difficulty metadata to leg counting dataset
* feat: Add clear() method to ScoreBoard to reset all stored data
* feat: Add __len__ method to ScoreBoard to return number of scores
* feat: Add update_dataset_config method to CompositeDataset
* cleanup __init__ & imports
2025-02-06 23:15:28 +01:00
Andreas Köpf
3f0fa88a89 Revert "feat: Add Complex Arithmetic Dataset and Tests" 2025-02-06 08:12:52 +01:00
Aayam
d49c042e64 Apply pre-commit fixes 2025-02-05 22:53:36 -08:00
Aayam
a0e291d066 feat: Add Complex Arithmetic Dataset and Tests
This commit introduces a new dataset for complex number arithmetic operations:

- Implements ComplexArithmeticDataset for generating complex number problems
- Supports addition, subtraction, multiplication, and division operations

Part of the algebra tasks collection in reasoning-gym.
2025-02-05 08:53:06 -08:00
Andreas Koepf
db65e8451b auto-load simple/intermediate integration tasks, stable order for n_queens (set was not stable) 2025-02-02 22:18:54 +01:00
joesharratt1229
7c02901ee3 added score_answer implementation and tests 2025-02-02 17:18:56 +00:00
joesharratt1229
b1fa387e5d added impl of simple integration dataset generator 2025-02-02 15:29:24 +00:00
joesharratt1229
a9ea2df7a0 added register dataset to script 2025-02-02 15:28:52 +00:00
joesharratt1229
ed1492ba05 added intermediate integration dataset generator 2025-02-02 15:27:08 +00:00
Andreas Koepf
519e411fa5 add reasoning_gym.create_dataset({name}, ...) global factory function 2025-01-25 00:58:34 +01:00
Andreas Koepf
0d2d8ba6a0 pass config to ProceduralDataset base 2025-01-25 00:23:05 +01:00
Andreas Koepf
fec13b8c16 pre-commit 2025-01-24 23:55:43 +01:00
panispani
7b2cca77eb Add polynomial equations dataset and config 2025-01-24 20:37:20 +00:00
Andreas Koepf
9cad6191a9 fix operators configuration 2025-01-24 19:44:46 +01:00
Andreas Koepf (aider)
11204dcdf9 feat: Add operators configuration and corresponding unit tests to simple_equations 2025-01-24 19:42:57 +01:00
Andreas Koepf
ac7dd69586 simplify simple_equation generation 2025-01-24 19:41:51 +01:00
Andreas Koepf
71c00c6043 refactor: Replace unnamed loop variable with named index in equation generation 2025-01-24 19:27:19 +01:00
Andreas Koepf (aider)
4eb71de848 fix: Remove operators configuration from simple equations dataset 2025-01-24 19:15:28 +01:00
Andreas Koepf
6a96c4f15a fix: Increase max attempts and improve operator validation in simple equations 2025-01-24 19:15:27 +01:00
Andreas Koepf (aider)
111f172c3f refactor: Improve equation generation with max attempts and error handling 2025-01-24 19:09:10 +01:00
Andreas Koepf
572a9c6db2 fix: Remove positive integer constraint for equation solutions 2025-01-24 19:08:38 +01:00
Andreas Koepf (aider)
3e28998c6a fix: Respect operator config when generating equation terms 2025-01-24 18:58:44 +01:00
Andreas Koepf
5c5d46b4bd formatting, cleanup 2025-01-24 17:12:42 +01:00
Andreas Koepf
4cb925fce9 set default max_value for SimpleEquationsDataset to 100 2025-01-24 16:14:13 +01:00
Andreas Koepf (aider)
5a13303237 feat: Add SimpleEquationsDataset to algebra module
Developed together with Benjamin Rio (benjamrio)
2025-01-24 16:08:05 +01:00
Andreas Koepf
35c430a64b feat: Add algebra module to reasoning_gym package 2025-01-24 15:50:25 +01:00
Andreas Koepf (aider)
fc11a5117a fix: Pass variable parameter in recursive equation generation 2025-01-24 15:47:03 +01:00
Andreas Koepf (aider)
2662a2410b fix: Ensure consistent variable usage in simple equations generation 2025-01-24 15:38:26 +01:00
Andreas Koepf (aider)
aa55f1d6f2 feat: Add simple equations dataset with sympy-based generation 2025-01-24 15:36:39 +01:00
Andreas Koepf
f2c71b075c feat: Add initial algebra module with simple equations and test file 2025-01-24 15:36:38 +01:00