Zafir Stojanovski
8d4e9030c0
manipulate matrix curriculum ( #293 )
2025-03-08 01:57:37 +01:00
Zafir Stojanovski
e69ed78c26
feat(env): Isomorphic Strings Curriculum ( #292 )
...
* isomorphic strings curriculum
---------
Co-authored-by: Andreas Köpf <andreas.koepf@xamla.com>
2025-03-08 01:56:14 +01:00
joesharratt1229
a7dd5f6680
added power function exponent ( #291 )
...
* added power function exponent
* register PowerFunctionCurriculum
---------
Co-authored-by: Andreas Koepf <andreas.koepf@provisio.com>
2025-03-08 01:54:36 +01:00
joesharratt1229
af5a6533c8
added word sort curriculum ( #289 )
2025-03-08 01:50:13 +01:00
Zafir Stojanovski
2d05a48f9b
feat(env): Group Anagrams Curriculum ( #288 )
...
* group anagrams curriculum
2025-03-08 01:49:12 +01:00
Zafir Stojanovski
9fc9cf4597
feat(env): Count Primes Curriculum ( #287 )
...
* count primes curriculum
2025-03-08 01:48:00 +01:00
Zafir Stojanovski
adf8cd8f6d
base conversion curriculum ( #286 )
2025-03-08 01:46:32 +01:00
vncntt
7199363339
dice curriculum ( #284 )
...
* curriculum + unit tests
* add difficulty to metadata
---------
Co-authored-by: Andreas Koepf <andreas.koepf@provisio.com>
2025-03-08 01:43:45 +01:00
vncntt
8c80bf6bec
Calendar arithmetic curriculum ( #283 )
...
* calendar arithmetic curriculum
* add difficulty to metadata
* register CalendarArithmeticCurriculum
---------
Co-authored-by: Andreas Koepf <andreas.koepf@provisio.com>
2025-03-08 01:38:22 +01:00
vncntt
775a42e9e4
Bitwise arithmetic curriculum ( #282 )
...
* bitwise_arithmetic curriculum
* register BitwiseArithmeticCurriculum
---------
Co-authored-by: Andreas Koepf <andreas.koepf@provisio.com>
2025-03-08 01:32:00 +01:00
joesharratt1229
444c793d3f
added Decimal curriculum ( #280 )
...
* added decimal curricula
* added chain sum decimal curriculum
* register DecimalArithmeticCurriculum & DecimalChainSumCurriculum
---------
Co-authored-by: Andreas Koepf <andreas.koepf@provisio.com>
2025-03-07 23:02:57 +01:00
Zafir Stojanovski
25b8e35589
feat(env): Binary Matrix Curriculum ( #279 )
...
* binary matrix curriculum
* register BinaryMatrixCurriculum
---------
Co-authored-by: Andreas Koepf <andreas.koepf@provisio.com>
2025-03-07 22:58:47 +01:00
joesharratt1229
1888fe2bb4
added basic arith curricula ( #276 )
...
* added basic arith curricula
* register BasicArithmeticCurriculum
---------
Co-authored-by: Andreas Koepf <andreas.koepf@provisio.com>
2025-03-07 22:54:49 +01:00
Oliver Stanley
f490b9f760
Tolerant scoring for CodeI/O based on edit distances ( #277 )
...
* add zss dep
* codeio edit distance-based scoring
* edit distance tweaks
2025-03-07 22:49:35 +01:00
Zafir Stojanovski
a8e920b552
feat(env): Binary Alternation Curriculum ( #278 )
...
* binary alternation
---------
Co-authored-by: Andreas Koepf <andreas.koepf@provisio.com>
2025-03-07 22:44:32 +01:00
Andreas Koepf
0a35e608ec
register MahjongPuzzleCurriculum
2025-03-07 19:17:04 +01:00
Zafir Stojanovski
e560cb3c46
feat(env): Leg Counting Curriculum ( #275 )
...
* leg counting curriculum
---------
Co-authored-by: Andreas Koepf <andreas.koepf@provisio.com>
2025-03-07 19:15:18 +01:00
Zafir Stojanovski
b915565c0d
add difficulty where possible ( #274 )
2025-03-07 19:01:26 +01:00
Andreas Koepf
fb06038e88
update gallery
2025-03-07 16:24:47 +01:00
Andreas Koepf
2802066233
remove data/ from main .gitignore
2025-03-07 16:16:40 +01:00
Andreas Koepf
c504efc2c3
use relative import for reasoning_gym.data
2025-03-07 15:56:45 +01:00
Andreas Köpf
c69bc5d4e6
Basic curriculum ( #198 )
...
* feat: Add optional curriculum support to dataset registration and creation
* docs: Add docstrings to create_curriculum() and register_dataset()
* feat: Add curriculum configuration classes for CurriculumExperiment
* feat: Add weight parameter to CurriculumAttributeConfig and use in DatasetSpec
* refactor: Simplify CurriculumAttributeConfig with "*" attribute level support
* test: Add unit tests for CurriculumExperiment class
* feat: Add from_yaml() method to CurriculumExperimentConfig with unit test
2025-03-07 11:22:12 +01:00
Rich Jones
cbfdf097a0
Add Modulo Grid Task ( #273 )
...
* add modulo_grid dataset
* ensure the pattern is mathematical, not just spatial
---------
Co-authored-by: Andreas Koepf <andreas.koepf@provisio.com>
2025-03-07 11:11:41 +01:00
Rich Jones
07dc01ad87
[Env] Game of Life Halting Prediction ( #272 )
...
This is a variant of the Game of Life task, which rather than trying to test the algorithmic simulation, tests the ability of the model to do explanatory reasoning of the board. The idea is that a model with good explanatory reasoning will be able to see that a game will not halt without simulating it into the future.
The task presents a GoL board, and the model is asked to predict if the board will halt (die, all cells zero) after n steps. Sometimes, the board will be made up of 'oscillators', isolated structures which never die. Othertimes, it is filled with non-oscillators, structures which will always die after a few steps. The model should deduce which case the presented board is.
2025-03-07 10:05:12 +01:00
Andreas Koepf
862617b7e0
update gallery, pypi release, bump version
2025-03-05 23:45:45 +01:00
joesharratt1229
d9638df79c
updated algorithmics dataset ( #269 )
...
* updated algorithmic datasets
* added changes to symbolic and power
* updated power function test
2025-03-05 23:32:53 +01:00
Zafir Stojanovski
f426db90ec
shortest path curriculum ( #271 )
2025-03-05 22:46:10 +01:00
Zafir Stojanovski
5bac641650
largest island curriculum ( #270 )
2025-03-05 22:45:35 +01:00
Zafir Stojanovski
9bb6d028a3
feat(env): Count Bits Curriculum ( #267 )
...
* add min n
* count bits
2025-03-05 22:44:04 +01:00
Zafir Stojanovski
8ccc4d7b0c
feat(env): Course Schedule Curriculum ( #266 )
...
* course schedule curriculum
* update levels
* update comments
* lint
2025-03-05 22:42:46 +01:00
joesharratt1229
f3ee9a91a2
Added puzzle24 closes #208 ( #268 )
...
* added puzzle24
2025-03-05 22:36:37 +01:00
Oliver Stanley
d1e505a8e9
First version of CodeI/O reasoning data ( #264 )
...
* notebook for prepping first set of raw code files
* updated codeio processing notebook for repo-level processing
* fix for edge case in codeio scoring
* Add reformat notebook
* filtering pass
* add non-determinism filtering
* Tweak CodeIODataset & include first real data
* add basic codeio test, metadata
2025-03-05 22:34:11 +01:00
joesharratt1229
e30be066ec
Fixed countdown score_answer ( #265 )
...
* fixed countdown score ans
* checked solution uses all numbers
2025-03-05 22:30:12 +01:00
Zafir Stojanovski
d0a42116fb
feat(env): Mahjong Puzzle Curriculum ( #263 )
...
* mahjong curriculum
* typo
* update levels
2025-03-05 22:28:02 +01:00
Zafir Stojanovski
8ecc723607
feat(env): NQueens Curriculum ( #262 )
...
* curriculum & tests
2025-03-05 15:05:17 +01:00
Andreas Köpf
5d7fbac0ad
Minor question template & score_answer improvements ( #261 )
...
* math prompt improvements
* ignore brackets in complex_arithmetic results
* improve additional instruction in prompt of polynomial_equations
* more strict tests for score_answer in polynomial_equations
* simplify special reward handling
* fix test_intermediate_integration
* fix sokoban dataset
* add common dataset score_answer consistency test
2025-03-04 21:55:09 +01:00
joesharratt1229
061282e373
implemented family_relationships score ans ( #260 )
2025-03-04 21:37:57 +01:00
vncntt
3672b231f1
should exit if API key isn't defined ( #259 )
...
* should exit if open-router and no api key
2025-03-04 09:45:36 +01:00
Rich Jones
0ba6119850
Game of Life partial scoring and rule-clarification ( #258 )
...
* partial scoring and rule clarification
* better ql scoring
* word seq reverse typos
2025-03-03 22:22:39 +01:00
joesharratt1229
6770ee3eef
updated for config by dataset ( #257 )
...
* updated for config by dataset
* updated read me
2025-03-03 21:58:32 +01:00
Andreas Köpf
c0cf237474
Reduce precision from 28 to 6 in DecimalArithmeticDataset ( #256 )
2025-03-03 21:57:08 +01:00
Andreas Köpf
68ecdca2bb
add Chain of Draft and direct system prompt styles ( #255 )
2025-03-03 21:56:31 +01:00
Zafir Stojanovski
01e1c8f9af
fix: Unify Prompts ( #254 )
...
* remove cot
* fix prompt template
* fix pool matrix
* spiral matrix fixed
2025-03-03 21:55:53 +01:00
joesharratt1229
49db4ed761
small change to word sequence reversal prompt ( #252 )
...
corrected ansewr format
2025-03-02 17:34:35 +01:00
vncntt
3149edf2c4
fixed problems in knights_knaves ( #251 )
...
* remove unnecessary variables
* added depth logic
* add depth tests
2025-03-02 08:47:54 +01:00
Andreas Köpf
24828e1889
Remove strip from ProceduralDataset::core score_answer() ( #250 )
...
* remove strip from ProceduralDataset::core score_answer(), strip in extract answer (optional, default=True)
* test: Move test_extract_answer() from test_dataset.py to test_utils.py
* refactor: Improve decimal reward computation with more flexible comparison
* fix: Implement rounding for format_number when round_if_needed is True
* test: Add test case for compute_decimal_reward with sign and zeros
2025-03-02 08:46:36 +01:00
Andreas Köpf
a66a7e7965
Revert "log error message on bad api response ( #243 )" ( #249 )
...
This reverts commit 8e2089b6c0
2025-03-01 23:56:42 +01:00
Andreas Köpf
e71d2a96b6
feat: Add category property to ProceduralDataset to extract category name ( #248 )
2025-03-01 23:11:40 +01:00
Zafir Stojanovski
f549909c3d
fix manipulate matrix ( #247 )
2025-03-01 23:00:29 +01:00
Rich Jones
39f151ad14
more dynamic scoring for jumble ( #246 )
2025-03-01 18:50:59 +01:00
