Zafir Stojanovski
4c47527130
fix(envs): Add source dataset and index to metadata ( #388 )
...
* add source dataset and index to metadata
* fix typo
* fix coach class and its test
2025-03-20 11:12:14 +00:00
Oliver Stanley
c6d01541aa
include ranges rather than sampled values in difficulty metadata dicts ( #387 )
...
* update difficulty metadata for logic datasets
* update difficulty metadata for graph datasets
* update difficulty metadata for geometry datasets
* update difficulty metadata for games datasets
* update difficulty metadata for cognition datasets
* update difficulty metadata for arithmetic datasets
* update difficulty metadata for arc datasets
* update difficulty metadata for algorithmic datasets
* update difficulty metadata for algebra datasets
* use tuples
* update tests
* update tests
2025-03-20 10:27:03 +01:00
Andreas Köpf
ed766028fb
Refactor Curriculum Attributes ( #335 )
...
* remove min_value from AttributeDefinition
* remove type from AttributeDefinition
* Add CurriculumContext
* add ensure_interval option for RangeAttributes
* docs: Add legend explaining curriculum indicators in dataset gallery
* update GALLERY.md
2025-03-16 15:40:28 +01:00
Adefioye
5e0ccf3499
Cryptarithm curriculum ( #346 )
...
* Add curriculum for cryptarithm
* Add difficulty to metadata
2025-03-13 21:03:57 +01:00
Andreas Köpf
b2904ccab9
Minor question template & score_answer improvements ( #261 )
...
* math prompt improvements
* ignore brackets in complex_arithmetic results
* improve additional instruction in prompt of polynomial_equations
* more strict tests for score_answer in polynomial_equations
* simplify special reward handling
* fix test_intermediate_integration
* fix sokoban dataset
* add common dataset score_answer consistency test
2025-03-04 21:55:09 +01:00
Zafir Stojanovski
2f9d94c1e7
fix: Unify Prompts ( #254 )
...
* remove cot
* fix prompt template
* fix pool matrix
* spiral matrix fixed
2025-03-03 21:55:53 +01:00
Andreas Koepf
d1f2f30d8a
add None/empty check to score_answer of cryptarithm
2025-02-25 23:43:29 +01:00
Andreas Koepf
74f590e24f
more native type hints
2025-02-21 21:23:14 +01:00
Andreas Koepf
ff5b210106
use native types List->list, Dict->dict, Set->set, Tuple->tuple
2025-02-21 15:15:38 +01:00
Andreas Koepf
67bf9d10cb
use correct signature for CryptarithmDataset.score_answer() method
2025-02-20 11:55:32 +01:00
theblackcat102
daa3b309f2
[fix] precommit not happy
2025-02-20 17:00:18 +08:00
theblackcat102
9c955f5b3c
[feat] remove answer parsing since its already handled
2025-02-20 16:57:51 +08:00
theblackcat102
c95a163ea6
[fix] normalize to <answer></answer>
2025-02-19 08:40:31 +08:00
theblackcat102
822c096e73
[fix] pre-commit fix
2025-02-18 21:48:54 +08:00
theblackcat102
e714d5e395
[feat] add test case
2025-02-18 21:45:51 +08:00
theblackcat102
3975f78343
[feat] added score_answer function
2025-02-18 21:33:14 +08:00
Andreas Koepf
b78408200c
cryptarithm change defaults: size=500, include_example=True
2025-02-16 16:38:43 +01:00
Andreas Koepf
839c830c2a
formatting
2025-02-16 16:30:28 +01:00
theblackcat102
9fe04f7c16
[feat] add include example params
2025-02-16 20:45:19 +08:00
