Oliver Stanley
7475a20700
include ranges rather than sampled values in difficulty metadata dicts ( #387 )
...
* update difficulty metadata for logic datasets
* update difficulty metadata for graph datasets
* update difficulty metadata for geometry datasets
* update difficulty metadata for games datasets
* update difficulty metadata for cognition datasets
* update difficulty metadata for arithmetic datasets
* update difficulty metadata for arc datasets
* update difficulty metadata for algorithmic datasets
* update difficulty metadata for algebra datasets
* use tuples
* update tests
* update tests
2025-03-20 10:27:03 +01:00
Andreas Köpf
d2c895f1d3
Refactor Curriculum Attributes ( #335 )
...
* remove min_value from AttributeDefinition
* remove type from AttributeDefinition
* Add CurriculumContext
* add ensure_interval option for RangeAttributes
* docs: Add legend explaining curriculum indicators in dataset gallery
* update GALLERY.md
2025-03-16 15:40:28 +01:00
Adefioye
ec3e414a8c
Cryptarithm curriculum ( #346 )
...
* Add curriculum for cryptarithm
* Add difficulty to metadata
2025-03-13 21:03:57 +01:00
Andreas Köpf
5d7fbac0ad
Minor question template & score_answer improvements ( #261 )
...
* math prompt improvements
* ignore brackets in complex_arithmetic results
* improve additional instruction in prompt of polynomial_equations
* more strict tests for score_answer in polynomial_equations
* simplify special reward handling
* fix test_intermediate_integration
* fix sokoban dataset
* add common dataset score_answer consistency test
2025-03-04 21:55:09 +01:00
Zafir Stojanovski
01e1c8f9af
fix: Unify Prompts ( #254 )
...
* remove cot
* fix prompt template
* fix pool matrix
* spiral matrix fixed
2025-03-03 21:55:53 +01:00
Andreas Koepf
65d17b9850
add None/empty check to score_answer of cryptarithm
2025-02-25 23:43:29 +01:00
Andreas Koepf
eeb9fa31d5
more native type hints
2025-02-21 21:23:14 +01:00
Andreas Koepf
3e7ff3b084
use native types List->list, Dict->dict, Set->set, Tuple->tuple
2025-02-21 15:15:38 +01:00
Andreas Koepf
50eab616f8
use correct signature for CryptarithmDataset.score_answer() method
2025-02-20 11:55:32 +01:00
theblackcat102
44559aac95
[fix] precommit not happy
2025-02-20 17:00:18 +08:00
theblackcat102
407b212326
[feat] remove answer parsing since its already handled
2025-02-20 16:57:51 +08:00
theblackcat102
9a2e9e949e
[fix] normalize to <answer></answer>
2025-02-19 08:40:31 +08:00
theblackcat102
bbc31e4291
[fix] pre-commit fix
2025-02-18 21:48:54 +08:00
theblackcat102
c612e2abc1
[feat] add test case
2025-02-18 21:45:51 +08:00
theblackcat102
288f632c5c
[feat] added score_answer function
2025-02-18 21:33:14 +08:00
Andreas Koepf
de8162dc6a
cryptarithm change defaults: size=500, include_example=True
2025-02-16 16:38:43 +01:00
Andreas Koepf
c832e2a438
formatting
2025-02-16 16:30:28 +01:00
theblackcat102
0e4b6a9026
[feat] add include example params
2025-02-16 20:45:19 +08:00
