Commit graph

15 commits

Author SHA1 Message Date
Andreas Köpf
b2904ccab9 Minor question template & score_answer improvements (#261)
* math prompt improvements
* ignore brackets in complex_arithmetic results
* improve additional instruction in prompt of polynomial_equations
* more strict tests for score_answer in polynomial_equations
* simplify special reward handling
* fix test_intermediate_integration
* fix sokoban dataset
* add common dataset score_answer consistency test
2025-03-04 21:55:09 +01:00
Zafir Stojanovski
2f9d94c1e7 fix: Unify Prompts (#254)
* remove cot
* fix prompt template
* fix pool matrix
* spiral matrix fixed
2025-03-03 21:55:53 +01:00
Andreas Koepf
d1f2f30d8a add None/empty check to score_answer of cryptarithm 2025-02-25 23:43:29 +01:00
Andreas Koepf
74f590e24f more native type hints 2025-02-21 21:23:14 +01:00
Andreas Koepf
ff5b210106 use native types List->list, Dict->dict, Set->set, Tuple->tuple 2025-02-21 15:15:38 +01:00
Andreas Koepf
67bf9d10cb use correct signature for CryptarithmDataset.score_answer() method 2025-02-20 11:55:32 +01:00
theblackcat102
daa3b309f2 [fix] precommit not happy 2025-02-20 17:00:18 +08:00
theblackcat102
9c955f5b3c [feat] remove answer parsing since its already handled 2025-02-20 16:57:51 +08:00
theblackcat102
c95a163ea6 [fix] normalize to <answer></answer> 2025-02-19 08:40:31 +08:00
theblackcat102
822c096e73 [fix] pre-commit fix 2025-02-18 21:48:54 +08:00
theblackcat102
e714d5e395 [feat] add test case 2025-02-18 21:45:51 +08:00
theblackcat102
3975f78343 [feat] added score_answer function 2025-02-18 21:33:14 +08:00
Andreas Koepf
b78408200c cryptarithm change defaults: size=500, include_example=True 2025-02-16 16:38:43 +01:00
Andreas Koepf
839c830c2a formatting 2025-02-16 16:30:28 +01:00
theblackcat102
9fe04f7c16 [feat] add include example params 2025-02-16 20:45:19 +08:00