Commit graph

8 commits

Author SHA1 Message Date
Andreas Köpf
5d7fbac0ad
Minor question template & score_answer improvements (#261)
* math prompt improvements
* ignore brackets in complex_arithmetic results
* improve additional instruction in prompt of polynomial_equations
* more strict tests for score_answer in polynomial_equations
* simplify special reward handling
* fix test_intermediate_integration
* fix sokoban dataset
* add common dataset score_answer consistency test
2025-03-04 21:55:09 +01:00
Zafir Stojanovski
01e1c8f9af
fix: Unify Prompts (#254)
* remove cot
* fix prompt template
* fix pool matrix
* spiral matrix fixed
2025-03-03 21:55:53 +01:00
Andreas Koepf
3e7ff3b084 use native types List->list, Dict->dict, Set->set, Tuple->tuple 2025-02-21 15:15:38 +01:00
Zafir Stojanovski
c72f4583cb test for parsing answer as python list 2025-02-15 16:14:13 +01:00
Zafir Stojanovski
70e6a2a347 update binary matrix prompt 2025-02-15 15:34:38 +01:00
Andreas Koepf
8c4400b18a reduce default zero probability for binary matrix 2025-02-09 20:05:56 +01:00
Zafir Stojanovski
18cf71a4a7 update instruction and shuffle numbers 2025-02-09 13:00:46 +01:00
Zafir Stojanovski
afde78196c binary matrix 2025-02-09 01:10:57 +01:00