Commit graph

9 commits

Author SHA1 Message Date
Andreas Köpf
b2904ccab9 Minor question template & score_answer improvements (#261)
* math prompt improvements
* ignore brackets in complex_arithmetic results
* improve additional instruction in prompt of polynomial_equations
* more strict tests for score_answer in polynomial_equations
* simplify special reward handling
* fix test_intermediate_integration
* fix sokoban dataset
* add common dataset score_answer consistency test
2025-03-04 21:55:09 +01:00
Andreas Koepf
74f590e24f more native type hints 2025-02-21 21:23:14 +01:00
Andreas Koepf
ff5b210106 use native types List->list, Dict->dict, Set->set, Tuple->tuple 2025-02-21 15:15:38 +01:00
abdulhakeem
b2ca8016fb Fix formatting of added instructions 2025-02-13 21:26:58 -06:00
abdulhakeem
62a0d14355 Add useful instructions to question template of some datasets 2025-02-13 00:49:31 -06:00
Andreas Koepf
4e49806d22 add ArcAgiDataset class, fix score_entry() metadata params 2025-02-08 23:18:18 +01:00
joesharratt1229
7c02901ee3 added score_answer implementation and tests 2025-02-02 17:18:56 +00:00
joesharratt1229
a9ea2df7a0 added register dataset to script 2025-02-02 15:28:52 +00:00
joesharratt1229
ed1492ba05 added intermediate integration dataset generator 2025-02-02 15:27:08 +00:00