4 commits

Author	SHA1	Message	Date
Zafir Stojanovski	dced3bfc45	fix(curriculum): Make boundaries in curriculum more sensible (#407) ... * init * fix tests * unify codeio * filtered for libraries not present in reasoning-gym * fix more bounds * puzzle24 * knight swap curriculum * fix number sorting * fix attributes * add validation of config in creation of dataset * dry run for instantiating and validating the datasets * remove unused imports * fix curriculum tests to reference newly updated attribute names	2025-04-04 20:24:14 +02:00
Andreas Köpf	bfa5f8078b	Eval N completions per prompt (#374) ... * feat: Add support for generating multiple completions per prompt * feat: Track best and mean scores for multiple completions per prompt * feat: Add checkpoint and resume functionality to evaluation script	2025-03-15 16:39:36 +01:00
Andreas Koepf	4109b5b72c	update eval yaml config files	2025-03-10 00:48:32 +01:00
Andreas Köpf	5b8d1b5175	Generate eval config tool (#240) ... * feat: Add generate_config.py script to create eval configurations	2025-02-27 21:40:53 +01:00