5 commits

Author	SHA1	Message	Date
Andreas Köpf	bfa5f8078b	Eval N completions per prompt (#374) ... * feat: Add support for generating multiple completions per prompt * feat: Track best and mean scores for multiple completions per prompt * feat: Add checkpoint and resume functionality to evaluation script	2025-03-15 16:39:36 +01:00
Andreas Köpf	b4207162ff	Eval sampling settings for generation (temperature, top-p, max_tokens) (#242) ... * feat: Add sampling parameters to eval configuration and API call * feat: Add support for system_prompt_id and optional system_prompt configuration	2025-02-28 11:48:37 +01:00
Andreas Köpf	850c1cf6f4	Eval script consolidation (#238) ... The script now supports: - YAML and JSON configurations - Dataset-specific parameters - Overriding configuration via command line - Detailed logging and error handling	2025-02-27 17:39:14 +01:00
joesharratt1229	52c3c430b9	updated config and read me	2025-02-25 16:25:16 +00:00
joesharratt1229	046c46c0bb	updated read me	2025-02-25 15:46:43 +00:00

Renamed from eval/r1/eval_config.py (Browse further)