open-thought/reasoning-gym
1
0
Fork 0
mirror of https://github.com/open-thought/reasoning-gym.git synced 2026-04-25 17:10:51 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

feat: Add fallback to first non-None model answer when best_answer is unset

Browse source
This commit is contained in:
Andreas Koepf (aider) 2025-03-15 16:52:50 +01:00
parent 424ee6751a
commit a829707408
1 changed files with 5 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

5
eval/eval.py
View file

@ -430,6 +430,11 @@ class AsyncModelEvaluator:
best_score = score
best_answer = model_answer
best_response = response
# If we don't have a best answer yet, use the first non-None answer
elif best_answer is None and model_answer is not None:
best_answer = model_answer
best_response = response
best_score = score
total_score += score