open-thought/reasoning-gym
1
0
Fork 0
mirror of https://github.com/open-thought/reasoning-gym.git synced 2026-04-24 17:05:03 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Game of Life partial scoring and rule-clarification (#258)

Browse source 
* partial scoring and rule clarification
* better ql scoring
* word seq reverse typos
This commit is contained in:
Rich Jones 2025-03-03 22:22:39 +01:00 • committed by GitHub
parent 340d6a7ab9
commit e3b7365f50
4 changed files with 60 additions and 9 deletions
Download patch file Download diff file Expand all files Collapse all files

4
reasoning_gym/graphs/quantum_lock.py
View file

@ -192,7 +192,9 @@ Buttons:
# Partial credit for reaching target (optional)
final_state = self.simulate_sequence(entry["metadata"], user_sequence)
if final_state == entry["metadata"]["target_value"]:
return 0.5 # Alternative scoring option
if len(user_sequence) == len(target_sequence):
return 1.0 # Different answer, but qually correct
return 0.5 # Alternative scoring - you're correct, but not optimal
return 0.1