Zafir Stojanovski
|
a969d8ef05
|
feat(curriculum): Knights and Knaves configs (#488)
* configs
* reduce complexity of curriculum
* update lower bound
* add failure threshold
* update last_k
* update thresholds for success and failure
* update curriculum file as well
* update run name for noncurriculum
* lint
* dtype model eval
* return binary scoring
* set eval repeats to 3
* fix tests
|
2025-07-31 10:18:05 +02:00 |
|
Oliver Stanley
|
add527ada1
|
update training dir with external eval details (#437)
* added games
* added llama 3b training conf
* update readme with details of external evals
* readme update
---------
Co-authored-by: joesharratt1229 <joesharratt1229@gmail.com>
|
2025-05-19 00:35:41 +02:00 |
|
Oliver Stanley
|
85f3c6dd02
|
updated inter-domain generalisation eval configs (#432)
* tweak eval configs
* add eval configs
* add eval config
|
2025-05-15 09:08:16 +02:00 |
|
joesharratt1229
|
73e3cb33a4
|
Added games training and evaluation configuration (#426)
* added games
* Update eval_games_composite.yaml
* Delete training/evaluations/eval_qwen_3b.yaml
* Add files via upload
* Delete training/evaluations/eval_algebraic_composite.yaml
* Delete training/evaluations/eval_algorithmic_composite.yaml
* Delete training/evaluations/eval_arithmetic_composite.yaml
* Delete training/evaluations/eval_cognition_composite.yaml
* Delete training/evaluations/eval_games_composite.yaml
|
2025-04-26 19:45:32 +01:00 |
|
Oliver Stanley
|
10863ea12b
|
inter-domain generalisation evaluation configs (#424)
* add inter-domain generalisation eval config for algebra
* add algorithmic eval cfg
* vllm infer
* add arithmetic eval cfg
* add geometry eval cfg
* add arc cfg
* add games eval cfg
* add cognition eval cfg
* add graphs eval cfg
|
2025-04-22 17:32:35 +01:00 |
|
joesharratt1229
|
d0ef136d5b
|
Feat/intragen experiments (#414)
* added curriculum
* readapted readme
* corrected small errors
* Delete eval/eval/r1/algorithmic/word_sorting.json
* removed redundant argument
* added spell
* removed duplicated fit
* changed config
* added composite changes
* added composite changes
* updated yaml
* added spell backward
* updated read me
* added qwen2.5
* added
* Add files via upload
* updated missing trainer func
* updated curr
* updated spell back
* updated correctness score func
* updated configs
* added local evals
* added updates
* updated datasets
* added fsdp to hf utility
* added algorithmic qwen 3b yaml
* updated read me
* updated configs
* added preappend token
* updated with thinking token
* updated test score board
* resolved comments
* added evaluation scripts
* removed results from pr
* added config
* added partial reward scoring
* added evaluation composites
* added training configs
* added games eval
* added rubriks cube
* resolved merge cinflicts
* added games config
* added latest eval configs
* updated strucutre
* Delete training/evaluations/eval_graphs_composite.yaml
---------
Co-authored-by: joesharratt1229 <joesharrat1229@gmail.com>
|
2025-04-16 08:04:52 +02:00 |
|
joesharratt1229
|
43c739cb3e
|
Feat/curr adj (#394)
|
2025-04-02 06:39:14 +01:00 |
|