Commit graph

1010 commits

Author SHA1 Message Date
Andreas Koepf
7f30e711e5 reactivate default imports for PropositionalLogicDataset 2025-02-21 15:41:04 +01:00
Andreas Köpf
802b8c4bed
Merge branch 'main' into fix/prop_logix 2025-02-21 15:38:29 +01:00
Andreas Köpf
b59ccdefa2
Merge pull request #178 from olliestanley/feature/unsloth-train
Add minimal working GRPO training example with Unsloth
2025-02-21 15:37:24 +01:00
Andreas Köpf
a6a5d30f1c
Merge pull request #175 from AhmedSaif2/fix-format
Add score_answer function to handle comma-formatted numbers
2025-02-21 15:36:21 +01:00
Andreas Koepf
acde58a200 use Decimal class for numeric comparison e.g. +0123.100 == 123.1 2025-02-21 15:36:06 +01:00
Andreas Koepf
3e7ff3b084 use native types List->list, Dict->dict, Set->set, Tuple->tuple 2025-02-21 15:15:38 +01:00
Rich Jones
0d84a8ecf5 fix mkd 2025-02-21 15:14:36 +01:00
Rich Jones
0730664eb6 link to eval readme 2025-02-21 15:13:29 +01:00
Rich Jones
84583b450a edits 2025-02-21 15:09:11 +01:00
Rich Jones
2cb395ba30 polish readme a bit 2025-02-21 15:04:04 +01:00
AhmedSaif2
5d02064b5a add a helper function to handle redundant code 2025-02-21 15:54:00 +02:00
AhmedSaif2
5c45e55340 extend format tests to allow questions that ends with question marks 2025-02-21 15:50:03 +02:00
Zafir Stojanovski
77789257d3 include pre-parsed responses in json 2025-02-21 13:50:48 +01:00
Zafir Stojanovski
96464388bb pre-commit 2025-02-21 13:39:05 +01:00
Zafir Stojanovski
941085e0c5 binary alternation 2025-02-21 13:09:21 +01:00
Rich Jones
b6c7ceabb2 clean up comments 2025-02-21 12:17:21 +01:00
Rich Jones
ee9202d63d add to init 2025-02-21 12:07:17 +01:00
Rich Jones
17088e9b42 add bitwise arithmetic 2025-02-21 12:02:41 +01:00
abdulhakeem
13a696979f Remove play file 2025-02-21 00:51:04 -06:00
abdulhakeem
624594bb1a Commit more changes 2025-02-21 00:37:29 -06:00
joesharratt1229
5fb655e390 moved trivial check 2025-02-21 00:20:00 +00:00
joesharratt1229
39ee099a86 reimplemented prop logic 2025-02-20 23:59:31 +00:00
joesharratt1229
ed10c5f9bc added testing func for prop logic 2025-02-20 23:59:07 +00:00
Oliver
f16dd9a7d4 Better progress tracking 2025-02-20 23:32:54 +00:00
Oliver
90547f30c7 Set log level 2025-02-20 22:36:07 +00:00
Oliver
e50444b924 Add requirements for Unsloth example 2025-02-20 22:29:13 +00:00
Oliver
29d116b034 Call for_inference before eval 2025-02-20 22:27:33 +00:00
Oliver
a01110aa7c Add eval 2025-02-20 22:18:52 +00:00
Andreas Koepf
bedee59616 fix jugs unit test 2025-02-20 23:09:46 +01:00
Oliver
e26161713e Answer scoring fixes to address edge cases 2025-02-20 22:04:01 +00:00
Andreas Koepf
f1daa8d1da update GALLERY.my, bump version 2025-02-20 23:03:54 +01:00
Oliver
8bd18f5387 Add minimal unsloth GRPO example 2025-02-20 22:03:40 +00:00
Andreas Köpf
cd1a989530
Merge pull request #177 from zafstojano/env/rotten-oranges
feat(env): Rotten Oranges
2025-02-20 22:51:14 +01:00
Andreas Köpf
000e179781
Merge branch 'main' into env/rotten-oranges 2025-02-20 22:51:07 +01:00
Andreas Köpf
a8ce2747c1
Merge pull request #172 from open-thought/rich/jugs
Add Water Jug Puzzles
2025-02-20 22:48:12 +01:00
Andreas Koepf
c236bcf1b6 store possible answer in entry 'answer' field 2025-02-20 22:47:21 +01:00
Andreas Koepf (aider)
9068e1d1b1 docs: Add descriptive comments for num_jugs and difficulty parameters 2025-02-20 22:39:22 +01:00
Andreas Koepf (aider)
ece040a0d0 feat: Add type hints to generate_puzzle and min_moves_n functions 2025-02-20 22:38:11 +01:00
Andreas Koepf
d7db2ed838 refactor: Simplify jug puzzle dataset generation and solution verification 2025-02-20 22:38:10 +01:00
Zafir Stojanovski
8709ec1ca3 remove empty space 2025-02-20 22:35:53 +01:00
Zafir Stojanovski
0d65bf3668 rotten oranges 2025-02-20 22:33:39 +01:00
Andreas Köpf
994ffa8459
Merge pull request #170 from open-thought/rich/needle
Adds Needle in a Haystack problems
2025-02-20 22:12:47 +01:00
Oliver
b7ee70995e Prompt tweak for code preprocessing 2025-02-20 20:07:32 +00:00
Oliver
6f9b81b879 Add initial CodeI/O experiment notebook 2025-02-20 20:03:36 +00:00
AhmedSaif2
73dfaa7f58 remove added instructions 2025-02-20 21:29:01 +02:00
AhmedSaif2
dcdef3f9ec Add score answer to support comma format 2025-02-20 20:52:31 +02:00
Rich Jones
2188c53308 wiggle imports 2025-02-20 16:23:40 +01:00
Rich Jones
0f798457ed jugs jugs jugs lint 2025-02-20 16:15:29 +01:00
Rich Jones
6f00690ae1 basic jugs 2025-02-20 15:24:46 +01:00
Rich Jones
39b739917e move assert to config 2025-02-20 12:45:09 +01:00