Commit graph

1008 commits

Author SHA1 Message Date
Oliver
4bdb8c7d6b Add note on code execution to CodeIODataset 2025-02-25 22:39:06 +00:00
Oliver
ef2f8d1978 Move data file & load into memory on first object creation 2025-02-25 22:36:38 +00:00
Oliver
f895a458c7 Register CodeIODataset 2025-02-24 18:28:35 +00:00
Oliver
efbcfb6eed Initial scoring algo for codeio 2025-02-24 18:27:53 +00:00
Oliver
5a222a398b Add tiny sample dataset & efficient sampling 2025-02-24 17:58:31 +00:00
Oliver
7ff162e9bb Remove outdated comment 2025-02-23 22:24:13 +00:00
Oliver
c0923a6fb8 Add validation 2025-02-23 22:23:45 +00:00
Oliver
3a5dc2080f Merge branch 'main' into codeio-sampler 2025-02-23 20:28:06 +00:00
Oliver
40d7dfdb5f Add input prediction 2025-02-23 20:27:27 +00:00
Andreas Köpf
f68d7e533c Merge pull request #194 from open-thought/190_fix_arc_1d_out_of_range
minor arc_1d tweaks
2025-02-23 16:40:09 +01:00
Andreas Koepf
0a487030ec minor arc_1d tweaks 2025-02-23 16:37:40 +01:00
Andreas Köpf
b71a051f6a Merge pull request #193 from open-thought/190_fix_arc_1d_out_of_range
Fix index out of range for arc_1d dataset
2025-02-23 13:20:08 +01:00
Andreas Koepf
696769a3d6 remove unnecessary checks, use tuples 2025-02-23 13:17:48 +01:00
Andreas Koepf
f600c7eb30 add arc_1d size range test 2025-02-23 12:58:51 +01:00
Andreas Koepf
e444bbf7a1 fix index out of range of arc_1d dataset (#190) 2025-02-23 12:51:41 +01:00
Andreas Koepf
a1a305c8d7 dev minor version one ahead of PyPI released version 2025-02-22 16:54:05 +01:00
Andreas Köpf
5c73043a1e Merge pull request #176 from olliestanley/codeio-experiments
Experiments with CodeI/O techniques for synthesising reasoning data
2025-02-22 16:24:17 +01:00
Oliver
489dea7267 Draft CodeIO-derived reasoning problems dataset 2025-02-22 00:56:52 +00:00
Oliver
378cba2de1 Outline CodeIO dataset classes 2025-02-22 00:21:17 +00:00
Oliver
94cd3c4d43 Add steps to synthesize CoTs with DeepSeekV3 2025-02-21 23:36:19 +00:00
Oliver
3297fc1bc0 Improve prompt for better LLM adherence 2025-02-21 23:00:48 +00:00
Andreas Koepf
74f590e24f more native type hints 2025-02-21 21:23:14 +01:00
Andreas Köpf
ae26704d05 Merge pull request #185 from joesharratt1229/feat/emoji-mystery
Implements #173
2025-02-21 21:09:26 +01:00
Andreas Koepf
d27ec36c94 add markdown tripple backtick code block for emoji_mystry hint 2025-02-21 21:06:07 +01:00
Andreas Köpf
e41b86ec36 Merge branch 'main' into feat/emoji-mystery 2025-02-21 20:58:39 +01:00
Oliver
fc2c43b7d3 Prompt tweak 2025-02-21 18:34:13 +00:00
joesharratt1229
f7be02abfc added answer format spec in prompt 2025-02-21 18:03:05 +00:00
joesharratt1229
650387f748 added tests 2025-02-21 17:58:13 +00:00
joesharratt1229
425ae24f3b added emoji dataset 2025-02-21 17:57:41 +00:00
Oliver
c2b42d2717 Merge branch 'main' into codeio-experiments 2025-02-21 17:25:08 +00:00
Andreas Koepf
71ecc0cfca update GALLERY.md 2025-02-21 17:30:33 +01:00
Andreas Köpf
82839dec96 Merge pull request #181 from open-thought/rich/bitwise
Add Bitwise Arithmetic
2025-02-21 17:27:45 +01:00
Andreas Köpf
de362fb76f Merge pull request #182 from zafstojano/env/binary-alternation
feat(env): Binary Alternation
2025-02-21 17:27:16 +01:00
Andreas Koepf (aider)
5fb26fc709 fix: Handle negative hex number prefix variations in bitwise arithmetic test 2025-02-21 17:23:50 +01:00
Andreas Koepf (aider)
2abe783be4 test: Update bitwise arithmetic difficulty levels to [1, 2, 3] 2025-02-21 17:22:36 +01:00
Andreas Koepf (aider)
5b233ce9cc test: Add comprehensive unit tests for BitwiseArithmeticDataset 2025-02-21 17:21:00 +01:00
Andreas Koepf (aider)
5f9d5c0e0f docs: Add comment explaining automatic base detection in int() conversion 2025-02-21 17:16:11 +01:00
Andreas Koepf (aider)
196d236978 docs: Add detailed comments for BitwiseArithmeticConfig and BitwiseArithmeticDataset 2025-02-21 17:14:00 +01:00
Andreas Koepf
aa37fbc2cf refactor: Update type hints and remove unused imports in bitwise_arithmetic.py 2025-02-21 17:13:36 +01:00
Andreas Koepf (aider)
253fd55a00 feat: Add typing hints and improve difficulty parameter documentation in bitwise_arithmetic.py 2025-02-21 17:11:40 +01:00
Rich Jones
aaff230dff lint 2025-02-21 17:09:19 +01:00
Rich Jones
217771a1b0 ensure arbitrary bit depth and signed values 2025-02-21 16:52:26 +01:00
Andreas Köpf
32d319e291 Merge pull request #180 from Adefioye/list-functions
Add induction-based tasks for list functions
2025-02-21 16:20:49 +01:00
Andreas Köpf
d24293358e Merge pull request #184 from AhmedSaif2/main
fix parameter name in compute_decimal_reward docstring
2025-02-21 16:15:05 +01:00
AhmedSaif2
75cbfb8783 fix parameter name in compute_decimal_reward docstring 2025-02-21 17:01:59 +02:00
abdulhakeem
a5e3ae6528 clean up 2025-02-21 08:54:55 -06:00
Andreas Köpf
ee2d04439f Merge pull request #183 from open-thought/rich/rdmepolish
Enhance README friendliness
2025-02-21 15:45:56 +01:00
Andreas Köpf
6d22bb6f27 Merge pull request #179 from joesharratt1229/fix/prop_logix
Fix/prop logix
2025-02-21 15:43:13 +01:00
Andreas Koepf
222d5ebf94 reactivate default imports for PropositionalLogicDataset 2025-02-21 15:41:04 +01:00
Andreas Köpf
78b2b518d9 Merge branch 'main' into fix/prop_logix 2025-02-21 15:38:29 +01:00