19 commits

Author	SHA1	Message	Date
Zafir Stojanovski	a23c8c3d4e	sentence reordering curriculum (#326)	2025-03-11 00:21:41 +01:00
Andreas Köpf	5d7fbac0ad	Minor question template & score_answer improvements (#261) ... * math prompt improvements * ignore brackets in complex_arithmetic results * improve additional instruction in prompt of polynomial_equations * more strict tests for score_answer in polynomial_equations * simplify special reward handling * fix test_intermediate_integration * fix sokoban dataset * add common dataset score_answer consistency test	2025-03-04 21:55:09 +01:00
Andreas Koepf	eeb9fa31d5	more native type hints	2025-02-21 21:23:14 +01:00
Andreas Koepf	3e7ff3b084	use native types List->list, Dict->dict, Set->set, Tuple->tuple	2025-02-21 15:15:38 +01:00
Andreas Koepf	4c47b7966f	ensure reward is float	2025-02-16 16:27:12 +01:00
Andreas Koepf	44f8d7b6af	formatting	2025-02-16 16:18:39 +01:00
joesharratt1229	e80f44d75a	added custom score answer func	2025-02-16 13:10:03 +00:00
Andreas Köpf	3f6b2fc807	Add Coaching & ScoreBoard class (result tracking) (#72) ... * feat: Add Coach and ScoreBoard classes for performance tracking and difficulty adjustment * feat: Add GroupedScores class to wrap aggregated scores * refactor: Create ScoreStats class with tuple-based score statistics * feat: Add unit test for Coach with CompositeDataset and multiple datasets * fix: Add difficulty metadata to leg counting dataset * feat: Add clear() method to ScoreBoard to reset all stored data * feat: Add __len__ method to ScoreBoard to return number of scores * feat: Add update_dataset_config method to CompositeDataset * cleanup __init__ & imports	2025-02-06 23:15:28 +01:00
Andreas Koepf	ecbb155184	fix unit tests, lower python dependency to 3.9	2025-01-26 16:55:17 +01:00
Andreas Koepf (aider)	49533e10ad	refactor: Update default sentence length constraints to 3-20 words	2025-01-26 15:57:02 +01:00
Andreas Koepf (aider)	b03b02f3a5	refactor: Update sentence extraction regex to preserve ending punctuation	2025-01-26 15:56:03 +01:00
Andreas Koepf (aider)	fa9465e6a9	refactor: Rename num_of_words_in_sentence and add max_words_in_sentence config	2025-01-26 15:46:21 +01:00
Andreas Koepf	9abea574ed	refactor: Update sentence reordering prompt to be more descriptive	2025-01-26 15:46:19 +01:00
abdulhakeem	03d4a5d8ac	Make more tiny correction	2025-01-25 23:25:55 -06:00
abdulhakeem	acc3f5269a	Correct logic for number of words in sentence	2025-01-25 23:22:16 -06:00
abdulhakeem	05004b7a51	Add parameters to _generate_sentence_dataset	2025-01-25 23:17:39 -06:00
abdulhakeem	9d025b43fa	Ensure only words are considered	2025-01-25 23:08:41 -06:00
abdulhakeem	d00856cab4	Add assertion to ensure number of words in sentence is positive	2025-01-25 23:02:17 -06:00
abdulhakeem	09634db2cf	Add sentence reordering and unit tests to validate it	2025-01-25 22:52:35 -06:00