69 commits

Author	SHA1	Message	Date
Dakota	11f1303da0	add error logging to collect_trajectories so they don't fail silently	2025-08-15 16:34:21 -05:00
pre-commit-ci[bot]	3d2d9e67fa	[pre-commit.ci] auto fixes from pre-commit.com hooks ... for more information, see https://pre-commit.ci	2025-07-15 11:42:46 +00:00
Alexey Gorbatovski	53984580c8	Bug fix	2025-07-15 14:37:55 +03:00
hjc-puro	72210cf4ad	rename fn	2025-07-11 04:04:55 +00:00
hjc-puro	d133ba3867	comment	2025-07-11 03:54:03 +00:00
hjc-puro	ccb8eaf230	move table to util	2025-07-11 03:52:24 +00:00
hjc-puro	5e61331360	simplify schema	2025-07-11 03:49:49 +00:00
hjc-puro	290e087fc5	remove some imports	2025-07-11 03:25:10 +00:00
hjc-puro	68da3809e2	move table to display util	2025-07-11 02:06:56 +00:00
hjc-puro	3e08c6d788	simplify schema	2025-07-11 00:52:09 +00:00
hjc-puro	6c64df0226	remove jsonlines dependency	2025-07-11 00:42:55 +00:00
hjc-puro	da0d64ae89	linting errors	2025-07-11 00:29:57 +00:00
hjc-puro	e601251893	gsm8k eval example	2025-07-11 00:22:36 +00:00
hjc-puro	eb926dc58b	working evals	2025-07-10 01:45:21 +00:00
hjc-puro	f4de3ad6f5	add printing	2025-07-09 23:35:26 +00:00
hjc-puro	a11af27298	add eval saving cli args	2025-07-09 03:12:13 +00:00
hjc-puro	5519f190d2	add evaluate subcommand to cli	2025-07-07 17:39:33 -04:00
dmahan93	58446dbcb1	Merge pull request #204 from NousResearch/multienv-enforce-mins ... Multienv with enforced minimum samples in a batch	2025-07-07 08:53:43 -05:00
Dakota	08e14cc745	feat: add minimum batch allocation support for environments ... - Add min_batch_allocation parameter to ensure environments contribute minimum proportion to each batch - Implement grab_batch_with_minimum_allocations function with proper scaling when allocations exceed 100% - Add mixed-size group buffering to handle variable-sized data submissions - Update server to use minimum allocation logic when any env has min_batch_allocation set - Add comprehensive tests for minimum allocation scenarios - Update documentation in API README and CONFIG.md - Update example environments to demonstrate the feature This feature allows critical environments to guarantee they contribute at least a specified proportion (0.0-1.0) to each training batch, ensuring important data sources are always represented during training. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>	2025-07-07 08:50:28 -05:00
pre-commit-ci[bot]	ee5257522a	[pre-commit.ci] auto fixes from pre-commit.com hooks ... for more information, see https://pre-commit.ci	2025-07-04 14:34:37 +00:00
Alexey Gorbatovski	14c70c0e68	Include run name in wandb initialization in BaseEnv	2025-07-04 17:13:34 +03:00
Dakota	683559afd2	allow inf (<= 0 max_token_len) generations if trainer requests it, but raise a warning so that users can check their logs and get info if their trainers are doing something weird	2025-07-01 09:52:10 -05:00
crStiv	e9a547ce32	Update base.py	2025-06-19 22:52:26 +02:00
Dakota	f3bbc6a42d	Fix import ordering with isort ... - Move typing_extensions import to proper location - Satisfy pre-commit isort requirements	2025-06-04 10:40:41 -05:00
Dakota	0ff55bf2cf	Fix TypedDict import for Python 3.10 compatibility ... - Use typing_extensions.TypedDict instead of typing.TypedDict - Fixes Pydantic error on Python < 3.12	2025-06-04 10:37:51 -05:00
hjc-puro	b5e7746c99	remove process defaults, respect config init	2025-06-02 21:19:45 -04:00
dmahan93	4a21ed0891	Enhance ScoredData model and API documentation ... - Added optional fields: advantages, messages, and images to the ScoredData model. - Updated API responses to include these new fields when no data is available. - Revised README.md to reflect changes in the API structure and response format.	2025-06-02 17:28:25 -05:00
Shannon Sands	2eddcb3cd9	fu linting	2025-05-23 11:18:16 +10:00
Shannon Sands	d98f65f444	linting	2025-05-23 11:09:06 +10:00
Shannon Sands	606a2615f0	loop check	2025-05-23 11:05:08 +10:00
Shannon Sands	00dd120067	Merge branch 'main' into blackjack2-env	2025-05-14 17:27:44 -07:00
dmahan93	e2128b817e	restructure config_init...	2025-05-13 10:00:45 -05:00
dmahan93	df62979b90	refactor to not mess up process...	2025-05-13 09:22:07 -05:00
dmahan93	96be544228	Merge commit '71e7a5ca27' into add-support-for-custom-api-servers	2025-05-12 18:40:35 -05:00
Shannon Sands	36f6822d71	Merge branch 'main' into blackjack2-env	2025-05-13 07:54:04 +10:00
dmahan93	706097db21	Merge pull request #36 from NousResearch/add-gym-frozen-lake-example ... add gym taxi env	2025-05-12 08:49:11 -05:00
Shannon Sands	101cbdd803	Merge branch 'main' into blackjack2-env	2025-05-12 07:22:24 +10:00
hjc-puro	e68df555ba	use parse_http_rseponse	2025-05-10 05:12:08 -04:00
hjc-puro	a659217afe	Merge branch 'main' into 2025-05-03-http-error-logging	2025-05-10 17:09:22 +08:00
dmahan93	92428fec8f	add gym taxi env	2025-05-09 19:05:01 -05:00
Shannon Sands	4d0f919fd1	linting	2025-05-10 09:10:31 +10:00
Shannon Sands	6c6a1c5d06	update handle_send_to_api	2025-05-10 09:07:54 +10:00
dmahan93	40b12dae60	run pre-commit on all files	2025-05-09 09:54:20 -05:00
hjc-puro	629d8c1731	Merge pull request #14 from NousResearch/2025-05-02-server-cli	2025-05-09 13:37:54 +08:00
dmahan93	70cf61c210	add custom server support	2025-05-08 12:01:49 -05:00
dmahan93	61af36b226	Update base.py	2025-05-08 11:53:15 -05:00
dmahan93	1848c7d453	Update base.py	2025-05-08 11:29:29 -05:00
hjc-puro	9415cadc53	fix cls name	2025-05-08 06:54:43 -07:00
hjc-puro	cdf5a9baa9	remove ,	2025-05-07 15:22:01 -04:00
hjc-puro	0373005175	forgot to condition on is ServerBaseline instance	2025-05-07 15:09:34 -04:00