38 commits

Author	SHA1	Message	Date
Jai Suphavadeeprasit	9ba6c0e7bb	ditching lora nccl	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	0dadc774ac	nccl loras 2	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	2501e33ae3	nccl loras	2026-02-13 11:26:25 -05:00
pre-commit-ci[bot]	11f495a381	[pre-commit.ci] auto fixes from pre-commit.com hooks ... for more information, see https://pre-commit.ci	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	93da3874e7	relative imports	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	e932369777	linting	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	d0b097974b	python versioning problems	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	bab3d85d85	python versioning problems	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	b8fb2b7950	python versioning problems	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	7a24857727	remove bloated endpoints	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	c8884348c7	cleanup	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	13a8e0204d	major refactor 2	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	e891a7f808	testing scripts	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	dc82124ce6	editing	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	83ebfe349f	editing	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	347f9ea363	hot swap adapter	2026-02-13 11:26:25 -05:00
pre-commit-ci[bot]	c86b36844b	[pre-commit.ci] auto fixes from pre-commit.com hooks ... for more information, see https://pre-commit.ci	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	c70635ef71	LORA 1	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	5c0ac94095	linter stuff	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	8250ba97bb	linter	2026-02-13 11:26:25 -05:00
pre-commit-ci[bot]	897ef4723c	[pre-commit.ci] auto fixes from pre-commit.com hooks ... for more information, see https://pre-commit.ci	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	729c308688	completions	2026-02-13 11:26:25 -05:00
pre-commit-ci[bot]	e1aca5ecf5	[pre-commit.ci] auto fixes from pre-commit.com hooks ... for more information, see https://pre-commit.ci	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	178ad95fe7	Bloat reduction	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	ca1ec60869	improve default	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	3ac4a64f6f	patching problem	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	3995e0af7d	monkey patch fixes	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	53b29472b4	changes based on torchtitan	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	078dd4a333	Cleanup	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	39e94c4278	weight updates async	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	b3874b658a	vllm underlying weights	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	b0d35be8a4	IPC updates	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	d978eff127	smol changes	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	db7414329b	generate endpoint with logprobs	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	e956af11a2	changes	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	7b143a7d68	correction	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	3ed23058c3	initial commit	2026-02-13 11:26:22 -05:00
Dakota	e6ac3abdcb	add managed vllm server	2025-11-07 13:06:49 -06:00