43 commits

Author	SHA1	Message	Date
Jai Suphavadeeprasit	fae87dcaaa	clean vllm tonight	2026-03-23 11:28:40 -07:00
Jai Suphavadeeprasit	322e7e6623	remove comments	2026-03-13 13:30:04 -04:00
pre-commit-ci[bot]	d1b0dee8f7	[pre-commit.ci] auto fixes from pre-commit.com hooks ... for more information, see https://pre-commit.ci	2026-03-13 15:14:09 +00:00
Jai Suphavadeeprasit	98a5d3b334	testing config	2026-03-13 11:06:02 -04:00
Jai Suphavadeeprasit	4f33ab8bf4	apparently not so easy	2026-03-13 11:04:57 -04:00
Jai Suphavadeeprasit	eb123f9596	ditching lora nccl	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	a05a7dc276	nccl loras 2	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	c33f9170c3	nccl loras	2026-03-02 11:18:52 -05:00
pre-commit-ci[bot]	5cfd1929f1	[pre-commit.ci] auto fixes from pre-commit.com hooks ... for more information, see https://pre-commit.ci	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	19248ed5b4	relative imports	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	238602e855	linting	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	04f2850980	python versioning problems	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	db5eba8fd2	python versioning problems	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	00649296a1	python versioning problems	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	4f6f2faac8	remove bloated endpoints	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	672cdbaea8	cleanup	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	3a1229afaf	major refactor 2	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	be16a2914d	testing scripts	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	278ece37d7	editing	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	917e9811f0	editing	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	29327c0605	hot swap adapter	2026-03-02 11:18:52 -05:00
pre-commit-ci[bot]	d288456535	[pre-commit.ci] auto fixes from pre-commit.com hooks ... for more information, see https://pre-commit.ci	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	3f69da5248	LORA 1	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	51e4640c69	linter stuff	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	412aaef2ba	linter	2026-03-02 11:18:52 -05:00
pre-commit-ci[bot]	d4589e1107	[pre-commit.ci] auto fixes from pre-commit.com hooks ... for more information, see https://pre-commit.ci	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	b8120e8eae	completions	2026-03-02 11:18:52 -05:00
pre-commit-ci[bot]	fe2fd3d824	[pre-commit.ci] auto fixes from pre-commit.com hooks ... for more information, see https://pre-commit.ci	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	ab8d2f2dac	Bloat reduction	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	64cf8e3f82	improve default	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	fad8e77be2	patching problem	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	4348345dac	monkey patch fixes	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	27b122a415	changes based on torchtitan	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	67e27def11	Cleanup	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	9512177d0a	weight updates async	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	e033e24c64	vllm underlying weights	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	533f0bf286	IPC updates	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	c336d981ce	smol changes	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	f5c847d39d	generate endpoint with logprobs	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	2b240bbd2e	changes	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	2d3c07dcae	correction	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	61221dd1a2	initial commit	2026-03-02 11:18:49 -05:00
Dakota	e6ac3abdcb	add managed vllm server	2025-11-07 13:06:49 -06:00