17 commits

Author	SHA1	Message	Date
Jai Suphavadeeprasit	b8120e8eae	completions	2026-03-02 11:18:52 -05:00
pre-commit-ci[bot]	fe2fd3d824	[pre-commit.ci] auto fixes from pre-commit.com hooks ... for more information, see https://pre-commit.ci	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	ab8d2f2dac	Bloat reduction	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	64cf8e3f82	improve default	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	fad8e77be2	patching problem	2026-03-02 11:18:52 -05:00
Jai Suphavadeeprasit	4348345dac	monkey patch fixes	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	27b122a415	changes based on torchtitan	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	67e27def11	Cleanup	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	9512177d0a	weight updates async	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	e033e24c64	vllm underlying weights	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	533f0bf286	IPC updates	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	c336d981ce	smol changes	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	f5c847d39d	generate endpoint with logprobs	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	2b240bbd2e	changes	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	2d3c07dcae	correction	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	61221dd1a2	initial commit	2026-03-02 11:18:49 -05:00
Dakota	e6ac3abdcb	add managed vllm server	2025-11-07 13:06:49 -06:00