12 commits

Author	SHA1	Message	Date
Jai Suphavadeeprasit	4348345dac	monkey patch fixes	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	27b122a415	changes based on torchtitan	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	67e27def11	Cleanup	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	9512177d0a	weight updates async	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	e033e24c64	vllm underlying weights	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	533f0bf286	IPC updates	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	c336d981ce	smol changes	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	f5c847d39d	generate endpoint with logprobs	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	2b240bbd2e	changes	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	2d3c07dcae	correction	2026-03-02 11:18:51 -05:00
Jai Suphavadeeprasit	61221dd1a2	initial commit	2026-03-02 11:18:49 -05:00
Dakota	e6ac3abdcb	add managed vllm server	2025-11-07 13:06:49 -06:00