14 commits

Author	SHA1	Message	Date
Jai Suphavadeeprasit	ca1ec60869	improve default	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	3ac4a64f6f	patching problem	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	3995e0af7d	monkey patch fixes	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	53b29472b4	changes based on torchtitan	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	078dd4a333	Cleanup	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	39e94c4278	weight updates async	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	b3874b658a	vllm underlying weights	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	b0d35be8a4	IPC updates	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	d978eff127	smol changes	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	db7414329b	generate endpoint with logprobs	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	e956af11a2	changes	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	7b143a7d68	correction	2026-02-13 11:26:25 -05:00
Jai Suphavadeeprasit	3ed23058c3	initial commit	2026-02-13 11:26:22 -05:00
Dakota	e6ac3abdcb	add managed vllm server	2025-11-07 13:06:49 -06:00