prompt logprobs

This commit is contained in:
Jai Suphavadeeprasit 2026-03-03 21:57:52 -05:00
parent 439b9b129b
commit f1c20591b6
3 changed files with 0 additions and 4 deletions

View file

@ -15,7 +15,6 @@ For automatic token and logprob tracking, see the [ManagedServer Guide](MANAGED_
- `prompt_tokens`
- `prompt_topk_token_ids`
- `prompt_topk_logprobs`
- `finish_reasons`
For backends that only expose sampled-token logprobs, prompt top-k arrays are synthesized with `k=1` for interface compatibility.