readme language

This commit is contained in:
Jai Suphavadeeprasit 2026-03-03 23:44:29 -05:00
parent 1a3d9ee664
commit c85a3e5ee7

View file

@ -10,13 +10,13 @@ For automatic token and logprob tracking, see the [ManagedServer Guide](MANAGED_
### Normalized `get_logprobs` API
`ManagedServer` and server backends expose a normalized `get_logprobs(...)` interface so callers can consume a single schema across backends:
`ManagedServer` and supported server backends expose a normalized `get_logprobs(...)` interface so callers can consume a single schema:
- `prompt_tokens`
- `prompt_topk_token_ids`
- `prompt_topk_logprobs`
Backends must return real prompt top-k arrays. Missing keys or malformed shapes fail fast.
Backends are expected to return real prompt top-k arrays (`[pos][k]`) matching this schema.
## Reasoning Model Support