mirror of
https://github.com/NousResearch/atropos.git
synced 2026-04-19 12:57:58 +00:00
readme language
This commit is contained in:
parent
1a3d9ee664
commit
c85a3e5ee7
1 changed files with 2 additions and 2 deletions
|
|
@ -10,13 +10,13 @@ For automatic token and logprob tracking, see the [ManagedServer Guide](MANAGED_
|
|||
|
||||
### Normalized `get_logprobs` API
|
||||
|
||||
`ManagedServer` and server backends expose a normalized `get_logprobs(...)` interface so callers can consume a single schema across backends:
|
||||
`ManagedServer` and supported server backends expose a normalized `get_logprobs(...)` interface so callers can consume a single schema:
|
||||
|
||||
- `prompt_tokens`
|
||||
- `prompt_topk_token_ids`
|
||||
- `prompt_topk_logprobs`
|
||||
|
||||
Backends must return real prompt top-k arrays. Missing keys or malformed shapes fail fast.
|
||||
Backends are expected to return real prompt top-k arrays (`[pos][k]`) matching this schema.
|
||||
|
||||
## Reasoning Model Support
|
||||
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue