mirror of
https://github.com/NousResearch/atropos.git
synced 2026-04-24 17:04:55 +00:00
fixing comments
This commit is contained in:
parent
51088ac24d
commit
1eeb31065f
6 changed files with 21 additions and 81 deletions
|
|
@ -10,13 +10,13 @@ For automatic token and logprob tracking, see the [ManagedServer Guide](MANAGED_
|
|||
|
||||
### Normalized `get_logprobs` API
|
||||
|
||||
`ManagedServer` and server backends now expose a normalized `get_logprobs(...)` interface so callers can consume a single schema across backends:
|
||||
`ManagedServer` and server backends expose a normalized `get_logprobs(...)` interface so callers can consume a single schema across backends:
|
||||
|
||||
- `prompt_tokens`
|
||||
- `prompt_topk_token_ids`
|
||||
- `prompt_topk_logprobs`
|
||||
|
||||
Strict mode: backends must return real prompt top-k arrays. Missing keys or malformed shapes fail fast.
|
||||
Backends must return real prompt top-k arrays. Missing keys or malformed shapes fail fast.
|
||||
|
||||
## Reasoning Model Support
|
||||
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue