mirror of
https://github.com/NousResearch/atropos.git
synced 2026-04-24 17:04:55 +00:00
prompt logprobs
This commit is contained in:
parent
439b9b129b
commit
f1c20591b6
3 changed files with 0 additions and 4 deletions
|
|
@ -15,7 +15,6 @@ For automatic token and logprob tracking, see the [ManagedServer Guide](MANAGED_
|
|||
- `prompt_tokens`
|
||||
- `prompt_topk_token_ids`
|
||||
- `prompt_topk_logprobs`
|
||||
- `finish_reasons`
|
||||
|
||||
For backends that only expose sampled-token logprobs, prompt top-k arrays are synthesized with `k=1` for interface compatibility.
|
||||
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue