NousResearch/atropos
1
0
Fork 0
mirror of https://github.com/NousResearch/atropos.git synced 2026-04-22 16:48:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

prompt logprobs

Browse source
This commit is contained in:
Jai Suphavadeeprasit 2026-03-03 21:56:11 -05:00
parent e98100e5f6
commit 439b9b129b
7 changed files with 73 additions and 138 deletions
Download patch file Download diff file Expand all files Collapse all files

8
atroposlib/envs/server_handling/README.md
View file

@ -13,13 +13,11 @@ For automatic token and logprob tracking, see the [ManagedServer Guide](MANAGED_
`ManagedServer` and server backends now expose a normalized `get_logprobs(...)` interface so callers can consume a single schema across backends:
- `prompt_tokens`
- `sequence_token_ids`
- `sequence_logprobs`
- `sequence_topk_token_ids`
- `sequence_topk_logprobs`
- `prompt_topk_token_ids`
- `prompt_topk_logprobs`
- `finish_reasons`
For backends that only expose sampled-token logprobs, top-k arrays are synthesized with `k=1` for interface compatibility.
For backends that only expose sampled-token logprobs, prompt top-k arrays are synthesized with `k=1` for interface compatibility.
## Reasoning Model Support