NousResearch/atropos
1
0
Fork 0
mirror of https://github.com/NousResearch/atropos.git synced 2026-04-24 17:04:55 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

prompt logprobs simplicity

Browse source
This commit is contained in:
Jai Suphavadeeprasit 2026-03-03 22:06:49 -05:00
parent f1c20591b6
commit 5aaf7a346c
5 changed files with 69 additions and 69 deletions
Download patch file Download diff file Expand all files Collapse all files

2
atroposlib/envs/server_handling/README.md
View file

@ -16,7 +16,7 @@ For automatic token and logprob tracking, see the [ManagedServer Guide](MANAGED_
- `prompt_topk_token_ids`
- `prompt_topk_logprobs`
For backends that only expose sampled-token logprobs, prompt top-k arrays are synthesized with `k=1` for interface compatibility.
Strict mode: backends must return real prompt top-k arrays. Missing keys or malformed shapes fail fast.
## Reasoning Model Support