NousResearch/atropos
1
0
Fork 0
mirror of https://github.com/NousResearch/atropos.git synced 2026-04-22 16:48:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1
1164 commits 156 branches 4 tags 164 MiB
Commit graph

200 commits

Author SHA1 Message Date
balyan.sid@gmail.com
57fa229846 remove unused managed_server wrapper + tese 2026-01-14 17:09:57 +05:30
balyan.sid@gmail.com
6a27e88023 use managed server 2026-01-14 17:09:01 +05:30
balyan.sid@gmail.com
294b980625 add tests for AtroposManagedClient 2026-01-12 10:34:05 +05:30
balyan.sid@gmail.com
cf636595d2 rework server and eval for rl rollout. add in asyncmanagedserver for 
verifiers
 2026-01-12 10:34:05 +05:30
Dakota
8ec5066998 add eval runner 2025-12-19 19:56:59 -06:00
Ksenchi
6c843d6677
Update MANAGED_SERVER.md 2025-11-12 07:22:40 +01:00
Ksenchi
edf26d68e1
Update MANAGED_SERVER.md 2025-11-12 07:22:06 +01:00
Dhyaneesh DS
9000c10869
Merge branch 'main' into dump-evaluate-config-yaml 2025-11-11 00:47:30 +05:30
dmahan93
e2c9ff5e9c
Merge pull request #272 from ninastef/main 
refactor: Refactor scored data handling into reusable helper
 2025-11-10 09:37:29 -08:00
Dhyaneesh
39d5fb4452 feat: dump evaluate subcommand config to YAML in env save dir 
Automatically save the final merged evaluate configuration to evaluate_config.yaml
in the data_dir_to_save_evals directory. This includes env config, OpenAI/server
configs, and server manager settings, enabling reproducibility and easier
debugging of evaluation runs.

The config is saved after all merging (CLI args > YAML > defaults) to capture
the exact configuration used for the evaluation.
 2025-11-08 23:46:13 +05:30
dmahan93
b4080a4f37
Merge pull request #273 from NousResearch/add-vllm-manager-fn 
add managed vllm server
 2025-11-07 14:22:07 -08:00
Dakota
e6ac3abdcb add managed vllm server 2025-11-07 13:06:49 -06:00
pre-commit-ci[bot]
9bef7a1b46 [pre-commit.ci] auto fixes from pre-commit.com hooks 
for more information, see https://pre-commit.ci
 2025-11-07 18:10:40 +00:00
Nina
722385e715
Update server.py 2025-11-07 19:06:03 +01:00
Nina
b3feae5eef
Update server.py 2025-11-07 19:03:54 +01:00
Nina
74b5412c2b
Update server.py 2025-11-07 19:02:26 +01:00
Nina
16a40a5617
Update server.py 2025-11-07 19:01:48 +01:00
Nina
97107ca868
Update server.py 2025-11-07 19:01:09 +01:00
Nina
a5a8b07848
Update server.py 2025-11-07 19:00:32 +01:00
dmahan93
c96b8a1255
Merge pull request #267 from bobtajson/main 
fix: correct typo and improve code quality
 2025-11-06 18:36:37 -08:00
dmahan93
b1e164eef5
Merge pull request #264 from NousResearch/add-logprob-server-manager-fn 
add sglang specific token level logprob handling and server manager/b…
 2025-10-29 13:53:39 -07:00
Dakota
578175a709 fix pre-commit 2025-10-29 14:47:50 -05:00
Dakota
3c8fc32288 fix test case 2025-10-29 14:38:16 -05:00
Dakota
5d6d6bb0dc add docs :) 2025-10-29 11:26:43 -05:00
Dakota
c3a118f50d fix tests 2025-10-29 10:55:10 -05:00
Dakota
d5400460e8 made masked logprobs coherently decided on 2025-10-29 10:52:38 -05:00
Dakota
e57c396f86 ran pre-commit 2025-10-29 10:45:27 -05:00
Dakota
17bb7bdf15 revert base.py 2025-10-29 10:11:05 -05:00
dmahan93
c483840f59 set prompt logprobs to a masked value 2025-10-26 11:58:55 -07:00
dmahan93
c22f8ca81b Merge remote-tracking branch 'origin/add-logprob-server-manager-fn' into add-logprob-server-manager-fn 2025-10-24 23:18:37 -07:00
dmahan93
5d662bf1aa add chat example and fix bug in managed_server 2025-10-24 23:15:56 -07:00
pre-commit-ci[bot]
0d80da5146 [pre-commit.ci] auto fixes from pre-commit.com hooks 
for more information, see https://pre-commit.ci
 2025-10-24 20:10:29 +00:00
dmahan93
7bf4cfbf80 add managed server to make grabbing logprobs easier w/ tokenized items 2025-10-24 13:09:46 -07:00
bobtajson
6e2d36bd2a
Update base.py 2025-10-23 10:27:23 +02:00
bobtajson
59ad9643d6
Update type_definitions.py 2025-10-23 10:26:51 +02:00
bobtajson
3157e6d7e8
Update metrics.py 2025-10-23 10:26:21 +02:00
bobtajson
16c6897b21
Update metrics.py 2025-10-23 10:26:03 +02:00
bobtajson
fd5483d510
Update metrics.py 2025-10-23 10:25:23 +02:00
pre-commit-ci[bot]
312f8859e3 [pre-commit.ci] auto fixes from pre-commit.com hooks 
for more information, see https://pre-commit.ci
 2025-10-16 18:47:07 +00:00
Dakota
d240dbb3b7 Merge remote-tracking branch 'origin/add-logprob-server-manager-fn' into add-logprob-server-manager-fn 2025-10-16 13:46:03 -05:00
Dakota
134cbc09d0 update openai/trl_vllm server with new fn 2025-10-16 13:45:55 -05:00
pre-commit-ci[bot]
1e6a745491 [pre-commit.ci] auto fixes from pre-commit.com hooks 
for more information, see https://pre-commit.ci
 2025-10-16 17:39:04 +00:00
Dakota
c36ec29656 add sglang specific token level logprob handling and server manager/baseline logprob/token fn 2025-10-16 12:38:03 -05:00
pre-commit-ci[bot]
0840c26e94 [pre-commit.ci] auto fixes from pre-commit.com hooks 
for more information, see https://pre-commit.ci
 2025-10-15 04:19:25 +00:00
ropresearch
e5b8fb8654 clean up 2025-10-10 11:50:39 -04:00
ropresearch
baf4b2d8a8 gzip compression for atropos api 2025-10-10 01:26:52 -04:00
dmahan93
36243bd3f4
Merge pull request #253 from NousResearch/rop/gen-params 
group temps, sample temps, and logprob api params
 2025-10-01 12:58:03 -05:00
ropresearch
6a20b90549 added gen params for latest examples endpoint 2025-10-01 13:05:37 -04:00
ropresearch
b9ecb0cc7f docs update 2025-09-25 17:00:05 -04:00
ropresearch
c3fc68879c group temps, sample temps, and logprob api params 2025-09-25 16:41:58 -04:00