balyan.sid@gmail.com
49687304ef
fix verifiers conflict
2026-01-12 10:34:05 +05:30
balyan.sid@gmail.com
9db6c0d1ed
added better wandb logging
2026-01-12 10:34:05 +05:30
balyan.sid@gmail.com
dceb1d8fd8
parallelize verifiers_server: use generate() for SFT, parallel
...
ManagedServer contexts for RL
2026-01-12 10:34:05 +05:30
balyan.sid@gmail.com
24b4488c60
clean up eval, pin verifiers version
2026-01-12 10:34:05 +05:30
pre-commit-ci[bot]
d98bc6d9fc
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2026-01-12 10:34:05 +05:30
balyan.sid@gmail.com
294b980625
add tests for AtroposManagedClient
2026-01-12 10:34:05 +05:30
balyan.sid@gmail.com
cf636595d2
rework server and eval for rl rollout. add in asyncmanagedserver for
...
verifiers
2026-01-12 10:34:05 +05:30
pre-commit-ci[bot]
3449a4c23d
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2026-01-12 10:34:05 +05:30
balyan.sid@gmail.com
5b09ad86f4
update readme, add sft-datagen to verifiers_server
2026-01-09 19:20:41 +05:30
balyan.sid@gmail.com
636715bb08
add wandb to eval
2026-01-09 16:51:19 +05:30
balyan.sid@gmail.com
dda85430da
fix docstrings
2026-01-09 16:25:44 +05:30
balyan.sid@gmail.com
9d5cd2b593
fix: improve verifiers environments consistency and correctness
...
- verifiers_server.py: consistent dataset column selection for train/test,
remove redundant comments, preserve float precision for scores
- verifiers_eval.py: add env_config_cls, fix constructor signature to match
BaseEnv (slurm bool), make stub methods raise NotImplementedError
2026-01-09 16:21:12 +05:30
balyan.sid@gmail.com
b62c416130
make verifiers deps optional and update README
2026-01-09 14:37:50 +05:30
balyan.sid@gmail.com
ed826de724
wip: verifiers integration
2026-01-09 14:21:03 +05:30
Teknium
a7a87a33e4
Merge pull request #301 from PLippmann/feat/sql-query-env
...
Feat/sql query env
2026-01-06 06:46:02 -08:00
PLippmann
5a130a3a5b
Quote fix
2026-01-06 15:14:26 +01:00
PLippmann
7d8123a526
Missing initialization
2026-01-06 15:14:26 +01:00
PLippmann
c927794248
Add SQL Query Generation Environment
2026-01-06 15:14:26 +01:00
Teknium
6d79d4c7ad
Merge pull request #290 from NousResearch/add-eval-runner
...
add eval runner
2026-01-05 15:48:45 -08:00
Teknium
11ebecd93f
Merge branch 'main' into add-eval-runner
2026-01-05 15:46:39 -08:00
teknium
cb6bf37e68
update name of eval example
2026-01-05 23:46:27 +00:00
Teknium
64b201af52
Merge pull request #234 from NousResearch/reverse-text-env
...
Add reversed text environment
2026-01-05 15:39:28 -08:00
teknium
1fa5c3eee4
lint it
2026-01-05 23:37:37 +00:00
Teknium
3ef206e013
Merge branch 'main' into reverse-text-env
2026-01-05 15:33:43 -08:00
pre-commit-ci[bot]
6cfcbdf4d5
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2026-01-05 23:20:47 +00:00
teknium
e1ece3e64e
Add reasoning configuration support across server implementations
...
- Updated server classes (OpenAIServer, SGLangServer, TrlVllmServer, VLLMServer) to accept a ReasoningConfig parameter during initialization.
- Enhanced ReasoningConfig to allow flexible max_tokens without strict validation, accommodating varying provider limits.
- Implemented reasoning configuration injection in APIServer methods for chat and completion handling.
- Updated tests to reflect changes in max_tokens validation logic.
This commit integrates reasoning capabilities into the server handling architecture, improving compatibility with diverse reasoning models.
2026-01-05 23:20:01 +00:00
Teknium
d2330633b3
Merge pull request #293 from JustKitting/gsm8k-fix
...
Fix missing logprob
2026-01-03 04:01:48 -08:00
Teknium
46beb71e4b
Merge branch 'main' into gsm8k-fix
2026-01-03 03:58:51 -08:00
Teknium
130aced9c9
Merge pull request #162 from interstellarninja/feat/tool_use_mtgrpo
...
MT-GRPO Turn-Level Advantage Environment
2026-01-03 03:58:32 -08:00
Teknium
ab75ce6e03
Merge branch 'main' into feat/tool_use_mtgrpo
2026-01-03 03:08:21 -08:00
Teknium
811d58e45e
Merge pull request #299 from rejected-l/chore/update-copyright-2026
...
chore: bump license year to 2026
2026-01-03 02:06:29 -08:00
Rej Ect
9ae8df324c
chore: bump license year to 2026
2026-01-02 17:38:27 +02:00
Teknium
dde05fa7af
Merge pull request #298 from NousResearch/update_letter_counting_env
...
big update for letter counting
2026-01-02 06:19:22 -08:00
teknium
00ab64a0f4
lint it
2026-01-02 14:17:56 +00:00
pre-commit-ci[bot]
f71873b0ea
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2026-01-02 14:14:11 +00:00
teknium
0bb38e79ef
big update for letter counting
2026-01-02 14:10:02 +00:00
Teknium
0524a71c76
Merge pull request #296 from NousResearch/joe-public-branch
...
Olympiad Coding Environment and LCB Eval
2025-12-31 13:07:49 -08:00
pre-commit-ci[bot]
3cb09259df
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2025-12-31 21:05:45 +00:00
teknium
b9dac318ee
fix lintings
2025-12-31 21:04:40 +00:00
Teknium
c980157a5a
Merge branch 'main' into joe-public-branch
2025-12-31 12:41:24 -08:00
teknium
6763649c3a
Merge branch 'add_reasoning_handling_draft' of https://github.com/NousResearch/atropos into add_reasoning_handling_draft
2025-12-30 23:08:56 +00:00
teknium
89c9697665
fix test
2025-12-30 23:08:54 +00:00
pre-commit-ci[bot]
a23be1555f
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2025-12-30 12:02:50 +00:00
teknium
127a925471
Merge branch 'add_reasoning_handling_draft' of https://github.com/NousResearch/atropos into add_reasoning_handling_draft
2025-12-30 11:59:46 +00:00
teknium
747fbc9285
fix linting
2025-12-30 11:56:21 +00:00
pre-commit-ci[bot]
97047eee7b
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2025-12-30 00:26:33 +00:00
teknium
62fa51240c
Add support for reasoning models and their variety of providers/endpoints
2025-12-30 00:23:00 +00:00
Teknium
1c306d3b17
Merge pull request #294 from NousResearch/port_many_evals
...
Port many benchmarks into atropos
2025-12-28 04:34:46 -08:00
pre-commit-ci[bot]
f7fe9d612b
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2025-12-28 12:32:56 +00:00
teknium
b912983e5e
Merge branch 'port_many_evals' of https://github.com/NousResearch/atropos into port_many_evals
2025-12-28 12:32:14 +00:00
