Commit graph

88 commits

Author SHA1 Message Date
Jai Suphavadeeprasit
f1c20591b6 prompt logprobs 2026-03-03 21:58:05 -05:00
Jai Suphavadeeprasit
439b9b129b prompt logprobs 2026-03-03 21:58:05 -05:00
pre-commit-ci[bot]
e98100e5f6 [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2026-03-03 17:21:00 +00:00
Jai Suphavadeeprasit
323a8a2601 readme updates 2026-03-03 12:19:55 -05:00
Jai Suphavadeeprasit
b9291aa29f init commit 2026-03-03 11:32:09 -05:00
pre-commit-ci[bot]
216c1f5899 [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2026-02-27 21:17:58 +00:00
Jai Suphavadeeprasit
35587cbdc0 logger changes 2026-02-27 16:17:03 -05:00
pre-commit-ci[bot]
64d3ee1bd6 [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2026-02-27 18:16:06 +00:00
Jai Suphavadeeprasit
f343b24a6a narrow down scope 2026-02-27 11:14:42 -05:00
Jai Suphavadeeprasit
e5297148f9 dynamic system prompt fixed 2026-02-20 14:50:43 -05:00
Jai Suphavadeeprasit
fc248dd65b clean 2026-02-20 12:01:50 -05:00
Jai Suphavadeeprasit
55f7cbd091 dynamic system prompts 2026-02-20 03:14:05 -05:00
Jai Suphavadeeprasit
e615eb1f50 assertions 2026-02-20 02:16:49 -05:00
Jai Suphavadeeprasit
559d649a26 proper fallback 2026-02-20 01:45:41 -05:00
Jai Suphavadeeprasit
3910a58f9b refactor base 2026-02-20 01:45:41 -05:00
Jai Suphavadeeprasit
1c90fc71b0 on policy clean up 2026-02-20 01:45:41 -05:00
Jai Suphavadeeprasit
0510ca9b72 found bug 2026-02-20 01:45:41 -05:00
Jai Suphavadeeprasit
fb23014dcc base env debugging 2026-02-20 01:45:41 -05:00
Dakota
7d6aeb9bbf add tokenizer name config to set the vllm/sglang tokenizer to something different if needed 2026-02-09 15:26:29 -06:00
Dakota
9ff24bf370 change to 128 tokens to support low length rejection 2026-02-04 16:23:30 -06:00
Dakota
10f651289c Add dummy openai managed server 2026-02-04 15:16:36 -06:00
balyan.sid@gmail.com
5a20abdce7 switch eval to use managed server adapter impl. moved managed server
adapter
2026-01-23 23:26:29 +05:30
Siddharth Balyan
7f28c52994
Merge branch 'main' into sid/verifiers 2026-01-16 11:50:27 +05:30
teknium
681616844d linter.... 2026-01-15 07:44:53 +00:00
teknium
45d47fbf56 Refactor reasoning configuration check in APIServer class
- Removed unnecessary commented-out code and simplified the logic for checking if reasoning is configured and active. This enhances code readability and maintainability.
2026-01-15 07:43:21 +00:00
pre-commit-ci[bot]
f3ea354f31 [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2026-01-15 07:23:36 +00:00
teknium
c2e7b3700e Merge branch 'add_reasoning_handling_draft' of https://github.com/NousResearch/atropos into add_reasoning_handling_draft 2026-01-15 07:22:47 +00:00
teknium
b2d17a44d2 Add README for server handling module and refine ReasoningConfig logic
- Introduced a new README.md file detailing the server handling module, including support for reasoning models, provider differences, effort level mappings, and usage examples.
- Cleaned up the ReasoningConfig class by removing unnecessary comments and clarifying logic related to reasoning injection and provider-specific requirements.
2026-01-15 07:21:53 +00:00
teknium
0e187d7869 Update completion handler documentation to clarify that reasoning config is not injected for completions, as it is only supported in chat completions. 2026-01-15 06:44:55 +00:00
pre-commit-ci[bot]
b6e24266b2 [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2026-01-15 06:27:19 +00:00
teknium
0316cac8d1 Rename is_active method to is_reasoning_kwargs_active in ReasoningConfig for clarity. Update references in the class and corresponding tests to reflect this change. 2026-01-15 06:26:31 +00:00
balyan.sid@gmail.com
57fa229846 remove unused managed_server wrapper + tese 2026-01-14 17:09:57 +05:30
balyan.sid@gmail.com
6a27e88023 use managed server 2026-01-14 17:09:01 +05:30
Teknium
837fc237ee
Merge branch 'main' into add_reasoning_handling_draft 2026-01-12 09:45:38 -08:00
teknium
6aba5244b8 ReasoningConfig documentation to clarify dependency on effort and max_tokens settings. This update specifies that enabling either of these parameters requires reasoning in OpenRouter to be set to Enabled. 2026-01-12 17:45:19 +00:00
teknium
21504537fc revive _get_server_base_url 2026-01-12 16:49:38 +00:00
balyan.sid@gmail.com
cf636595d2 rework server and eval for rl rollout. add in asyncmanagedserver for
verifiers
2026-01-12 10:34:05 +05:30
pre-commit-ci[bot]
6cfcbdf4d5 [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2026-01-05 23:20:47 +00:00
teknium
e1ece3e64e Add reasoning configuration support across server implementations
- Updated server classes (OpenAIServer, SGLangServer, TrlVllmServer, VLLMServer) to accept a ReasoningConfig parameter during initialization.
- Enhanced ReasoningConfig to allow flexible max_tokens without strict validation, accommodating varying provider limits.
- Implemented reasoning configuration injection in APIServer methods for chat and completion handling.
- Updated tests to reflect changes in max_tokens validation logic.

This commit integrates reasoning capabilities into the server handling architecture, improving compatibility with diverse reasoning models.
2026-01-05 23:20:01 +00:00
teknium
127a925471 Merge branch 'add_reasoning_handling_draft' of https://github.com/NousResearch/atropos into add_reasoning_handling_draft 2025-12-30 11:59:46 +00:00
teknium
747fbc9285 fix linting 2025-12-30 11:56:21 +00:00
pre-commit-ci[bot]
97047eee7b [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2025-12-30 00:26:33 +00:00
teknium
62fa51240c Add support for reasoning models and their variety of providers/endpoints 2025-12-30 00:23:00 +00:00
Dakota
8ec5066998 add eval runner 2025-12-19 19:56:59 -06:00
Ksenchi
6c843d6677
Update MANAGED_SERVER.md 2025-11-12 07:22:40 +01:00
Ksenchi
edf26d68e1
Update MANAGED_SERVER.md 2025-11-12 07:22:06 +01:00
Dakota
e6ac3abdcb add managed vllm server 2025-11-07 13:06:49 -06:00
Dakota
578175a709 fix pre-commit 2025-10-29 14:47:50 -05:00
Dakota
5d6d6bb0dc add docs :) 2025-10-29 11:26:43 -05:00
Dakota
c3a118f50d fix tests 2025-10-29 10:55:10 -05:00