atropos/atroposlib/envs/server_handling
dmahan93 44b96c7b6c Add max_n_completions parameter to ServerManager for handling multiple completions
- Introduced max_n_completions configuration to limit the number of completions requested per server call.
- Updated chat_completion and completion methods to split requests exceeding max_n_completions into multiple calls, merging results accordingly.
- Enhanced documentation for max_n_completions in ServerManagerConfig.
2025-06-02 11:11:55 -05:00
..
openai_server.py linting 2025-05-18 16:55:25 -07:00
server_baseline.py removed unused 2025-05-17 13:37:55 -07:00
server_harness.py first commit 2025-04-29 12:10:10 -07:00
server_manager.py Add max_n_completions parameter to ServerManager for handling multiple completions 2025-06-02 11:11:55 -05:00
trl_vllm_server.py removed unused 2025-05-17 13:37:55 -07:00