Commit graph

24 commits

Author SHA1 Message Date
Shannon Sands
cb08629bcf fixing error 2025-05-18 16:06:59 -07:00
Shannon Sands
5f36d0c658 debugging 2025-05-18 16:01:38 -07:00
Shannon Sands
76736ec4c2 removed unused 2025-05-17 13:37:55 -07:00
Shannon Sands
c05d9f7f53 added health check flag to skip entirely 2025-05-17 13:36:26 -07:00
Shannon Sands
f84934363c linting 2025-05-17 13:06:16 -07:00
Shannon Sands
90138376f9 thanks cursor 2025-05-17 13:00:35 -07:00
Shannon Sands
59b08a1aa9 Added flag for chat completion, switch in OpenAI client 2025-05-17 12:59:20 -07:00
Shannon Sands
81534f7c8a message 2025-05-17 12:50:35 -07:00
Shannon Sands
7dc3938038 changed health check to chat completions since all oai models are compatible with that, and it should work with compatible servers 2025-05-17 12:46:50 -07:00
dmahan93
f7552c9c6f
make default not slurm 2025-05-13 13:11:04 -05:00
dmahan93
553d45cc7e start servers as healthy so they can get a chance to check... 2025-05-13 11:17:23 -05:00
dmahan93
8b864e9786 move server_type to serverbaseline instead so it can be used as well for server instantiation 2025-05-13 10:21:58 -05:00
dmahan93
6fc356e76e fix type checking to substantiate an appropriate class instead of the abstract server class 2025-05-13 10:09:36 -05:00
dmahan93
bb658631e9 fix bad import from restructuring... 2025-05-13 09:58:16 -05:00
dmahan93
df62979b90 refactor to not mess up process... 2025-05-13 09:22:07 -05:00
dmahan93
6e9405ba95 Fix bad merge 2025-05-12 20:02:54 -05:00
dmahan93
0aaf59fc9a add trl server
add gsm8k example for axolotl checking
2025-05-12 19:04:46 -05:00
dmahan93
96be544228 Merge commit '71e7a5ca27' into add-support-for-custom-api-servers 2025-05-12 18:40:35 -05:00
dmahan93
1aa72d7e7e Add n kwarg being ignored workaround 2025-05-12 12:06:03 -05:00
hjc-puro
629d8c1731
Merge pull request #14 from NousResearch/2025-05-02-server-cli 2025-05-09 13:37:54 +08:00
dmahan93
8ff48065a3
Update server_manager.py to not continue to API config stuff if serverbaseline is set 2025-05-08 20:18:15 -05:00
dmahan93
70cf61c210 add custom server support 2025-05-08 12:01:49 -05:00
hjc-puro
4348dd2ec1 hide complicated openai config override behavior somewhere else 2025-05-03 14:18:50 -07:00
Dakota Nous
621d00dd80 first commit 2025-04-29 12:10:10 -07:00