mirror of
https://github.com/NousResearch/atropos.git
synced 2026-04-19 12:57:58 +00:00
structural changes
This commit is contained in:
parent
12ba3cc3bd
commit
a171358f2e
6 changed files with 422 additions and 50 deletions
|
|
@ -314,14 +314,14 @@ What to configure on the environment side:
|
|||
|
||||
```bash
|
||||
--env.teacher_enabled true \
|
||||
--env.teacher_server.base_url "http://localhost:9003/v1" \
|
||||
--env.teacher_server.model_name "$TEACHER_MODEL" \
|
||||
--env.teacher_server.server_type vllm \
|
||||
--teacher.base_url "http://localhost:9003/v1" \
|
||||
--teacher.model_name "$TEACHER_MODEL" \
|
||||
--teacher.server_type vllm \
|
||||
--env.teacher_top_k 8
|
||||
```
|
||||
|
||||
If `$TEACHER_MODEL` is a deployment alias instead of a tokenizer identifier,
|
||||
also set `--env.teacher_server.tokenizer_name ...` so the env can validate
|
||||
also set `--teacher.tokenizer_name ...` so the env can validate
|
||||
tokenizer compatibility.
|
||||
|
||||
Why cross-tokenizer conversion is not acceptable here:
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue