Sync contents

2026-04-19 12:58:01 +00:00 · 2026-01-25 05:52:42 +00:00 · 2026-01-25 05:52:42 +00:00 · ca40e08bb4
commit ca40e08bb4
parent ad03d44978
12 changed files with 358 additions and 27 deletions
--- a/docs/api/samplingclient.md
+++ b/docs/api/samplingclient.md
@ -110,3 +110,14 @@ async def compute_logprobs_async(
 ```

 Async version of compute_logprobs.
+
+#### `get_tokenizer`
+
+```python
+def get_tokenizer() -> PreTrainedTokenizer
+```
+
+Get the tokenizer for the current model.
+
+Returns:
+- `PreTrainedTokenizer` compatible with the model