NousResearch/atropos
1
0
Fork 0
mirror of https://github.com/NousResearch/atropos.git synced 2026-04-19 12:57:58 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
atropos/atroposlib/utils/tokenizers
History
shannonsands 9f23c732dd
qwen tokenizer wrapper & fixed jinja template for tool handling (#224) 
* added qwen tokenizer wrapper & fixed jinja template for tool handling issues in the official HF one

* moved jinja template into it's own file
2025-07-30 11:57:15 +10:00
..
__init__.py qwen tokenizer wrapper & fixed jinja template for tool handling (#224) 2025-07-30 11:57:15 +10:00
qwen_chat_template.jinja qwen tokenizer wrapper & fixed jinja template for tool handling (#224) 2025-07-30 11:57:15 +10:00
qwen_fixed_tokenizer.py qwen tokenizer wrapper & fixed jinja template for tool handling (#224) 2025-07-30 11:57:15 +10:00