torch
transformers
vllm
pydantic
numpy
requests
tenacity
wandb