# Training + Serving
sentencepiece
transformers
accelerate
flash-attn<2
protobuf<3.21
# Serving
fastapi
pydantic
shortuuid
uvicorn
vllm
