numpy
sse-starlette
infinity-emb[torch]
openai>=1.5.0
transformers>=4.37.2
vllm>=0.3.0
