Metadata-Version: 2.1
Name: onnxruntime-genai
Version: 0.5.2
Summary: ONNX Runtime generate() API
Author: Microsoft Corporation
Author-email: onnxruntime-genai@microsoft.com
License: MIT License
Description-Content-Type: text/markdown
Requires-Dist: numpy>=1.21.6
Requires-Dist: onnxruntime>=1.20.1

# ONNX Runtime generate() API

Run SLMs/LLMs and multi modal models on-device and in the cloud with ONNX Runtime.

Model architectures supported so far (and more coming soon): Gemma, Llama, Mistral, Phi (language and vision).

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai
