# nexaai

> **Run next-generation LLMs and VLMs locally, natively, and at top speed on any hardware.**

**nexaai** is the official Python SDK for NexaSDK/NexaML:  
An NPU‑first cross‑platform inference engine that powers LLMs, VLMs, embeddings, audio, and vision models across NPU, GPU, and CPU—on desktop, mobile, automotive, and IoT.

---

## Features

- 🚀 **NPU‑First Performance** — Accelerated AI with automatic device selection and backend optimizations.
- 🔮 **Day‑0 Architecture Support** — Run new LLMs, VLMs, ASR, and CV models immediately (GGUF, MLX, .nexa, and more).
- 🧩 **True Multimodality** — Seamless pipelines for text, vision, and audio.
- 🤖 **OpenAI-Compatible Server** — Supports serving, chat, and function calling.
- 🏆 **Cross‑Platform** — macOS (Apple Silicon), Windows (x64, ARM64), Linux, mobile, embedded.

---

## What is it?

nexaai offers a clean Python API over NexaML’s runtime. Build modern AI applications—chatbots, copilots, vision tools—that run fully **on-device** with maximal hardware utilization. Designed for rapid adoption of new models and formats, especially with NPU acceleration.

---

## Installation & Quickstart

Please refer to our official docs for up-to-date install steps, environment notes, and code examples:

- **Overview:** [NexaAI Python SDK Overview](https://docs.nexa.ai/nexa-sdk-python/overview)
- **Quickstart:** [Quickstart Guide](https://docs.nexa.ai/nexa-sdk-python/quickstart)

The docs include supported Python versions, backend requirements (NPU, MLX, GPU, CPU), and ready-to-run examples for LLMs, VLMs, embeddings, and audio.

---

## Links

- 📚 **Docs:** https://docs.nexa.ai/nexa-sdk-python/overview
- 🐞 **Issues/Discussions:** [NexaAI Issues](https://github.com/NexaAI/nexa-sdk/issues)
- 💬 **Community:**
  - [Discord](https://discord.com/invite/nexa-ai)
  - [Slack](https://nexa-ai-community.slack.com/ssb/redirect)

---
