# LLMHosts — Documentation for LLMs

> LLMHosts turns your home GPU into production AI infrastructure accessible from anywhere.
> CLI tool distributed via PyPI (`pip install llmhost`) with a three-tier intelligent router,
> verified semantic cache, and OpenAI + Anthropic compatible proxy.

## Start Here
- https://llmhosts.com/ — product overview and quick start
- https://llmhosts.com/pricing — plans and pricing (Free, Pro $29/mo, Team $99/mo)
- https://llmhosts.com/docs — documentation hub

## Key Concepts
- **Three-tier hybrid router**: Rule-based + kNN (FAISS/ONNX) → ModernBERT classifier → Qwen2.5-0.5B
- **Verified semantic cache (vCache)**: ICLR 2026 algorithm, <1% false positive rate
- **IslandRun privacy routing**: PII-aware request routing with tiered trust levels
- **BYOK encrypted key storage**: Fernet-encrypted API keys stored locally
- **Auto-discovery**: Detects Ollama instances and GPU hardware automatically
- **Remote access**: Auto-detects Tailscale or Cloudflare Tunnel for anywhere access

## API Compatibility
- OpenAI compatible: `POST /v1/chat/completions`, `GET /v1/models`
- Anthropic compatible: `POST /v1/messages`
- Drop-in replacement — just change `OPENAI_BASE_URL`

## Installation
```
pip install llmhost        # Core (~50MB)
pip install llmhost[smart] # +ONNX/FAISS (~150MB)
pip install llmhost[full]  # +PyTorch (~2GB)
```

## CLI Commands
- `llmhost serve` — start the proxy server
- `llmhost doctor` — run diagnostics
- `llmhost keys add <provider> <key>` — store encrypted API key
- `llmhost tunnel start` — enable remote access
- `llmhost suggest-models` — recommend models for your hardware
- `llmhost setup` — first-run wizard

## Feeds and Structured Exports
- https://llmhosts.com/sitemap.xml — XML sitemap
- https://llmhosts.com/feeds/articles.xml — RSS feed

## Source Code
- https://github.com/LookNoHandsMom/LLMHosts.com — GitHub repository (private)
- https://pypi.org/project/llmhost/ — PyPI package

## Legal
- https://llmhosts.com/legal/terms — Terms of Service
- https://llmhosts.com/legal/privacy — Privacy Policy
