# Performance Targets

## Router

| Component | Target | Source |
|-----------|--------|--------|
| Tier 1 kNN routing | <15ms CPU | ADR-001 |
| Tier 2 ModernBERT | <50ms GPU, <100ms CPU | ADR-001, F-020 |
| Tier 3 Qwen2.5-0.5B | <500ms | ADR-001 |
| Total router VRAM budget | <1GB | ADR-001 |

## Cache

| Component | Target | Source |
|-----------|--------|--------|
| Exact hash cache hit | <5ms | F-007 |
| Entity namespace extraction | <10ms | F-015 |
| vCache semantic FP rate | <1% | F-016 |

## Relay (ADR-009)

| Metric | Target | Rationale |
|--------|--------|-----------|
| Relay overhead (added latency) | <50ms | Negligible for LLM streaming |
| WSS + Noise NK handshake | <200ms | One-time on connect |
| yamux stream open | <1ms | Per-request overhead |
| yamux frame overhead | <2ms | Per-frame cost |
| Reconnection time | <5s (p95) | Includes backoff jitter |
| Max concurrent streams/device | 256 | yamux default |
| Max concurrent devices/server | 10,000 | fd limits + memory |
| relay_core .so binary size | <5MB | Fits in pip wheel |
| Memory per device connection | <2MB | Registry + yamux state |

## Proxy

| Component | Target | Source |
|-----------|--------|--------|
| Startup time | <5 seconds | F-010 |
| `llmhosts doctor` | <10 seconds | F-011 |
| First install + model download | <3 minutes | ADR-008 |
| Core pip install size | ~50MB | ADR-008 |
| Smart pip install size | ~150MB | ADR-008 |
| Full pip install size | ~2GB | ADR-008 |

## Build Targets

| Target | Platform | Binary Size (est.) |
|--------|----------|-------------------|
| x86_64-unknown-linux-musl | Linux x86_64 | ~3MB |
| aarch64-unknown-linux-musl | Linux ARM64 | ~3MB |
| x86_64-apple-darwin | Intel Mac | ~3MB |
| aarch64-apple-darwin | Apple Silicon | ~3MB |
| x86_64-pc-windows-msvc | Windows x86_64 | ~3.5MB |
