# LLMHosts.com -- Executive Roadmap

## META
- layer: 1 of 3 (Executive)
- synced_with: detailed.md, full-pm.md
- last_updated: 2026-02-22
- version: 4.0 (STATUS SYNC)
- ssot: GitHub milestones and project board (this doc is narrative context)

## COURSE CORRECTION CONTEXT (v3.0)
v2.0 pivoted from "GPU Orchestration Platform" to "Personal AI Cloud" but overcorrected: killed intelligent routing, lost the core value prop, charged for the wrong thing. Course correction restores: (1) three-tier hybrid router, (2) `llmhosts tunnel` as THE killer feature, (3) algorithms free, data intelligence paid.

**Key changes from v2.0**: Pure kNN to three-tier hybrid. Headscale-for-all to Tailscale/Cloudflare auto-detect (Headscale later deprecated; replaced by self-hosted relay per ADR-009). GPTCache to vCache. $15/mo credits to $19/mo flat. Monolithic pip to tiered install. Added Anthropic API dialect.

## TIMELINE OVERVIEW

| Phase | Name | Status | Key Milestone | Revenue Target | Success Gate |
|-------|------|--------|---------------|----------------|-------------|
| 1 | CLI + Local Intelligence | **COMPLETE** | OSS CLI + three-tier router + vCache + honest savings | $950/mo (50 Pro) | 1K stars, 500 installs |
| 2 | Your GPU From Anywhere | **COMPLETE** | `llmhosts tunnel` + multi-device mesh + Pro tier | $3,800/mo (200 Pro) | Tunnel works, 30-50% savings |
| 3 | The Hive | **IN PROGRESS** | GPU pooling, teams, public launch | $10K+ MRR | 10K users, viral >1.0 |
| 4 | Intelligence | PLANNED | Global router, assisted discovery | Sustainable | Routing beats manual |

## PHASE 1: CLI + LOCAL INTELLIGENCE -- COMPLETE

**Milestone closed**: 54 issues resolved. All Phase 1 deliverables shipped.

### What Was Built
- OpenAI + Anthropic compatible proxy (LiteLLM adapter)
- Three-tier hybrid router (rule-based + kNN + ModernBERT) with IslandRun privacy routing
- Three-tier vCache (exact hash + namespace filter + adaptive semantic, ICLR 2026)
- LRU eviction with Prometheus metrics across all cache tiers
- Ollama auto-discovery + BYOK encrypted key storage
- Textual TUI dashboard + web dashboard API bridge
- Tiered pip install (core ~50MB, smart ~150MB, full ~2GB)
- Cost tracking with honest savings calculations
- 536+ backend tests, CI/CD with GitHub Actions

## PHASE 2: YOUR GPU FROM ANYWHERE -- COMPLETE

**Milestone closed**: 44 issues resolved. All Phase 2 deliverables shipped.

### What Was Built
- `llmhosts tunnel` with Tailscale/Cloudflare auto-detect
- Next.js 16 web dashboard (App Router, React 19, TypeScript, TailwindCSS 4)
- Stripe billing: Free, Pro ($19/mo), Team ($49/seat), Enterprise ($50/user)
- Auth (NextAuth v5), API key management, spending dashboard, achievements
- 29 E2E tests (Playwright), 113 frontend unit tests (Vitest)
- Monitoring stack: Prometheus + Grafana + Loki + AlertManager + pre-built dashboards
- Structured CLI with fuzzy model selection and error remediation hints
- Documentation: API reference, deployment tutorials, troubleshooting guide

## PHASE 3: THE HIVE -- IN PROGRESS

### Objective
Social GPU pooling, team accounts, public launch to 10K users.

### Already Completed (10 issues closed)
- ~~Headscale deployed and running (port 8080, API key stored)~~ *Deprecated; replaced by self-hosted Rust relay (ADR-009)*
- ~~Hive ↔ Headscale integration (users + pre-auth keys) (#148)~~ *Deprecated; relay handles device auth natively*
- Node sharing controls (per-node toggle, schedule) (#149)
- Karma system wiring (compute contributed vs consumed) (#150)
- ~~Headscale ACLs (per-Hive access control) (#151)~~ *Deprecated; relay enforces access control via Noise NK + JWT*

**GPU-as-API MVP (PR #229 — in review):**
- `llmhosts up` unified command: serve + tunnel + auth + register (#223)
- OAuth 2.0 Device Code Flow for CLI auth, RFC 8628 (#224)
- Device registration, heartbeat, and health endpoints (#225)
- Remote device routing in relay (#226)
- API key bridge: proxy validates frontend-issued keys (#227)
- Comprehensive technical + marketing documentation (#228)

### Remaining (13 open issues)

**Launch gates:**
- #134 — Soft launch decision (P0-blocker, MVP v0.1.0 milestone)
- #135 — Production launch: Real PyPI + Stripe Live (P1-critical, v0.2.0 milestone)

**Hive core:** #95 Team accounts, #96 Email infra, #97 Enterprise tier

**Security hardening:** #122 Rate limiting, #123 Audit export, #124 mTLS

**Performance:** #117 HTTP/2 pooling, #118 Batch inference, #120 OpenTelemetry

**Platform:** #115 Plugin system, #121 Alerting rules

### Key Metrics
- Users: 10,000 | Hives: 50+ | MRR: $10K+ | NPS: >50

## PHASE 4: INTELLIGENCE (Weeks 25-36)

### Objective
Global router intelligence from aggregate data = defensible moat.

### Key Metrics
- Routing > manual selection | Revenue: sustainable | Founder ops: <4h/week

## CROSS-CUTTING: HIVE.CEO (Embedded Agent System)
> **NOTE**: Hive.CEO is DIFFERENT from "Hive Mode" (Phase 3 GPU pooling).

Hive.CEO is the self-aware, self-improving, self-healing embedded agent system. It is cross-cutting -- scaffolded now, activates progressively:

| Phase | Hive.CEO Activity |
|-------|-------------------|
| Phase 1 | Scaffolding complete. Identity, config, 5 agents coded. Activates after ship: Analyst indexes codebase, Watcher monitors health. |
| Phase 2 | Builder agent creates PRs for improvements. Advisor proposes optimizations. Admin panel integrated into web dashboard. |
| Phase 3 | Full self-improvement cycles running. Hive.CEO adapts as Hive Mode (GPU pooling) changes the architecture. |
| Phase 4 | Intelligence + Self-evolution (Hive.CEO drives the app's algorithmic evolution). |

Full backlog: `docs/backlog/epic-hive-ceo.md`. Prompt spec: `/home/dev/projects/IdeaFactory.DEV/prompts/Hive/hive.md`.

## RISK SUMMARY

| Risk | Impact | Mitigation |
|------|--------|-----------|
| Tiered pip complexity | Medium | CI all tiers; Docker alternative |
| Router VRAM conflicts | Low | Math proven; Tier 3 CPU fallback |
| Tunnel depends on Tailscale/CF | Medium | Both free+reliable; fallback |
| "Just Ollama wrapper" | Medium | Tunnel + intelligence + vCache novel |
| vCache FP in production | Low | Formal guarantee; entity namespace |
| Low Pro conversion | Medium | Cloud dashboard standalone value |
| Competitor copies | Moderate | Data moat + coordination infra |
| Cloud GPU price drops | Low | Access + privacy + latency immune |
