Metadata-Version: 2.4
Name: rag-orchestrator
Version: 0.1.1
Summary: Lightweight orchestrator with in-process gatekeeper + micro-batching for multi-agent RAG.
Home-page: https://github.com/pkbythebay29/ot-rag-llm-api
Author: pkbythebay29
Author-email: kannan@haztechrisk.org
License: MIT
Requires-Python: >=3.8
Description-Content-Type: text/markdown
Requires-Dist: fastapi>=0.110
Requires-Dist: pydantic>=2.6
Requires-Dist: anyio>=4.4
Requires-Dist: uvicorn>=0.29
Dynamic: author
Dynamic: author-email
Dynamic: home-page
Dynamic: requires-python

# Krionis Orchestrator

A lightweight orchestration runtime built on top of **Krionis Pipeline**.  
It enables **batching, multi-agent workflows, and coordination** for low-latency, multi-user RAG systems.

---

## 🤖 Key Features

⚡ **Batching & Microbatching**  
- Queueing + scheduling for efficient parallel queries  
- Smooth multi-user handling (no “stuck at starting”)  

🕹 **Agent Runtime**  
- Built-in agents: Retriever, Compressor, Reranker, Drafting, Validator, Dialogue, Coordinator  
- Agents communicate, self-optimize, and hand off state until human approval  

🔗 **Provider Plug-ins**  
- Pluggable backends (local LLMs, APIs, hybrid deployments)  
- Bridges directly to [`krionis-pipeline`](https://pypi.org/project/krionis-pipeline/)  

🌐 **API + Web Interface**  
- REST endpoints for orchestration and multi-agent queries  
- Minimal HTML UI for monitoring and interaction  

🛡 **Resilient Runtime**  
- Timeouts, retries, and cancellation built in  
- Lightweight, works offline and in low-compute setups  

---

## 🚀 Quickstart

Install:

```bash
pip install krionis-orchestrator
```
