# Sayou Chunking

**Flexible text segmentation strategies for preprocessing large documents before embedding or RAG.**

---

## 💡 Why Sayou Chunking?

`sayou_chunking` turns raw text into manageable, context-preserving chunks — a critical step for embedding pipelines and RAG.

- **Multiple Strategies:** Fixed-length, recursive, semantic, structure-based.  
- **LLM-Aware Chunking:** Uses LLM cues to split logically.  
- **Interoperable:** Produces DataAtoms usable by Sayou Refinery or Assembler.

---

## 🚀 Quick Start

```bash
pip install sayou-chunking
```

```
```

## 🏗️ Core Concepts

- Splitter: Defines the splitting strategy.
- Plugins: Extend chunking logic for domain-specific use cases.

## 📜 License

Apache 2.0 License © 2025 Sayouzone