# 🚀 Pranjit Transformer

[![PyPI version](https://badge.fury.io/py/pranjit-transformer.svg)](https://badge.fury.io/py/pranjit-transformer)
[![Python 3.8+](https://img.shields.io/badge/python-3.8+-blue.svg)](https://www.python.org/downloads/)
[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)

A **CPU-first**, lightweight transformer library optimized for training and inference on low-resource devices. Built with PyTorch, featuring modern architecture components like RoPE embeddings, RMS normalization, and gated feed-forward networks.

## ✨ Features

- 🖥️ **CPU-Optimized**: Designed for efficient training on standard hardware
- 🔧 **User-Controlled**: Full control over model configuration and hyperparameters
- 🧩 **Hybrid Tokenizer**: Word-level and character-level tokenization support
- ⚡ **Modern Architecture**: RoPE embeddings, RMS normalization, gated FFN
- 📦 **Clean API**: Simple and intuitive interface for quick experimentation
- 💾 **Model I/O**: Easy save/load functionality for checkpoints

## 📦 Installation

