Metadata-Version: 2.3
Name: toker
Version: 0.1.0
Summary: Extremely fast tokenizer for language modeling
Author: Marcel Rød
Author-email: Marcel Rød <marcelroed@gmail.com>
Requires-Python: >=3.13
Description-Content-Type: text/markdown

# Toker
Extremely fast tokenizer for language modeling.