Metadata-Version: 2.1
Name: smolbpe
Version: 0.1.0
Summary: A GPT-4 compatible Byte Pair Encoding (BPE) tokenizer.
Home-page: https://github.com/T4ras123/SmolBPE
Author: Vover
Author-email: vovatara123@gmail.com
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.6
License-File: LICENSE
Requires-Dist: regex>=2021.4.4
