Metadata-Version: 2.1
Name: japre
Version: 0.1.0
Summary: Custom pretokenizers for Japanese language models
Home-page: https://github.com/Alab-NII/japre
License: MIT
Author: Kaito Sugimoto
Author-email: kaito_sugimoto@is.s.u-tokyo.ac.jp
Requires-Python: >=3.8,<4.0
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Requires-Dist: flake8 (>=4.0.1,<5.0.0)
Requires-Dist: fugashi (>=1.1.2,<2.0.0)
Requires-Dist: ipadic (>=1.0.0,<2.0.0)
Requires-Dist: pytextspan (>=0.5.4,<0.6.0)
Requires-Dist: tokenizers (>=0.12.1,<0.13.0)
Project-URL: Repository, https://github.com/Alab-NII/japre
Description-Content-Type: text/markdown

# japre
