Metadata-Version: 2.1
Name: iar-tokenizer
Version: 1.0.1
Summary: A tokenizer focused on Spanish language.
Home-page: https://github.com/ivansiiito/iar_tokenizer
Author: Ivan Arias Rodriguez
Author-email: ivansiiito@gmail.com
License: UNKNOWN
Platform: UNKNOWN
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Description-Content-Type: text/markdown

# IAR Tokenizer

The IAR (IvÃ¡n Arias RodrÃ­guez) Tokenizer is a tokenizer developed mainly for Spanish. It is able to divide a text in paragraphs, those in 
sentences, and each sentence in a list of tokens.

More information to be added in the future...

