Metadata-Version: 2.0
Name: overtokenizer
Version: 0.1.0
Summary: Unicode-based language-agnostic (over-) tokenizer.
Home-page: https://bitbucket.org/luismsgomes/overtokenizer
Author: Luís Gomes
Author-email: luismsgomes@gmail.com
License: LGPLv2
Keywords: text tokenization pre-processing
Platform: UNKNOWN
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: Topic :: Text Processing :: Linguistic
Classifier: License :: OSI Approved :: GNU Lesser General Public License v2 or later (LGPLv2+)
Classifier: Programming Language :: Python :: 3.5
Requires-Dist: docopt
Requires-Dist: openfile
Requires-Dist: regex

===============
 overtokenizer
===============

This package provides a simple language-agnostic tokenizer.

Copyright ® 2016, Luís Gomes <luismsgomes@gmail.com>.

This library is free software; you can redistribute it and/or
modify it under the terms of the GNU Lesser General Public
License as published by the Free Software Foundation; either
version 2.1 of the License, or (at your option) any later version.

This library is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the GNU
Lesser General Public License for more details.

You should have received a copy of the GNU Lesser General Public
License along with this library; if not, write to the Free Software
Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA  02110-1301  USA


