Metadata-Version: 2.0
Name: tokenize-uk
Version: 0.1.2
Summary: Simple python lib to tokenize texts into sentences and sentences to words. Small, fast and robust. Comes with ukrainian flavour 
Home-page: https://github.com/dchaplinsky/tokenize_uk
Author: Vsevolod Dyomkin, Dmitry Chaplinsky
Author-email: chaplinsky.dmitry@gmail.com
License: MIT
Keywords: tokenize_uk
Platform: UNKNOWN
Classifier: Development Status :: 2 - Pre-Alpha
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Natural Language :: English
Classifier: Programming Language :: Python :: 2
Classifier: Programming Language :: Python :: 2.6
Classifier: Programming Language :: Python :: 2.7
Classifier: Programming Language :: Python :: Implementation :: PyPy
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.3
Classifier: Programming Language :: Python :: 3.4
Classifier: Programming Language :: Python :: 3.5
Requires-Dist: six

===============================
Tokenize UK
===============================

.. image:: https://img.shields.io/pypi/v/tokenize_uk.svg
        :target: https://pypi.python.org/pypi/tokenize_uk

.. image:: https://img.shields.io/travis/dchaplinsky/tokenize_uk.svg
        :target: https://travis-ci.org/lang-uk/tokenize-uk

.. image:: https://readthedocs.org/projects/tokenize_uk/badge/?version=latest
        :target: https://readthedocs.org/projects/tokenize_uk/?badge=latest
        :alt: Documentation Status


Simple python lib to tokenize texts into sentences and sentences to words. Small, fast and robust. Comes with ukrainian flavour 

* Free software: MIT license
* Documentation: https://tokenize_uk.readthedocs.org.

Features
--------

* Tokenize given text into sentences
* Tokenize given sentence into words
* Works well with accented characters (like stresses) and apostrophes
* Suitable also for other languages


=======
History
=======

0.1.0 (2016-05-29)
------------------

* First release on PyPI.


