Metadata-Version: 1.1
Name: mosestokenizer
Version: 0.3.0
Summary: Wrappers for several pre-processing scripts from the Moses toolkit.
Home-page: https://bitbucket.org/luismsgomes/mosestokenizer
Author: Luís Gomes
Author-email: luismsgomes@gmail.com
License: LGPLv2
Description: mosestokenizer
        ==============
        
        This package provides wrappers for some pre-processing Perl scripts from the
        Moses toolkit, namely, ``normalize-punctuation.perl``, ``tokenizer.perl`` and
        ``split-sentences.perl``.
        
        Copyright ® 2016, Luís Gomes <luismsgomes@gmail.com>.
        
        This library is free software; you can redistribute it and/or
        modify it under the terms of the GNU Lesser General Public
        License as published by the Free Software Foundation; either
        version 2.1 of the License, or (at your option) any later version.
        
        This library is distributed in the hope that it will be useful,
        but WITHOUT ANY WARRANTY; without even the implied warranty of
        MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the GNU
        Lesser General Public License for more details.
        
        You should have received a copy of the GNU Lesser General Public
        License along with this library; if not, write to the Free Software
        Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA  02110-1301  USA
        
Keywords: text tokenization pre-processing
Platform: UNKNOWN
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: Topic :: Text Processing :: Linguistic
Classifier: License :: OSI Approved :: GNU Lesser General Public License v2 or later (LGPLv2+)
Classifier: Programming Language :: Python :: 3.5
