Metadata-Version: 1.1
Name: dask-igzip
Version: 0.1.0
Summary: dask chunked read_text on gzip file
Home-page: https://github.com/jurismarches/dask-igzip
Author: Jurismarches
Author-email: contact@jurismarches.com
License: UNKNOWN
Description: Dask indexed gzip
        ##################
        
        |pypi-version| |travis| |coveralls|
        
        
        An implementation compatible with `dask read_text`_ interface,
        than can chunk a gzipped text file into several partitions,
        thanks to an index, provided by `indexed_gzip`_
        
        
        Sample session ::
        
          >>> import dask_igzip
          >>> file_path = dask_igzip()
          >>> dask.igzip.
        
        Dask `read_text` create a unique partition if you provide it with a gzip file.
        This is understandable, there is no way to split the gzip file in a predictable
        yet coherent way.
        This project provides an implementation where the gzip is indexed,
        then lines positions are also indexed,
        so that reading the text can be done by chunk (thus enabling parallelism).
        On first run, indexes are saved on disk, so that subsequent runs are fast.
        
        .. _`indexed_gzip`: https://githuib.com/pauldmccarthy/indexed_gzip
        .. _`dask read_text`: https://dask.pydata.org/en/latest/bag-creation.html#db-read-text
        
        
        .. |pypi-version| image:: https://img.shields.io/pypi/v/dask-igzip.svg
            :target: https://pypi.python.org/pypi/dask-igzip
            :alt: Latest PyPI version
        .. |travis| image:: http://img.shields.io/travis/jurismarches/dask_igzip/master.svg?style=flat
            :target: https://travis-ci.org/jurismarches/dask_igzip
        .. |coveralls| image:: http://img.shields.io/coveralls/jurismarches/dask_igzip/master.svg?style=flat
            :target: https://coveralls.io/r/jurismarches/dask_igzip
        
        
        
        
        Changelog
        #########
        
        The format is based on `Keep a Changelog`_
        and this project tries to adhere to `Semantic Versioning`_.
        
        .. _`Keep a Changelog`: http://keepachangelog.com/en/1.0.0/
        .. _`Semantic Versioning`: http://semver.org/spec/v2.0.0.html
        
        0.1.0 - 2018-06-19
        ==================
        
        New
        ---
        
        - initial release
        - 100% code coverage
        
Platform: UNKNOWN
Classifier: Development Status :: 3 - Alpha
Classifier: License :: OSI Approved :: GNU Lesser General Public License v3 or later (LGPLv3+)
Classifier: Topic :: Scientific/Engineering :: Information Analysis
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3.5
Classifier: Programming Language :: Python :: 3.6
