Metadata-Version: 2.1
Name: kerchunk
Version: 0.0.5
Summary: Functions to make reference descriptions for ReferenceFileSystem
Home-page: https://github.com/fsspec/kerchunk
Author: Martin Durant
Author-email: martin.durant@alumni.utoronto.ca
License: MIT
Platform: UNKNOWN
Requires-Python: >=3.7
Description-Content-Type: text/markdown
Requires-Dist: fsspec
Requires-Dist: ujson

# kerchunk

Cloud-friendly access to archival data

[![Docs](https://github.com/fsspec/kerchunk/actions/workflows/default.yml/badge.svg)](https://fsspec.github.io/kerchunk/)
[![Tests](https://github.com/fsspec/kerchunk/actions/workflows/tests.yml/badge.svg)](https://github.com/fsspec/kerchunk/actions/workflows/tests.yml)
[![Pypi](https://img.shields.io/pypi/v/kerchunk.svg)](https://pypi.python.org/pypi/kerchunk/)
[![Conda-forge](https://img.shields.io/conda/vn/conda-forge/kerchunk.svg)](https://anaconda.org/conda-forge/kerchunk)

Kerchunk is a library that provides a unified way to represent a variety of chunked, compressed 
data formats (e.g. NetCDF, HDF5, GRIB),
allowing efficient access to the data from traditional file systems or cloud object storage.  
It also provides a flexible way to create
virtual datasets from multiple files.  It does this by extracting the byte ranges, 
compression information and other information about the
data and storing this metadata in a new, separate object.  This means that you can
create a virtual aggregate dataset over potentially many source
files, for efficient, parallel and cloud-friendly *in-situ* access without having to copy or
translate the originals. It is a gateway to in-the-cloud massive data processing while
the data providers still insist on using legacy formats for archival storage.

(formerly known as `fsspec-reference-maker`)

<img alt="logo" src="./kerchunk.png" width="200"/>


For further information, please see the documentation pages.


