Metadata-Version: 2.1
Name: llama-index-readers-huggingface-fs
Version: 0.3.0
Summary: llama-index readers huggingface fs integration
License: MIT
Keywords: face,filesystem,fs,hugging,huggingface
Author: Your Name
Author-email: you@example.com
Maintainer: jerryjliu
Requires-Python: >=3.9,<4.0
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Dist: huggingface-hub (>=0.20.3,<0.21.0)
Requires-Dist: llama-index-core (>=0.12.0,<0.13.0)
Requires-Dist: pandas
Description-Content-Type: text/markdown

# Hugging Face FS Loader

```bash
pip install llama-index-readers-huggingface-fs
```

This loader uses Hugging Face Hub's Filesystem API (> 0.14) to
load datasets.

Besides the existing `load_data` function, you may also choose to use
`load_dicts` and `load_df`.

## Usage

To use this loader, you need to pass in a path to a Hugging Face dataset.

```python
from pathlib import Path

from llama_index.readers.huggingface_fs import HuggingFaceFSReader

# load documents
loader = HuggingFaceFSReader()
documents = loader.load_data("datasets/dair-ai/emotion/data/data.jsonl.gz")

# load dicts
dicts = loader.load_dicts("datasets/dair-ai/emotion/data/data.jsonl.gz")

# load df
df = loader.load_df("datasets/dair-ai/emotion/data/data.jsonl.gz")
```

This loader is designed to be used as a way to load data into [LlamaIndex](https://github.com/run-llama/llama_index/).

