Metadata-Version: 2.1
Name: jax-dataloaders
Version: 0.1.1
Summary: A high-performance data loading library for JAX
Home-page: https://github.com/yourusername/jax-dataloader
Author: Kartikey Rawat
Author-email: your.email@example.com
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.8
Description-Content-Type: text/markdown
License-File: LICENSE

# JAX DataLoader

A high-performance data loading library for JAX, designed for efficient data loading and preprocessing in machine learning workflows.

## Features

- Efficient data loading with automatic batching
- Multi-GPU support with automatic batch distribution
- Memory management with automatic batch size tuning
- Support for various data formats (CSV, JSON, Images)
- Progress tracking and statistics
- Data caching and prefetching
- Error handling and recovery

## Installation

```bash
pip install jax-dataloader
```

## Quick Start

```python
from jax_dataloader import JAXDataLoader, DataLoaderConfig

# Create a DataLoader configuration
config = DataLoaderConfig(
    batch_size=32,
    num_workers=4,
    multi_gpu=True
)

# Load your data
dataloader = JAXDataLoader(
    data_path="path/to/your/data",
    config=config
)

# Iterate over batches
for batch_x, batch_y in dataloader:
    # Process your batch
    ...
```

## Examples

The package includes comprehensive examples demonstrating various features:

```bash
# Clone the repository
git clone https://github.com/yourusername/jax-dataloader.git
cd jax-dataloader

# Install example dependencies
pip install -r examples/requirements.txt

# Run the data loading demo
cd examples/data_loading
python demo.py
```

The examples demonstrate:
- Loading different data formats (CSV, JSON, Images)
- Multi-GPU support
- Memory management
- Progress tracking
- Batch size optimization

For more examples and detailed documentation, visit our [documentation](https://jax-dataloader.readthedocs.io/).

## Documentation

For detailed documentation, including API reference and advanced usage examples, visit our [documentation](https://jax-dataloader.readthedocs.io/).

## Contributing

We welcome contributions! Please see our [contributing guide](CONTRIBUTING.md) for details.

## License

This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.

---

### **Project Structure**:

```
