Metadata-Version: 2.1
Name: glue-utils
Version: 0.2.1rc4
Summary: Reusable utilities for working with Glue PySpark jobs
Home-page: https://github.com/dashmug/glue-utils
License: MIT
Keywords: aws,glue,pyspark,spark,etl,data,data-engineering
Author: Noel Llevares
Author-email: dashmug@gmail.com
Requires-Python: >=3.10,<4.0
Classifier: Development Status :: 2 - Pre-Alpha
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Natural Language :: English
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Software Development :: Libraries
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Project-URL: Documentation, https://github.com/dashmug/glue-utils/wiki
Project-URL: Repository, https://github.com/dashmug/glue-utils/issues
Description-Content-Type: text/markdown

# glue-utils

[![License](https://img.shields.io/badge/license-MIT-blue.svg)](LICENSE)

## Description

Reusable utilities for working with Glue PySpark jobs

## Installation

### As a runtime (or production) dependency...

```sh
pip install glue-utils
```

### For development...

This library does not include `pyspark` and `aws-glue-libs` as 
dependencies as they are already pre-installed in Glue's runtime 
environment.

To help in developing your Glue jobs locally in your IDE, it is helpful 
to install `pyspark` and `aws-glue-libs`. Unfortunately, `aws-glue-libs` 
is not available through PyPI so we can only install it from its git 
repository.

```sh
pip install pyspark==3.3.0
pip install git+https://github.com/awslabs/aws-glue-libs.git@master
```

To make your local environment as close to Glue's runtime as possible, 
use the versions specified in [this document](https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-python-libraries.html#glue-modules-provided).

## Documentation

For more details on what you can use this library for, check out the 
[project wiki](https://github.com/dashmug/glue-utils/wiki).
