Metadata-Version: 2.1
Name: mage-ai
Version: 0.3.2
Summary: Mage is a notebook for building and deploying data pipelines.
Home-page: https://github.com/mage-ai/mage-ai
Author: Mage
Author-email: eng@mage.ai
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.6
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: alembic (>=1.7.5)
Requires-Dist: Faker (==4.14.0)
Requires-Dist: Flask (~=1.1.2)
Requires-Dist: Jinja2 (~=3.0.3)
Requires-Dist: MarkupSafe (==2.1.1)
Requires-Dist: Werkzeug (~=2.0.0)
Requires-Dist: asyncio (==3.4.3)
Requires-Dist: click (==8.1.3)
Requires-Dist: flask-cors (==3.0.10)
Requires-Dist: importlib-metadata (==4.11.3)
Requires-Dist: ipykernel (==6.15.0)
Requires-Dist: ipython
Requires-Dist: itsdangerous (~=1.1.0)
Requires-Dist: joblib (>=1.1.0)
Requires-Dist: jupyter-client (==7.3.4)
Requires-Dist: jupyter-server-proxy (==3.2.1)
Requires-Dist: numpy (~=1.21.0)
Requires-Dist: pandas (~=1.3.0)
Requires-Dist: pyarrow (==6.0.0)
Requires-Dist: python-dateutil (==2.8.2)
Requires-Dist: pytz (==2022.1)
Requires-Dist: pyyaml (~=6.0)
Requires-Dist: requests (==2.27.0)
Requires-Dist: scikit-learn (>=1.0)
Requires-Dist: simplejson
Requires-Dist: six (>=1.15.0)
Requires-Dist: sqlalchemy (>=1.4.20)
Requires-Dist: tornado (==6.1)
Requires-Dist: zipp (==3.8.0)
Provides-Extra: all
Requires-Dist: botocore (==1.27.19) ; extra == 'all'
Requires-Dist: boto3 (==1.24.19) ; extra == 'all'
Requires-Dist: db-dtypes (==1.0.2) ; extra == 'all'
Requires-Dist: google-cloud-bigquery (==3.2.0) ; extra == 'all'
Requires-Dist: psycopg2-binary (==2.9.3) ; extra == 'all'
Requires-Dist: redshift-connector (==2.0.907) ; extra == 'all'
Requires-Dist: snowflake-connector-python (==2.7.9) ; extra == 'all'
Provides-Extra: bigquery
Requires-Dist: google-cloud-bigquery (==3.2.0) ; extra == 'bigquery'
Requires-Dist: db-dtypes (==1.0.2) ; extra == 'bigquery'
Provides-Extra: hdf5
Requires-Dist: tables (==3.7.0) ; extra == 'hdf5'
Provides-Extra: postgres
Requires-Dist: psycopg2-binary (==2.9.3) ; extra == 'postgres'
Provides-Extra: redshift
Requires-Dist: boto3 (==1.24.19) ; extra == 'redshift'
Requires-Dist: redshift-connector (==2.0.907) ; extra == 'redshift'
Provides-Extra: s3
Requires-Dist: botocore (==1.27.19) ; extra == 's3'
Requires-Dist: boto3 (==1.24.19) ; extra == 's3'
Provides-Extra: snowflake
Requires-Dist: snowflake-connector-python (==2.7.9) ; extra == 'snowflake'
Provides-Extra: spark
Requires-Dist: botocore (==1.27.19) ; extra == 'spark'
Requires-Dist: boto3 (==1.24.19) ; extra == 'spark'

[![PyPi](https://img.shields.io/pypi/v/mage-ai?color=orange)](https://pypi.org/project/mage-ai/)
[![mage-ai](https://img.shields.io/circleci/build/gh/mage-ai/mage-ai?color=%23159946&label=CircleCI&logo=circleci)](https://app.circleci.com/pipelines/github/mage-ai/mage-ai?branch=master&filter=all)
[![License](https://img.shields.io/github/license/mage-ai/mage-ai?color=red)](https://opensource.org/licenses/Apache-2.0)
[![Join Slack](https://img.shields.io/badge/Slack-Join%20Slack-blueviolet?logo=slack)](https://join.slack.com/t/mageai/shared_invite/zt-1adn34w4m-t~TcnPTlo3~5~d_0raOp6A)

# Intro

<img alt="Fire mage" height="160" src="media/mage-fire-charging-up.svg" />

Mage is an open-source tool for <b>building</b> and <b>deploying</b> data pipelines.

Here is a sample data pipeline defined across 3 files:

```python
# data_loaders/load_data_from_file.py
import pandas as pd


@data_loader
def load_data():
    return pd.read_csv('default_repo/titanic.csv')
```

```python
# transformers/select_columns.py
@transformer
def transform_df(df, *args):
    return df[['Age', 'Fare', 'Survived']]
```

```python
# data_exporters/export_to_file.py
@data_exporter
def export_data(df) -> None:
    df.to_csv('default_repo/titanic_transformed.csv')
```

What the data pipeline looks like in the UI:

<img
  alt="data pipeline overview"
  src="media/data-pipeline-overview.jpg"
/>


New? We recommend reading about [blocks](docs/blocks/README.md) and
learning from a [hands-on tutorial](docs/tutorials/quick_start/etl_restaurant/README.md).

[![Join us on Slack](https://img.shields.io/badge/%20-Join%20us%20on%20Slack-black?style=for-the-badge&logo=slack&labelColor=6B50D7)](https://www.mage.ai/chat)

**Table of contents**

1. [Quick start](#%EF%B8%8F-quick-start)
1. [Demo video](#-demo-video-2-min)
1. [Tutorials](#-tutorials)
1. [Features](#-features)
1. [Documentation](#documentation)
1. [Contributing](#%EF%B8%8F-contributing)
1. [Community](#-community)

# 🏃‍♀️ Quick start

You can install Mage using Docker or `pip`:

### Using Docker

Create a new project and launch tool (change `demo_project` to any other name if you want):

```bash
docker run -it -p 6789:6789 -v $(pwd):/home/src \
  mageai/mageai mage start demo_project
```

Open [http://localhost:6789](http://localhost:6789) in your browser and build a pipeline.

<sub>Follow the [guide](docs/kernels/README.md#pyspark-kernel-) if you want to use PySpark kernel in your notebook.</sub>

### Using pip

##### 1. Install Mage
```bash
pip install mage-ai
```

<sub>For additional packages (e.g. `spark`, `postgres`, etc), please see [Installing extra packages](docs/README.md#installing-extra-packages).</sub>

<sub>If you run into errors, please see [Install errors](docs/README.md#install-errors).</sub>

##### 2. Create new project and launch tool (change `demo_project` to any other name if you want):

```bash
mage start demo_project
```

Open [http://localhost:6789](http://localhost:6789) in your browser and build a pipeline.

<br />

# 🎮 Demo video (2 min)

[![Mage quick start demo](media/mage-youtube-preview.jpg)](https://www.youtube.com/watch?v=hrsErfPDits "Mage quick start demo")

<sub><i>Click the image to play video</i></sub>

<br />

# 👩‍🏫 Tutorials

- [Train model on Titanic dataset](docs/tutorials/quick_start/train_titanic_model/README.md)
- [Load data from API, transform it, and export it to PostgreSQL](docs/tutorials/quick_start/etl_restaurant/README.md)
- [Integrate Mage into an existing Airflow project](docs/tutorials/airflow/integrate_into_existing_project/README.md)

<br />

# 🔮 Features

Check out an overview of features [here](docs/features/README.md).

<img
  alt="Mage"
  src="media/tool-overview.png"
/>

<br />

# 📚 Documentation

Read more docs [here](docs/README.md).

<br />

# 🙋‍♀️ Contributing
We welcome all contributions to Mage;
from small UI enhancements to brand new cleaning actions.
We love seeing community members level up and give people power-ups!

Check out the [🎁 contributing guide](/docs/contributing/README.md) to get started
by setting up your development environment and
exploring the code base.

Got questions? Live chat with us in
[<img alt="Slack" height="20" src="https://thepostsportsbar.com/wp-content/uploads/2017/02/Slack-Logo.png" style="position: relative; top: 4px;" /> Slack](https://www.mage.ai/chat)

Anything you contribute, the Mage team and community will maintain. We’re in it together!

<br />

# 🧙 Community
We love the community of Magers (`/ˈmājər/`);
a group of mages who help each other realize their full potential!

To live chat with the Mage team and community,
please join the free Mage [<img alt="Slack" height="20" src="https://thepostsportsbar.com/wp-content/uploads/2017/02/Slack-Logo.png" style="position: relative; top: 4px;" /> Slack](https://www.mage.ai/chat)
channel.

[![Join us on Slack](https://img.shields.io/badge/%20-Join%20us%20on%20Slack-black?style=for-the-badge&logo=slack&labelColor=6B50D7)](https://www.mage.ai/chat)

For real-time news and fun memes, check out the Mage
[<img alt="Twitter" height="20" src="https://upload.wikimedia.org/wikipedia/commons/thumb/4/4f/Twitter-logo.svg/2491px-Twitter-logo.svg.png" style="position: relative; top: 4px;" /> Twitter](https://twitter.com/mage_ai).

To report bugs or add your awesome code for others to enjoy,
visit [GitHub](https://github.com/mage-ai/mage-ai).

<br />

# 🪪 License
See the [LICENSE](LICENSE) file for licensing information.

[<img alt="Water mage casting spell" height="300" src="media/mage-water-charging-up.svg" />](https://www.mage.ai/)
