Metadata-Version: 2.1
Name: airbyte-source-kyve
Version: 0.2.0
Summary: Source implementation for KYVE.
Author: Airbyte
Author-email: contact@airbyte.io
Description-Content-Type: text/markdown
Requires-Dist: airbyte-cdk~=0.2
Provides-Extra: tests
Requires-Dist: requests-mock~=1.9.3; extra == "tests"
Requires-Dist: pytest~=6.2; extra == "tests"
Requires-Dist: pytest-mock~=3.6.1; extra == "tests"

# KYVE

This page contains the setup guide and reference information for the **KYVE** source connector.

The KYVE Data Pipeline enables easy import of KYVE data into any data warehouse or destination
supported by [Airbyte](https://airbyte.com/). With the `ELT` format, data analysts and engineers can now confidently source KYVE data without worrying about its validity or reliability.

For information about how to set up an end-to-end pipeline with this connector, see [the documentation](https://docs.kyve.network/data_engineers/accessing_data/elt_pipeline/overview).


1. In order to  create an ELT pipeline with KYVE source you should specify the **`Pool-ID`** of the [KYVE storage pool](https://app.kyve.network/#/pools) from which you want to retrieve data.

2. You can specify a specific **`Bundle-Start-ID`** in case you want to narrow the records that will be retrieved from the pool. You can find the valid bundles in the KYVE app (e.g. [Cosmos Hub pool](https://app.kyve.network/#/pools/0/bundles)).

3. In order to extract the validated data from KYVE, you can specify the endpoint which will be requested **`KYVE-API URL Base`**. By default, the official KYVE **`mainnet`** endpoint will be used, providing the data of [these pools](https://app.kyve.network/#/pools).

***Note:***
KYVE Network consists of three individual networks: *Korellia* is the `devnet` used for development purposes, *Kaon* is the `testnet` used for testing purposes, and **`mainnet`** is the official network. Although through Kaon and Korellia validated data can be used for development purposes, it is recommended to only trust the data validated on Mainnet.

You can fetch with one source configuration more than one pool simultaneously. You just need to specify the **`Pool-IDs`** and the **`Bundle-Start-IDs`** for the KYVE storage pool you want to archive separated with comma.


| Version | Date     | Subject                                              |
| :------ |:---------|:-----------------------------------------------------|
| 0.1.0   | 25-05-23 | Initial release of KYVE source connector             |
| 0.2.0   | 10-11-23 | Update KYVE source to support to Mainnet and Testnet |
