Metadata-Version: 2.1
Name: llm-vertex
Version: 0.1
Summary: Plugin for LLM adding support for Google Cloud Vertex AI
Author: Justyn Shull
License: Apache-2.0
Project-URL: Homepage, https://github.com/justyns/llm-vertex
Project-URL: Changelog, https://github.com/justyns/llm-vertex/releases
Project-URL: Issues, https://github.com/justyns/llm-vertex/issues
Classifier: License :: OSI Approved :: Apache Software License
Requires-Python: >3.7
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: llm
Requires-Dist: google-cloud-aiplatform>=1.38.0

# llm-vertex

Plugin for LLM adding support for Google Cloud Vertex AI.

Please note that this plugin is for Vertex AI specifically, not Google AI Studio.

For Gemini support using AI Studio, please see [llm-gemini](https://github.com/simonw/llm-gemini) instead.

Supported models:

- gemini-1.5-pro-preview-0409
- gemini-1.0-pro-vision-001
- gemini-experimental

## Installation

TBD

## Use

First, authenticate using `gcloud`:

``` shell
gcloud auth application-default login
```

Export two environment variables for the GCP Project and location you want to use:

``` shell
export VERTEX_PROJECT_ID=gcp-project-id VERTEX_LOCATION=us-east1
```

Run llm and specify one of the provided models:

``` shell
❯ llm -m gemini-1.5-pro-preview-0409 "What's one clever name for a pet pelican?"
"Gulliver" would be a clever name for a pet pelican, referencing both its large gullet and its potential for long journeys! 🦜
```
