Metadata-Version: 2.2
Name: lmeval-framework
Version: 0.11.3
Summary: LMEval: Large Model Evaluation Framework
Requires-Python: >=3.10
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: pydantic>=2.10.6
Requires-Dist: dash>=2.18.2
Requires-Dist: dash-bootstrap-components>=1.7.1
Requires-Dist: immutabledict>=4.2.0
Requires-Dist: ipykernel>=6.29.5
Requires-Dist: litellm>1.61.16
Requires-Dist: matplotlib>=3.9.2
Requires-Dist: nbformat>=5.10.4
Requires-Dist: openai>=1.64.0
Requires-Dist: pandas>=2.2.3
Requires-Dist: tabulate>=0.9.0
Requires-Dist: tink>=1.10.0
Requires-Dist: typer>=0.15.1
Provides-Extra: vertex
Requires-Dist: google-cloud-aiplatform>=1.67.1; extra == "vertex"

# LMEval: Large Model Evaluation Framework

## Installation

```bash
pip install lmeval
```

### Dev setup

LMeval use `uv` that you need to install then

```bash
uv venv
source .venv/bin/activate  # or open a new term in vscode after accepting the new venv
uv pip install -e .
```

## Disclaimer

- This is not a Google product.

- When using private datasets, remember that questions may be sent to your chosen model providers for evaluation if the requested results aren't already available. Ensure this aligns with your data policies regarding external processing of sensitive information.
