Metadata-Version: 2.1
Name: cedarverse-bda
Version: 0.0.1
Summary: Interactive dashboard tool for analyzing differences between Aider benchmark runs
Author-email: Elifarley <elifarley@cedarverse.com>
License: Apache-2.0
Project-URL: Homepage, https://github.com/cedarverse/benchmark-delta-analysis
Project-URL: Documentation, https://github.com/cedarverse/benchmark-delta-analysis#readme
Project-URL: Repository, https://github.com/cedarverse/benchmark-delta-analysis.git
Project-URL: Bug Tracker, https://github.com/cedarverse/benchmark-delta-analysis/issues
Keywords: benchmark,testing,analysis,visualization,dashboard,comparison,aider
Classifier: Development Status :: 3 - Alpha
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.12
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Classifier: Intended Audience :: Developers
Classifier: Topic :: Software Development :: Testing
Classifier: Topic :: Software Development :: Quality Assurance
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Requires-Python: >=3.12
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: python-dotenv>=1.0.1
Requires-Dist: dash>=2.18.2
Requires-Dist: pandas>=2.2.2
Requires-Dist: statsmodels>=0.14.2
Provides-Extra: dev
Requires-Dist: pytest>=7.0; extra == "dev"
Requires-Dist: black>=22.0; extra == "dev"
Requires-Dist: isort>=5.0; extra == "dev"
Requires-Dist: flake8>=4.0; extra == "dev"
Requires-Dist: mypy>=0.900; extra == "dev"
Requires-Dist: coverage>=6.0; extra == "dev"
Requires-Dist: tox>=3.24; extra == "dev"
Requires-Dist: build>=1.2.2; extra == "dev"
Requires-Dist: setuptools-scm>=8.1.0; extra == "dev"

# BDA - Benchmark Delta Analysis Tool

A Python tool for analyzing and visualizing differences between two Aider benchmark runs through an interactive dashboard.

## Features

- Compares two benchmark run folders (raw or tar-bz2 archives)
- Interactive web dashboard built with Dash
- Detailed test-by-test comparison analysis
- Visualizes performance changes and differences

## Dashboard Features
- Test result comparison
- Performance metrics visualization
- Interactive data filtering and sorting
- Detailed test case analysis

![img.png](img.png)

![img_1.png](img_1.png)

![img_2.png](img_2.png)

![img_3.png](img_3.png)

## Installation

```bash
pipx install cedarverse-bda
```

## Usage

```bash
# Info on a single benchmark run
bda <run-path>

# Delta Analysis
bda <run1-path> <run2-path>

# Interactive dashboard
bda --dashboard <run-path>

```

## Development


```bash
# Install development dependencies
pip install -e .[dev]
```
