Arksim

Workflow
Config

Step 1

# Simulate

Generate simulated conversations between virtual users and your agent.

Need scenarios? Use
to generate them, or provide your own scenario.json below.

## Agent Config

How arksim connects to your agent.

Type
Name
Endpoint

Loaded from config YAML. Select a different config in the sidebar to change.

Agent config file

## Scenario Input

Scenario file

Directory:

## Simulation Parameters

Provider
Model
vpn_key Requires env: ``
Conversations per scenario
Max turns
Workers

## Run

Status:
No logs yet.

Step 2

# Evaluate

Score simulated conversations on goal completion, helpfulness, and coherence.

## Model

Provider
Model
vpn_key Requires env: ``

## Input Source

Run Simulate first, or switch to Load from Disk.

## Configuration

Workers
Score threshold
HTML report
Generate

## Metrics

Built-in metrics
Custom metrics files

## Run

Status:
No logs yet.

Step 3

# Results

Review evaluation scores and the full HTML report.

## Input Source

Run Evaluate first, or switch to Load from Disk.
Overall Score
Pass Rate
Avg Turns
Conversations

## Output Files

Click a file to open it. All files are saved in the output directory.

folder

## Conversation Scores

Conversation | Goal Completion | Final Score | Status
--- | --- | --- | ---

## HTML Report

The full report is best viewed in its own tab.

open_in_new View Full Report
bar_chart
No results yet
Run Simulate then Evaluate to generate results, or switch to Load from Disk.

Step 0

# Build Scenarios

Create test scenarios that define how simulated users interact with your agent.

auto_awesome
Auto-generate Scenarios PRO

Automatically generate realistic test scenarios from your agent's knowledge base.

Learn More →

## Load Existing

## Scenarios

note_add
No scenarios yet. Add one manually or load an existing file.

###

Click a file to select it