# Fresh WLBS Tool Effectiveness

Generated: 2026-03-26T10:10:13.685246+00:00

## Goal

Provide fresh, inspectable tests showing that `wlbs-scan` can help a model route from a symptom file to the true root-cause file.

## Anti-Overfitting Guardrail

- Train stems: door_guard, grant_table, permit_store, test_door_guard, test_wallet_gate, wallet_gate
- Heldout stems: calc_panel, policy_grid, rule_sheet, screen_lock, test_local_math, test_screen_lock, test_widget_entry, widget_entry
- Exact overlap: []

## Core Result

- Heldout symptom-first success rate: **0.0**
- Heldout WLBS continual success rate: **1.0**
- Heldout symptom-first top-1 root targeting: **0.333**
- Heldout WLBS continual top-1 root targeting: **1.0**

## Reproduce

```bash
python validation/run_fresh_cli_effectiveness.py
```

## Workspaces

- D:\wlbs_scan\validation\fresh_effectiveness_20260326\workspaces

## Claim Boundary

- Supported: WLBS improves root-cause routing in these fresh controlled tasks, and the process is inspectable via saved workspaces and CLI advisory JSON.
- Not claimed: This is not an official SWE-bench pass-rate result.

