probitas — guardrail regression test report

Timestamp: {{ timestamp }}
{% if policy_hash %}Policy hash: {{ policy_hash[:16] }}...
{% endif %} Evidence hash: {{ evidence_hash[:16] }}...
{{ summary.total }}
Total
{{ summary.passed }}
Passed
{{ summary.failed }}
Failed

Test Results

{% for t in tests %} {% endfor %}
TestToolExpectedActualRuleStatus
{{ t.description }} {{ t.tool }} {{ t.expected }} {{ t.actual }} {{ t.rule }} {{ "PASS" if t.passed else "FAIL" }}

Guardrail Coverage

{{ coverage.coverage_pct }}%

{{ coverage.rules_exercised | length }} / {{ coverage.total_deterministic_rules }} deterministic rules exercised

{% if coverage.rules_not_exercised %}

Rules Not Exercised

{% endif %} {% if coverage.semantic_rules %}

Semantic Rules (manual validation required)

{% endif %}