# TCK Test Baseline Report

**Date:** 2026-02-10
**Version:** 1.0.2
**Excluding:** CALL procedure tests (39 scenarios)

## Summary

| Metric | Value |
|--------|-------|
| **Scenarios Passed** | 2,601 |
| **Scenarios Failed** | 1,244 |
| **Total Scenarios** | 3,845 |
| **Pass Rate** | **67.6%** |
| **Target** | 99%+ |
| **Gap** | 1,207+ scenarios |

## Failure Categories

### 1. Result Mismatches (634 failures)
- "Expected row not found in actual results"
- Query returns wrong data

### 2. Unexpected Errors (210 failures)
Queries that should work but throw errors:
- Unknown entity name: r (13)
- 'NoneType' object has no attribute 'edge_path' (11)
- Type mismatch: list index must be integer, got str (9)
- year must be in 1..9999, not 0 (8)
- SET requires entity.property format, got: n (8)
- Variable already bound, cannot rebind (12)
- unsupported operand type(s) for +: temporal + duration (15)
- Unknown entity name: various (30+)

### 3. Row Count Mismatches (133 failures)
- Wrong number of results returned

### 4. Missing Error Validation (200+ failures)
Tests expect specific errors but query succeeds:
- Expected SyntaxError (UndefinedVariable) - 29
- Expected TypeError (InvalidArgumentValue) - 28
- Expected SyntaxError (InvalidAggregation) - 26
- Expected SyntaxError (InvalidArgumentType) - 20
- Expected TypeError (InvalidArgumentType) - 17
- And many more...

### 5. Side Effect Mismatches (50+ failures)
- +/-properties mismatch
- +/-labels mismatch
- +/-relationships mismatch

## Priority Fixes

### High Priority (blocking many tests)
1. **Variable scope in WITH/RETURN** - Unknown entity errors
2. **Path handling** - edge_path attribute errors
3. **SET clause** - Handle SET n = {map} syntax
4. **Variable rebinding** - Allow rebinding in certain contexts

### Medium Priority
5. **Temporal arithmetic** - Duration addition to DateTime/Time/LocalTime
6. **Date parsing** - Handle year 0, ordinal dates, various formats
7. **List indexing** - Handle map property access with dot notation

### Lower Priority (validation errors)
8. **Error validation** - Raise proper SyntaxError/TypeError for invalid queries
