# Polars Benchmark Report

_Auto-generated by the LakeBench integration test suite._  
_Last updated: 2026-02-25 00:34:47 UTC_

---

## TPC-H

⚠️ **11/22 queries passed (50.0%)**

### Failed queries

| Querie | Error |
|---|---|
| `q1` | SQLSyntaxError: unsupported interval syntax ('INTERVAL (-88) DAY') |
| `q2` | SQLSyntaxError: subquery comparisons with '=' are not supported; use 'IN' instead |
| `q4` | SQLInterfaceError: expression Exists { subquery: Query { with: None, body: Select(Select { select_token: TokenWithSpan { token: Word(Word { value: "SELECT", quote_style: None, keyword: SELECT }), span: Span(Location(9,5)..Location(9,11)) }, distinct: None, top: None, top_before_distinct: false, proj |
| `q5` | ColumnNotFoundError: unable to find column "s_nationkey"; valid columns: ["n_nationkey", "n_name", "n_regionkey", "n_comment"]  Resolved plan until failure:  	---> FAILED HERE RESOLVING 'join' <--- PythonDataset SCAN [PL_PY_DSET] PROJECT */4 COLUMNS |
| `q11` | SQLSyntaxError: subquery comparisons with '>' are not supported |
| `q13` | SQLInterfaceError: only equi-join constraints are currently supported; found expression = UnaryOp { op: Not, expr: Like { negated: false, any: false, expr: Identifier(Ident { value: "o_comment", quote_style: None, span: Span(Location(10,38)..Location(10,47)) }), pattern: Value(ValueWithSpan { value: |
| `q15` | SQLSyntaxError: subquery comparisons with '=' are not supported; use 'IN' instead |
| `q17` | SQLSyntaxError: subquery comparisons with '<' are not supported |
| `q20` | SQLSyntaxError: subquery comparisons with '>' are not supported |
| `q21` | SQLInterfaceError: expression Exists { subquery: Query { with: None, body: Select(Select { select_token: TokenWithSpan { token: Word(Word { value: "SELECT", quote_style: None, keyword: SELECT }), span: Span(Location(15,5)..Location(15,11)) }, distinct: None, top: None, top_before_distinct: false, pr |
| `q22` | SQLSyntaxError: subquery comparisons with '>' are not supported |

---

## TPC-DS

⚠️ **29/103 queries passed (28.2%)**

### Failed queries

| Querie | Error |
|---|---|
| `q1` | SQLSyntaxError: subquery comparisons with '>' are not supported |
| `q2` | ColumnNotFoundError: unable to find column "d_week_seq:date_dim"; valid columns: ["d_date_sk", "d_date_id", "d_date", "d_month_seq", "d_week_seq", "d_quarter_seq", "d_year", "d_dow", "d_moy", "d_dom", "d_qoy", "d_fy_year", "d_fy_quarter_seq", "d_fy_week_seq", "d_day_name", "d_quarter_name", "d_holid |
| `q5` | SQLSyntaxError: unsupported interval syntax ('INTERVAL 14 DAY') |
| `q6` | SQLSyntaxError: subquery comparisons with '=' are not supported; use 'IN' instead |
| `q9` | SQLInterfaceError: unexpected subquery |
| `q10` | SQLInterfaceError: expression Exists { subquery: Query { with: None, body: Select(Select { select_token: TokenWithSpan { token: Word(Word { value: "SELECT", quote_style: None, keyword: SELECT }), span: Span(Location(30,5)..Location(30,11)) }, distinct: None, top: None, top_before_distinct: false, pr |
| `q12` | SQLSyntaxError: unsupported interval syntax ('INTERVAL 30 DAY') |
| `q13` | DuplicateError: projections contained duplicate output name 'ss_ext_wholesale_cost'. It's possible that multiple expressions are returning the same default column name. If this is the case, try renaming the columns with `.alias("new_name")` to avoid duplicate column names.  Resolved plan until failu |
| `q14a` | SQLSyntaxError: subquery comparisons with '>' are not supported |
| `q14b` | SQLSyntaxError: subquery comparisons with '=' are not supported; use 'IN' instead |
| `q16` | SQLSyntaxError: unsupported interval syntax ('INTERVAL 60 DAY') |
| `q18` | SQLInterfaceError: expression Rollup([[Identifier(Ident { value: "i_item_id", quote_style: None, span: Span(Location(34,5)..Location(34,14)) })], [Identifier(Ident { value: "ca_country", quote_style: None, span: Span(Location(35,5)..Location(35,15)) })], [Identifier(Ident { value: "ca_state", quote_ |
| `q20` | SQLSyntaxError: unsupported interval syntax ('INTERVAL 30 DAY') |
| `q21` | SQLSyntaxError: unsupported interval syntax ('INTERVAL (-30) DAY') |
| `q22` | SQLInterfaceError: expression Rollup([[Identifier(Ident { value: "i_product_name", quote_style: None, span: Span(Location(16,5)..Location(16,19)) })], [Identifier(Ident { value: "i_brand", quote_style: None, span: Span(Location(17,5)..Location(17,12)) })], [Identifier(Ident { value: "i_class", quote |
| `q23a` | SQLInterfaceError: array element BinaryOp { left: Value(ValueWithSpan { value: Number("1998", false), span: Span(Location(13,22)..Location(13,26)) }), op: Plus, right: Value(ValueWithSpan { value: Number("1", false), span: Span(Location(13,29)..Location(13,30)) }) } is not supported |
| `q23b` | SQLInterfaceError: array element BinaryOp { left: Value(ValueWithSpan { value: Number("1998", false), span: Span(Location(13,22)..Location(13,26)) }), op: Plus, right: Value(ValueWithSpan { value: Number("1", false), span: Span(Location(13,29)..Location(13,30)) }) } is not supported |
| `q24a` | SQLSyntaxError: subquery comparisons with '>' are not supported |
| `q24b` | SQLSyntaxError: subquery comparisons with '>' are not supported |
| `q27` | SQLInterfaceError: unsupported function 'grouping' |
| `q29` | SQLInterfaceError: array element BinaryOp { left: Value(ValueWithSpan { value: Number("1998", false), span: Span(Location(31,27)..Location(31,31)) }), op: Plus, right: Value(ValueWithSpan { value: Number("1", false), span: Span(Location(31,34)..Location(31,35)) }) } is not supported |
| `q30` | SQLInterfaceError: ambiguous reference to column "d_year" (use one of: d2.d_year, d3.d_year, web_returns.d_year) |
| `q31` | SQLInterfaceError: ambiguous reference to column "d_qoy" (use one of: d2.d_qoy, d3.d_qoy, store_sales.d_qoy) |
| `q32` | SQLInterfaceError: ambiguous reference to column "d_date" (use one of: catalog_sales.d_date, d2.d_date, d3.d_date) |
| `q33` | SQLInterfaceError: ambiguous reference to column "d_year" (use one of: d2.d_year, d3.d_year, store_sales.d_year) |
| `q34` | SQLInterfaceError: array element BinaryOp { left: Value(ValueWithSpan { value: Number("1998", false), span: Span(Location(36,35)..Location(36,39)) }), op: Plus, right: Value(ValueWithSpan { value: Number("1", false), span: Span(Location(36,42)..Location(36,43)) }) } is not supported |
| `q35` | SQLInterfaceError: ambiguous reference to column "d_date_sk" (use one of: c.d_date_sk, d2.d_date_sk, d3.d_date_sk) |
| `q36` | SQLInterfaceError: unsupported function 'grouping' |
| `q37` | SQLInterfaceError: ambiguous reference to column "d_date" (use one of: d2.d_date, d3.d_date, item.d_date) |
| `q39a` | ComputeError: the name 'w_warehouse_sk' passed to `LazyFrame.with_columns` is duplicate  It's possible that multiple expressions are returning the same default column name. If this is the case, try renaming the columns with `.alias("new_name")` to avoid duplicate column names.  Resolved plan until f |
| `q39b` | SQLInterfaceError: ambiguous reference to column "w_warehouse_name" (use one of: inv2.w_warehouse_name, inventory.w_warehouse_name) |
| `q40` | SQLInterfaceError: unsupported SQL join constraint: On(Nested(BinaryOp { left: BinaryOp { left: Identifier(Ident { value: "cs_order_number", quote_style: None, span: Span(Location(25,5)..Location(25,20)) }), op: Eq, right: Identifier(Ident { value: "cr_order_number", quote_style: None, span: Span(Lo |
| `q41` | SQLSyntaxError: subquery comparisons with '>' are not supported |
| `q42` | ShapeError: sort expressions must have same length as DataFrame, got DataFrame height: 5 and Series length: 1 |
| `q44` | SQLSyntaxError: subquery comparisons with '*' are not supported |
| `q46` | SQLInterfaceError: array element BinaryOp { left: Value(ValueWithSpan { value: Number("2000", false), span: Span(Location(31,35)..Location(31,39)) }), op: Plus, right: Value(ValueWithSpan { value: Number("1", false), span: Span(Location(31,42)..Location(31,43)) }) } is not supported |
| `q47` | SQLInterfaceError: ambiguous reference to column "d_year" (use one of: v1_lag.d_year, v1_lead.d_year, v2.d_year) |
| `q48` | SQLInterfaceError: ambiguous reference to column "d_year" (use one of: store_sales.d_year, v1_lag.d_year, v1_lead.d_year) |
| `q49` | SQLInterfaceError: unsupported SQL join constraint: On(Nested(BinaryOp { left: BinaryOp { left: CompoundIdentifier([Ident { value: "ws", quote_style: None, span: Span(Location(33,11)..Location(33,13)) }, Ident { value: "ws_order_number", quote_style: None, span: Span(Location(33,14)..Location(33,29) |
| `q51` | SQLInterfaceError: unsupported SQL join constraint: On(Nested(BinaryOp { left: BinaryOp { left: CompoundIdentifier([Ident { value: "web", quote_style: None, span: Span(Location(63,9)..Location(63,12)) }, Ident { value: "item_sk", quote_style: None, span: Span(Location(63,13)..Location(63,20)) }]), o |
| `q53` | SQLInterfaceError: array element BinaryOp { left: Value(ValueWithSpan { value: Number("1183", false), span: Span(Location(18,7)..Location(18,11)) }), op: Plus, right: Value(ValueWithSpan { value: Number("1", false), span: Span(Location(18,14)..Location(18,15)) }) } is not supported |
| `q54` | SQLInterfaceError: unexpected subquery |
| `q57` | SQLInterfaceError: ambiguous reference to column "d_year" (use one of: v1_lag.d_year, v1_lead.d_year, v2.d_year) |
| `q58` | SQLSyntaxError: subquery comparisons with '=' are not supported; use 'IN' instead |
| `q59` | ColumnNotFoundError: unable to find column "d_week_seq:d"; valid columns: ["d_date_sk", "d_date_id", "d_date", "d_month_seq", "d_week_seq", "d_quarter_seq", "d_year", "d_dow", "d_moy", "d_dom", "d_qoy", "d_fy_year", "d_fy_quarter_seq", "d_fy_week_seq", "d_day_name", "d_quarter_name", "d_holiday", "d |
| `q61` | ComputeError: the name 'promotions' passed to `LazyFrame.with_columns` is duplicate  It's possible that multiple expressions are returning the same default column name. If this is the case, try renaming the columns with `.alias("new_name")` to avoid duplicate column names.  Resolved plan until failu |
| `q63` | SQLInterfaceError: array element BinaryOp { left: Value(ValueWithSpan { value: Number("1183", false), span: Span(Location(18,7)..Location(18,11)) }), op: Plus, right: Value(ValueWithSpan { value: Number("1", false), span: Span(Location(18,14)..Location(18,15)) }) } is not supported |
| `q64` | DuplicateError: group_by keys contained duplicate output name 'ca_street_number'. It's possible that multiple expressions are returning the same default column name. If this is the case, try renaming the columns with `.alias("new_name")` to avoid duplicate column names. |
| `q65` | SQLInterfaceError: ambiguous reference to column "d_month_seq" (use one of: d2.d_month_seq, d3.d_month_seq, store_sales.d_month_seq) |
| `q67` | SQLInterfaceError: expression Rollup([[Identifier(Ident { value: "i_category", quote_style: None, span: Span(Location(37,9)..Location(37,19)) })], [Identifier(Ident { value: "i_class", quote_style: None, span: Span(Location(38,9)..Location(38,16)) })], [Identifier(Ident { value: "i_brand", quote_sty |
| `q68` | SQLInterfaceError: array element BinaryOp { left: Value(ValueWithSpan { value: Number("2000", false), span: Span(Location(33,35)..Location(33,39)) }), op: Plus, right: Value(ValueWithSpan { value: Number("1", false), span: Span(Location(33,42)..Location(33,43)) }) } is not supported |
| `q69` | SQLInterfaceError: expression Exists { subquery: Query { with: None, body: Select(Select { select_token: TokenWithSpan { token: Word(Word { value: "SELECT", quote_style: None, keyword: SELECT }), span: Span(Location(18,5)..Location(18,11)) }, distinct: None, top: None, top_before_distinct: false, pr |
| `q70` | SQLInterfaceError: unsupported function 'grouping' |
| `q72` | SQLInterfaceError: unsupported SQL join constraint: On(Nested(BinaryOp { left: Identifier(Ident { value: "cs_item_sk", quote_style: None, span: Span(Location(11,5)..Location(11,15)) }), op: Eq, right: Identifier(Ident { value: "inv_item_sk", quote_style: None, span: Span(Location(11,18)..Location(11 |
| `q73` | SQLInterfaceError: array element BinaryOp { left: Value(ValueWithSpan { value: Number("1998", false), span: Span(Location(32,35)..Location(32,39)) }), op: Plus, right: Value(ValueWithSpan { value: Number("1", false), span: Span(Location(32,42)..Location(32,43)) }) } is not supported |
| `q74` | SQLInterfaceError: array element BinaryOp { left: Value(ValueWithSpan { value: Number("1998", false), span: Span(Location(15,22)..Location(15,26)) }), op: Plus, right: Value(ValueWithSpan { value: Number("1", false), span: Span(Location(15,29)..Location(15,30)) }) } is not supported |
| `q75` | SQLInterfaceError: unsupported SQL join constraint: On(Nested(BinaryOp { left: BinaryOp { left: Identifier(Ident { value: "cs_order_number", quote_style: None, span: Span(Location(26,9)..Location(26,24)) }), op: Eq, right: Identifier(Ident { value: "cr_order_number", quote_style: None, span: Span(Lo |
| `q77` | SQLSyntaxError: unsupported interval syntax ('INTERVAL 30 DAY') |
| `q78` | SQLInterfaceError: unsupported SQL join constraint: On(Nested(BinaryOp { left: BinaryOp { left: BinaryOp { left: Identifier(Ident { value: "ws_sold_year", quote_style: None, span: Span(Location(73,5)..Location(73,17)) }), op: Eq, right: Identifier(Ident { value: "ss_sold_year", quote_style: None, sp |
| `q79` | SQLInterfaceError: array element BinaryOp { left: Value(ValueWithSpan { value: Number("1999", false), span: Span(Location(28,35)..Location(28,39)) }), op: Plus, right: Value(ValueWithSpan { value: Number("1", false), span: Span(Location(28,42)..Location(28,43)) }) } is not supported |
| `q80` | SQLInterfaceError: unsupported SQL join constraint: On(Nested(BinaryOp { left: BinaryOp { left: Identifier(Ident { value: "ss_item_sk", quote_style: None, span: Span(Location(10,7)..Location(10,17)) }), op: Eq, right: Identifier(Ident { value: "sr_item_sk", quote_style: None, span: Span(Location(10, |
| `q81` | SQLSyntaxError: subquery comparisons with '>' are not supported |
| `q82` | SQLSyntaxError: unsupported interval syntax ('INTERVAL 60 DAY') |
| `q85` | ShapeError: sort expressions must have same length as DataFrame, got DataFrame height: 0 and Series length: 1 |
| `q86` | SQLInterfaceError: unsupported function 'grouping' |
| `q89` | SchemaError: could not evaluate comparison between series 'avg_monthly_sales' of dtype: List(Float64) and series 'literal' of dtype: Int32 |
| `q91` | ColumnNotFoundError: unable to find column "cr_net_loss"; valid columns: ["Call_Center", "Call_Center_Name", "Manager", "Returns_Loss", "cc_call_center_id", "cc_name", "cc_manager", "cd_marital_status", "cd_education_status"]  Resolved plan until failure:  	---> FAILED HERE RESOLVING 'sink' <--- SEL |
| `q92` | SQLSyntaxError: unsupported interval syntax ('INTERVAL 90 DAY') |
| `q93` | SQLInterfaceError: unsupported SQL join constraint: On(Nested(BinaryOp { left: BinaryOp { left: Identifier(Ident { value: "sr_item_sk", quote_style: None, span: Span(Location(21,7)..Location(21,17)) }), op: Eq, right: Identifier(Ident { value: "ss_item_sk", quote_style: None, span: Span(Location(21, |
| `q94` | SQLSyntaxError: unsupported interval syntax ('INTERVAL 60 DAY') |
| `q95` | SQLInterfaceError: ambiguous reference to column "ws_order_number" (use one of: ws1.ws_order_number, ws2.ws_order_number) |
| `q96` | ColumnNotFoundError: "len" not found |
| `q97` | SQLInterfaceError: unsupported SQL join constraint: On(Nested(BinaryOp { left: BinaryOp { left: CompoundIdentifier([Ident { value: "ssci", quote_style: None, span: Span(Location(51,5)..Location(51,9)) }, Ident { value: "customer_sk", quote_style: None, span: Span(Location(51,10)..Location(51,21)) }] |
| `q98` | SQLSyntaxError: unsupported interval syntax ('INTERVAL 30 DAY') |

---

## ClickBench

⚠️ **35/43 queries passed (81.4%)**

### Failed queries

| Querie | Error |
|---|---|
| `q7` | DuplicateError: projections contained duplicate output name 'EventDate'. It's possible that multiple expressions are returning the same default column name. If this is the case, try renaming the columns with `.alias("new_name")` to avoid duplicate column names.  Resolved plan until failure:  	---> F |
| `q16` | ColumnNotFoundError: "UserID" not found |
| `q17` | ColumnNotFoundError: "UserID" not found |
| `q19` | ColumnNotFoundError: "UserID" not found |
| `q29` | SQLInterfaceError: unsupported function 'regexp_replace' |
| `q30` | DuplicateError: projections contained duplicate output name 'ResolutionWidth'. It's possible that multiple expressions are returning the same default column name. If this is the case, try renaming the columns with `.alias("new_name")` to avoid duplicate column names.  Resolved plan until failure:  	 |
| `q36` | DuplicateError: group_by keys contained duplicate output name 'ClientIP'. It's possible that multiple expressions are returning the same default column name. If this is the case, try renaming the columns with `.alias("new_name")` to avoid duplicate column names. |
| `q43` | SQLInterfaceError: unsupported function 'date_trunc' |

---

## ELTBench

✅ **12/12 tasks passed (100.0%)**

---
