Skip to content

feat[array]: Patched array remove GPU transpose#8127

Draft
joseph-isaacs wants to merge 4 commits into
developfrom
claude/add-transpose-metadata-8iZD0
Draft

feat[array]: Patched array remove GPU transpose#8127
joseph-isaacs wants to merge 4 commits into
developfrom
claude/add-transpose-metadata-8iZD0

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

Summary

Closes: #000

Testing

@joseph-isaacs joseph-isaacs changed the title Claude/add transpose metadata 8i zd0 feat[array]: Patched array remove default transpose May 27, 2026
@joseph-isaacs joseph-isaacs force-pushed the claude/add-transpose-metadata-8iZD0 branch from da1a0a9 to 9a73899 Compare May 27, 2026 14:08
@joseph-isaacs joseph-isaacs added changelog/feature A new feature action/benchmark Trigger full benchmarks to run on this PR labels May 27, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 27, 2026
claude and others added 4 commits May 27, 2026 16:15
Remove the eager GPU lane transpose from the Patched array. Patches are now
kept in their natural sorted layout with one chunk offset per 1024-element
chunk, mirroring the Patches helper, and execute/slice/take/compare/filter
reuse the existing untransposed patch machinery.

The transpose count (n_lanes) is retained as metadata so the data-parallel
GPU transpose can be re-added in the future without a format change.

Signed-off-by: Claude <noreply@anthropic.com>
Add SparsePatchedPlugin which, when the experimental Patched encoding is
enabled, deserializes a primitive Sparse array as a Patched array over a
constant fill. A Sparse array is logically patches on top of a constant, so
this reuses the same externalization shim already used for BitPacked and ALP.

Non-primitive (bool/varbin/struct/fixed-size-list) and nullable-patch sparse
arrays remain Sparse, since Patched only represents primitive inners with
non-null patch values.

Signed-off-by: Claude <noreply@anthropic.com>
Microbenchmark isolating loop ordering for patched bitpacked decode: unpack
every 1024-block then scatter all patches, versus unpacking one block and
patching it while still hot in cache. Both do identical work, so any delta is
cache locality. Fused wins 20-40% once the output exceeds L2, peaking around
moderate patch density.

Signed-off-by: Claude <noreply@anthropic.com>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs changed the title feat[array]: Patched array remove default transpose feat[array]: Patched array remove GPU transpose May 27, 2026
@joseph-isaacs joseph-isaacs force-pushed the claude/add-transpose-metadata-8iZD0 branch from 9a73899 to b38b783 Compare May 27, 2026 15:16
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 27, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 9a73899 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -9.6%
Vortex (geomean): 0.806x ✅
Parquet (geomean): 0.888x ✅
Shifts: Parquet (control) -11.2% · Median polish -18.7%


datafusion / vortex-file-compressed (0.811x ✅, 21↑ 0↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 49809658 58199200 0.86
tpch_q02/datafusion:vortex-file-compressed 22908411 25429687 0.90
tpch_q03/datafusion:vortex-file-compressed 🚀 28536565 31863009 0.90
tpch_q04/datafusion:vortex-file-compressed 🚀 20212580 23990415 0.84
tpch_q05/datafusion:vortex-file-compressed 🚀 48145144 60013345 0.80
tpch_q06/datafusion:vortex-file-compressed 🚀 10575436 12709206 0.83
tpch_q07/datafusion:vortex-file-compressed 🚀 53552667 69316441 0.77
tpch_q08/datafusion:vortex-file-compressed 🚀 39596895 48825623 0.81
tpch_q09/datafusion:vortex-file-compressed 🚀 51526045 65397651 0.79
tpch_q10/datafusion:vortex-file-compressed 🚀 39121592 47141591 0.83
tpch_q11/datafusion:vortex-file-compressed 🚀 15587201 19298313 0.81
tpch_q12/datafusion:vortex-file-compressed 🚀 23960233 28760306 0.83
tpch_q13/datafusion:vortex-file-compressed 🚀 25545593 29869879 0.86
tpch_q14/datafusion:vortex-file-compressed 🚀 15589853 20082398 0.78
tpch_q15/datafusion:vortex-file-compressed 🚀 23923761 30692313 0.78
tpch_q16/datafusion:vortex-file-compressed 🚀 19319420 23176851 0.83
tpch_q17/datafusion:vortex-file-compressed 🚀 67114180 100523840 0.67
tpch_q18/datafusion:vortex-file-compressed 🚀 79534013 109383824 0.73
tpch_q19/datafusion:vortex-file-compressed 🚀 20525506 23149200 0.89
tpch_q20/datafusion:vortex-file-compressed 🚀 28991142 35952305 0.81
tpch_q21/datafusion:vortex-file-compressed 🚀 69942366 93781069 0.75
tpch_q22/datafusion:vortex-file-compressed 🚀 12183538 14565834 0.84
datafusion / vortex-compact (0.819x ✅, 22↑ 0↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀 58450480 68265166 0.86
tpch_q02/datafusion:vortex-compact 🚀 26033859 29329079 0.89
tpch_q03/datafusion:vortex-compact 🚀 28755273 33904562 0.85
tpch_q04/datafusion:vortex-compact 🚀 22124127 27331469 0.81
tpch_q05/datafusion:vortex-compact 🚀 49840941 61659680 0.81
tpch_q06/datafusion:vortex-compact 🚀 12117083 14898639 0.81
tpch_q07/datafusion:vortex-compact 🚀 59896796 73493198 0.81
tpch_q08/datafusion:vortex-compact 🚀 42821782 54241345 0.79
tpch_q09/datafusion:vortex-compact 🚀 55872155 69171087 0.81
tpch_q10/datafusion:vortex-compact 🚀 45824569 55368973 0.83
tpch_q11/datafusion:vortex-compact 🚀 16773046 20455274 0.82
tpch_q12/datafusion:vortex-compact 🚀 31185521 38112618 0.82
tpch_q13/datafusion:vortex-compact 🚀 31489613 38029165 0.83
tpch_q14/datafusion:vortex-compact 🚀 19598978 23351577 0.84
tpch_q15/datafusion:vortex-compact 🚀 30333620 38720780 0.78
tpch_q16/datafusion:vortex-compact 🚀 24118646 29882914 0.81
tpch_q17/datafusion:vortex-compact 🚀 70150271 89148602 0.79
tpch_q18/datafusion:vortex-compact 🚀 84844552 110266540 0.77
tpch_q19/datafusion:vortex-compact 🚀 31006611 35490136 0.87
tpch_q20/datafusion:vortex-compact 🚀 34554302 40982693 0.84
tpch_q21/datafusion:vortex-compact 🚀 75581060 97274380 0.78
tpch_q22/datafusion:vortex-compact 🚀 12356325 14971336 0.83
datafusion / parquet (0.885x ✅, 15↑ 1↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 129888238 100358892 1.29
tpch_q02/datafusion:parquet 🚀 61829118 71308714 0.87
tpch_q03/datafusion:parquet 72850170 75503103 0.96
tpch_q04/datafusion:parquet 🚀 43355622 49177163 0.88
tpch_q05/datafusion:parquet 🚀 93020748 108411837 0.86
tpch_q06/datafusion:parquet 42667676 39935263 1.07
tpch_q07/datafusion:parquet 🚀 103468534 122609517 0.84
tpch_q08/datafusion:parquet 93708695 100224595 0.93
tpch_q09/datafusion:parquet 🚀 128611503 146379430 0.88
tpch_q10/datafusion:parquet 🚀 110568143 123316374 0.90
tpch_q11/datafusion:parquet 🚀 41084724 46778557 0.88
tpch_q12/datafusion:parquet 86430287 90523251 0.95
tpch_q13/datafusion:parquet 🚀 200453633 239040344 0.84
tpch_q14/datafusion:parquet 🚀 44977145 51243182 0.88
tpch_q15/datafusion:parquet 58433013 63079586 0.93
tpch_q16/datafusion:parquet 🚀 42302003 49350148 0.86
tpch_q17/datafusion:parquet 🚀 124265181 188823109 0.66
tpch_q18/datafusion:parquet 🚀 164593630 239528817 0.69
tpch_q19/datafusion:parquet 🚀 67900816 83471124 0.81
tpch_q20/datafusion:parquet 🚀 68725240 76400855 0.90
tpch_q21/datafusion:parquet 136197947 149392736 0.91
tpch_q22/datafusion:parquet 🚀 30614790 35775445 0.86
datafusion / arrow (0.787x ✅, 21↑ 0↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 56011965 75702545 0.74
tpch_q02/datafusion:arrow 🚀 19034697 22108914 0.86
tpch_q03/datafusion:arrow 🚀 30720433 37719890 0.81
tpch_q04/datafusion:arrow 🚀 27146154 32667446 0.83
tpch_q05/datafusion:arrow 🚀 79798338 102239100 0.78
tpch_q06/datafusion:arrow 🚀 19346288 27573494 0.70
tpch_q07/datafusion:arrow 🚀 102358889 154672164 0.66
tpch_q08/datafusion:arrow 🚀 42978854 63529235 0.68
tpch_q09/datafusion:arrow 🚀 64571741 86452847 0.75
tpch_q10/datafusion:arrow 🚀 45366011 57267549 0.79
tpch_q11/datafusion:arrow 🚀 9166684 10372854 0.88
tpch_q12/datafusion:arrow 🚀 51298180 64055819 0.80
tpch_q13/datafusion:arrow 48062205 53236129 0.90
tpch_q14/datafusion:arrow 🚀 21615202 27479696 0.79
tpch_q15/datafusion:arrow 🚀 41717778 53232067 0.78
tpch_q16/datafusion:arrow 🚀 19027381 21981802 0.87
tpch_q17/datafusion:arrow 🚀 67169777 89761064 0.75
tpch_q18/datafusion:arrow 🚀 133399836 181459485 0.74
tpch_q19/datafusion:arrow 🚀 33871361 44938031 0.75
tpch_q20/datafusion:arrow 🚀 33540088 43756070 0.77
tpch_q21/datafusion:arrow 🚀 155810083 179073237 0.87
tpch_q22/datafusion:arrow 🚀 17733920 20073290 0.88
duckdb / vortex-file-compressed (0.784x ✅, 22↑ 0↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚀 31027967 35097124 0.88
tpch_q02/duckdb:vortex-file-compressed 🚀 25412130 28685107 0.89
tpch_q03/duckdb:vortex-file-compressed 🚀 32578148 38268760 0.85
tpch_q04/duckdb:vortex-file-compressed 🚀 28772445 32836887 0.88
tpch_q05/duckdb:vortex-file-compressed 🚀 37140449 54227140 0.68
tpch_q06/duckdb:vortex-file-compressed 🚀 8608396 9800792 0.88
tpch_q07/duckdb:vortex-file-compressed 🚀 34107803 45130774 0.76
tpch_q08/duckdb:vortex-file-compressed 🚀 37509832 46993573 0.80
tpch_q09/duckdb:vortex-file-compressed 🚀 56771307 81390259 0.70
tpch_q10/duckdb:vortex-file-compressed 🚀 41084926 50821888 0.81
tpch_q11/duckdb:vortex-file-compressed 🚀 15133083 17211272 0.88
tpch_q12/duckdb:vortex-file-compressed 🚀 22378954 27970695 0.80
tpch_q13/duckdb:vortex-file-compressed 🚀 41153860 52861636 0.78
tpch_q14/duckdb:vortex-file-compressed 🚀 22204963 28769420 0.77
tpch_q15/duckdb:vortex-file-compressed 🚀 17184728 23595709 0.73
tpch_q16/duckdb:vortex-file-compressed 🚀 28423690 36979274 0.77
tpch_q17/duckdb:vortex-file-compressed 🚀 24235290 33923054 0.71
tpch_q18/duckdb:vortex-file-compressed 🚀 53322339 70993771 0.75
tpch_q19/duckdb:vortex-file-compressed 🚀 28538511 42074136 0.68
tpch_q20/duckdb:vortex-file-compressed 🚀 32900118 47312966 0.70
tpch_q21/duckdb:vortex-file-compressed 🚀 99844768 126175279 0.79
tpch_q22/duckdb:vortex-file-compressed 🚀 16729829 20286458 0.82
duckdb / vortex-compact (0.812x ✅, 21↑ 0↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚀 38657091 43055428 0.90
tpch_q02/duckdb:vortex-compact 🚀 32412519 39656644 0.82
tpch_q03/duckdb:vortex-compact 🚀 34500070 39500574 0.87
tpch_q04/duckdb:vortex-compact 🚀 31649998 35396522 0.89
tpch_q05/duckdb:vortex-compact 🚀 40364635 47496994 0.85
tpch_q06/duckdb:vortex-compact 11438239 12045225 0.95
tpch_q07/duckdb:vortex-compact 🚀 40575904 49636566 0.82
tpch_q08/duckdb:vortex-compact 🚀 41701893 49327512 0.85
tpch_q09/duckdb:vortex-compact 🚀 64870498 84546272 0.77
tpch_q10/duckdb:vortex-compact 🚀 45916393 54565550 0.84
tpch_q11/duckdb:vortex-compact 🚀 18252632 23263845 0.78
tpch_q12/duckdb:vortex-compact 🚀 30225766 38610239 0.78
tpch_q13/duckdb:vortex-compact 🚀 46490643 60707317 0.77
tpch_q14/duckdb:vortex-compact 🚀 25516100 34898159 0.73
tpch_q15/duckdb:vortex-compact 🚀 19721423 27120225 0.73
tpch_q16/duckdb:vortex-compact 🚀 32206864 41935586 0.77
tpch_q17/duckdb:vortex-compact 🚀 29154638 38315369 0.76
tpch_q18/duckdb:vortex-compact 🚀 53355965 62017407 0.86
tpch_q19/duckdb:vortex-compact 🚀 32800919 40610908 0.81
tpch_q20/duckdb:vortex-compact 🚀 39859721 48740115 0.82
tpch_q21/duckdb:vortex-compact 🚀 102545554 136218500 0.75
tpch_q22/duckdb:vortex-compact 🚀 18590633 23290556 0.80
duckdb / parquet (0.890x ✅, 13↑ 1↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77379017 83342628 0.93
tpch_q02/duckdb:parquet 🚀 39729148 46858638 0.85
tpch_q03/duckdb:parquet 🚀 70313626 85877163 0.82
tpch_q04/duckdb:parquet 55710938 59182131 0.94
tpch_q05/duckdb:parquet 🚀 67647911 79628806 0.85
tpch_q06/duckdb:parquet 🚀 22225509 25094398 0.89
tpch_q07/duckdb:parquet 🚀 76186949 91606195 0.83
tpch_q08/duckdb:parquet 95564815 103492014 0.92
tpch_q09/duckdb:parquet 🚀 133847728 162640606 0.82
tpch_q10/duckdb:parquet 🚀 130425538 151080724 0.86
tpch_q11/duckdb:parquet 22234287 24538095 0.91
tpch_q12/duckdb:parquet 🚨 58227225 50678554 1.15
tpch_q13/duckdb:parquet 🚀 250653381 296461928 0.85
tpch_q14/duckdb:parquet 🚀 50597966 56370274 0.90
tpch_q15/duckdb:parquet 🚀 26222824 32020998 0.82
tpch_q16/duckdb:parquet 🚀 57398900 66338299 0.87
tpch_q17/duckdb:parquet 60926650 61301585 0.99
tpch_q18/duckdb:parquet 117821254 127878431 0.92
tpch_q19/duckdb:parquet 🚀 68646915 79207552 0.87
tpch_q20/duckdb:parquet 65574150 69454053 0.94
tpch_q21/duckdb:parquet 🚀 170740652 211581994 0.81
tpch_q22/duckdb:parquet 53744025 58237937 0.92
duckdb / duckdb (0.803x ✅, 22↑ 0↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 🚀 17804745 20894362 0.85
tpch_q02/duckdb:duckdb 🚀 14291358 18786944 0.76
tpch_q03/duckdb:duckdb 🚀 22022412 28127191 0.78
tpch_q04/duckdb:duckdb 🚀 21838919 27838033 0.78
tpch_q05/duckdb:duckdb 🚀 23661142 30530669 0.77
tpch_q06/duckdb:duckdb 🚀 7120091 8443666 0.84
tpch_q07/duckdb:duckdb 🚀 25431610 32045614 0.79
tpch_q08/duckdb:duckdb 🚀 24958582 30690186 0.81
tpch_q09/duckdb:duckdb 🚀 55862568 81369895 0.69
tpch_q10/duckdb:duckdb 🚀 49675177 65599010 0.76
tpch_q11/duckdb:duckdb 🚀 7136377 8497901 0.84
tpch_q12/duckdb:duckdb 🚀 17801356 20983136 0.85
tpch_q13/duckdb:duckdb 🚀 39304972 48525044 0.81
tpch_q14/duckdb:duckdb 🚀 21266657 24617157 0.86
tpch_q15/duckdb:duckdb 🚀 13510343 15598319 0.87
tpch_q16/duckdb:duckdb 🚀 25922911 30873246 0.84
tpch_q17/duckdb:duckdb 🚀 16583111 19567025 0.85
tpch_q18/duckdb:duckdb 🚀 41108782 51563161 0.80
tpch_q19/duckdb:duckdb 🚀 30678970 43049781 0.71
tpch_q20/duckdb:duckdb 🚀 25563564 30274928 0.84
tpch_q21/duckdb:duckdb 🚀 61487387 84959860 0.72
tpch_q22/duckdb:duckdb 🚀 25233368 29731673 0.85
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -26.0% +9.6% -32.5% +21.6% ✅ faster
1 datafusion:vortex-compact -14.4% +9.6% -21.9% +21.6% ✅ faster
1 datafusion:vortex-file-compressed -14.4% +9.6% -21.9% +21.6% ✅ faster
1 duckdb:duckdb -14.8% +9.6% -22.3% +21.6% ✅ faster
1 duckdb:vortex-compact -10.2% +9.6% -18.1% +21.6% ✅ faster
1 duckdb:vortex-file-compressed -11.6% +9.6% -19.4% +21.6% ✅ faster
2 datafusion:arrow -13.9% -14.3% +0.4% +21.6% ➖ noise
2 datafusion:vortex-compact -11.2% -14.3% +3.5% +21.6% ➖ noise
2 datafusion:vortex-file-compressed -9.9% -14.3% +5.1% +21.6% ➖ noise
2 duckdb:duckdb -23.9% -14.3% -11.3% +21.6% ➖ noise
2 duckdb:vortex-compact -18.3% -14.3% -4.7% +21.6% ➖ noise
2 duckdb:vortex-file-compressed -11.4% -14.3% +3.3% +21.6% ➖ noise
3 datafusion:arrow -18.6% -11.1% -8.4% +21.6% ➖ noise
3 datafusion:vortex-compact -15.2% -11.1% -4.6% +21.6% ➖ noise
3 datafusion:vortex-file-compressed -10.4% -11.1% +0.8% +21.6% ➖ noise
3 duckdb:duckdb -21.7% -11.1% -11.9% +21.6% ➖ noise
3 duckdb:vortex-compact -12.7% -11.1% -1.7% +21.6% ➖ noise
3 duckdb:vortex-file-compressed -14.9% -11.1% -4.2% +21.6% ➖ noise
4 datafusion:arrow -16.9% -8.9% -8.8% +21.6% ➖ noise
4 datafusion:vortex-compact -19.1% -8.9% -11.1% +21.6% ➖ noise
4 datafusion:vortex-file-compressed -15.7% -8.9% -7.5% +21.6% ➖ noise
4 duckdb:duckdb -21.6% -8.9% -13.9% +21.6% ➖ noise
4 duckdb:vortex-compact -10.6% -8.9% -1.8% +21.6% ➖ noise
4 duckdb:vortex-file-compressed -12.4% -8.9% -3.8% +21.6% ➖ noise
5 datafusion:arrow -21.9% -14.6% -8.6% +21.6% ➖ noise
5 datafusion:vortex-compact -19.2% -14.6% -5.3% +21.6% ➖ noise
5 datafusion:vortex-file-compressed -19.8% -14.6% -6.0% +21.6% ➖ noise
5 duckdb:duckdb -22.5% -14.6% -9.2% +21.6% ➖ noise
5 duckdb:vortex-compact -15.0% -14.6% -0.5% +21.6% ➖ noise
5 duckdb:vortex-file-compressed -31.5% -14.6% -19.8% +21.6% ✅ faster
6 datafusion:arrow -29.8% -2.7% -27.9% +21.6% ✅ faster
6 datafusion:vortex-compact -18.7% -2.7% -16.4% +21.6% ➖ noise
6 datafusion:vortex-file-compressed -16.8% -2.7% -14.5% +21.6% ➖ noise
6 duckdb:duckdb -15.7% -2.7% -13.3% +21.6% ➖ noise
6 duckdb:vortex-compact -5.0% -2.7% -2.4% +21.6% ➖ noise
6 duckdb:vortex-file-compressed -12.2% -2.7% -9.7% +21.6% ➖ noise
7 datafusion:arrow -33.8% -16.2% -21.0% +21.6% ✅ faster
7 datafusion:vortex-compact -18.5% -16.2% -2.7% +21.6% ➖ noise
7 datafusion:vortex-file-compressed -22.7% -16.2% -7.8% +21.6% ➖ noise
7 duckdb:duckdb -20.6% -16.2% -5.3% +21.6% ➖ noise
7 duckdb:vortex-compact -18.3% -16.2% -2.4% +21.6% ➖ noise
7 duckdb:vortex-file-compressed -24.4% -16.2% -9.8% +21.6% ➖ noise
8 datafusion:arrow -32.3% -7.1% -27.2% +21.6% ✅ faster
8 datafusion:vortex-compact -21.1% -7.1% -15.0% +21.6% ➖ noise
8 datafusion:vortex-file-compressed -18.9% -7.1% -12.7% +21.6% ➖ noise
8 duckdb:duckdb -18.7% -7.1% -12.5% +21.6% ➖ noise
8 duckdb:vortex-compact -15.5% -7.1% -9.0% +21.6% ➖ noise
8 duckdb:vortex-file-compressed -20.2% -7.1% -14.1% +21.6% ➖ noise
9 datafusion:arrow -25.3% -15.0% -12.2% +21.6% ➖ noise
9 datafusion:vortex-compact -19.2% -15.0% -5.0% +21.6% ➖ noise
9 datafusion:vortex-file-compressed -21.2% -15.0% -7.3% +21.6% ➖ noise
9 duckdb:duckdb -31.3% -15.0% -19.3% +21.6% ✅ faster
9 duckdb:vortex-compact -23.3% -15.0% -9.8% +21.6% ➖ noise
9 duckdb:vortex-file-compressed -30.2% -15.0% -18.0% +21.6% ✅ faster
10 datafusion:arrow -20.8% -12.0% -10.0% +21.6% ➖ noise
10 datafusion:vortex-compact -17.2% -12.0% -5.9% +21.6% ➖ noise
10 datafusion:vortex-file-compressed -17.0% -12.0% -5.7% +21.6% ➖ noise
10 duckdb:duckdb -24.3% -12.0% -13.9% +21.6% ➖ noise
10 duckdb:vortex-compact -15.9% -12.0% -4.4% +21.6% ➖ noise
10 duckdb:vortex-file-compressed -19.2% -12.0% -8.1% +21.6% ➖ noise
11 datafusion:arrow -11.6% -10.8% -0.9% +21.6% ➖ noise
11 datafusion:vortex-compact -18.0% -10.8% -8.1% +21.6% ➖ noise
11 datafusion:vortex-file-compressed -19.2% -10.8% -9.5% +21.6% ➖ noise
11 duckdb:duckdb -16.0% -10.8% -5.9% +21.6% ➖ noise
11 duckdb:vortex-compact -21.5% -10.8% -12.0% +21.6% ➖ noise
11 duckdb:vortex-file-compressed -12.1% -10.8% -1.4% +21.6% ➖ noise
12 datafusion:arrow -19.9% +4.7% -23.5% +21.6% ✅ faster
12 datafusion:vortex-compact -18.2% +4.7% -21.9% +21.6% ✅ faster
12 datafusion:vortex-file-compressed -16.7% +4.7% -20.5% +21.6% ✅ faster
12 duckdb:duckdb -15.2% +4.7% -19.0% +21.6% ✅ faster
12 duckdb:vortex-compact -21.7% +4.7% -25.3% +21.6% ✅ faster
12 duckdb:vortex-file-compressed -20.0% +4.7% -23.6% +21.6% ✅ faster
13 datafusion:arrow -9.7% -15.8% +7.2% +21.6% ➖ noise
13 datafusion:vortex-compact -17.2% -15.8% -1.7% +21.6% ➖ noise
13 datafusion:vortex-file-compressed -14.5% -15.8% +1.6% +21.6% ➖ noise
13 duckdb:duckdb -19.0% -15.8% -3.8% +21.6% ➖ noise
13 duckdb:vortex-compact -23.4% -15.8% -9.1% +21.6% ➖ noise
13 duckdb:vortex-file-compressed -22.1% -15.8% -7.5% +21.6% ➖ noise
14 datafusion:arrow -21.3% -11.2% -11.4% +21.6% ➖ noise
14 datafusion:vortex-compact -16.1% -11.2% -5.4% +21.6% ➖ noise
14 datafusion:vortex-file-compressed -22.4% -11.2% -12.5% +21.6% ➖ noise
14 duckdb:duckdb -13.6% -11.2% -2.7% +21.6% ➖ noise
14 duckdb:vortex-compact -26.9% -11.2% -17.6% +21.6% ➖ noise
14 duckdb:vortex-file-compressed -22.8% -11.2% -13.0% +21.6% ➖ noise
15 datafusion:arrow -21.6% -12.9% -10.0% +21.6% ➖ noise
15 datafusion:vortex-compact -21.7% -12.9% -10.1% +21.6% ➖ noise
15 datafusion:vortex-file-compressed -22.1% -12.9% -10.5% +21.6% ➖ noise
15 duckdb:duckdb -13.4% -12.9% -0.6% +21.6% ➖ noise
15 duckdb:vortex-compact -27.3% -12.9% -16.5% +21.6% ➖ noise
15 duckdb:vortex-file-compressed -27.2% -12.9% -16.4% +21.6% ➖ noise
16 datafusion:arrow -13.4% -13.9% +0.5% +21.6% ➖ noise
16 datafusion:vortex-compact -19.3% -13.9% -6.3% +21.6% ➖ noise
16 datafusion:vortex-file-compressed -16.6% -13.9% -3.2% +21.6% ➖ noise
16 duckdb:duckdb -16.0% -13.9% -2.5% +21.6% ➖ noise
16 duckdb:vortex-compact -23.2% -13.9% -10.8% +21.6% ➖ noise
16 duckdb:vortex-file-compressed -23.1% -13.9% -10.7% +21.6% ➖ noise
17 datafusion:arrow -25.2% -19.1% -7.5% +21.6% ➖ noise
17 datafusion:vortex-compact -21.3% -19.1% -2.7% +21.6% ➖ noise
17 datafusion:vortex-file-compressed -33.2% -19.1% -17.4% +21.6% ➖ noise
17 duckdb:duckdb -15.2% -19.1% +4.8% +21.6% ➖ noise
17 duckdb:vortex-compact -23.9% -19.1% -5.9% +21.6% ➖ noise
17 duckdb:vortex-file-compressed -28.6% -19.1% -11.7% +21.6% ➖ noise
18 datafusion:arrow -26.5% -20.4% -7.6% +21.6% ➖ noise
18 datafusion:vortex-compact -23.1% -20.4% -3.3% +21.6% ➖ noise
18 datafusion:vortex-file-compressed -27.3% -20.4% -8.6% +21.6% ➖ noise
18 duckdb:duckdb -20.3% -20.4% +0.2% +21.6% ➖ noise
18 duckdb:vortex-compact -14.0% -20.4% +8.1% +21.6% ➖ noise
18 duckdb:vortex-file-compressed -24.9% -20.4% -5.6% +21.6% ➖ noise
19 datafusion:arrow -24.6% -16.0% -10.2% +21.6% ➖ noise
19 datafusion:vortex-compact -12.6% -16.0% +4.1% +21.6% ➖ noise
19 datafusion:vortex-file-compressed -11.3% -16.0% +5.6% +21.6% ➖ noise
19 duckdb:duckdb -28.7% -16.0% -15.1% +21.6% ➖ noise
19 duckdb:vortex-compact -19.2% -16.0% -3.8% +21.6% ➖ noise
19 duckdb:vortex-file-compressed -32.2% -16.0% -19.2% +21.6% ✅ faster
20 datafusion:arrow -23.3% -7.8% -16.8% +21.6% ➖ noise
20 datafusion:vortex-compact -15.7% -7.8% -8.5% +21.6% ➖ noise
20 datafusion:vortex-file-compressed -19.4% -7.8% -12.5% +21.6% ➖ noise
20 duckdb:duckdb -15.6% -7.8% -8.4% +21.6% ➖ noise
20 duckdb:vortex-compact -18.2% -7.8% -11.3% +21.6% ➖ noise
20 duckdb:vortex-file-compressed -30.5% -7.8% -24.5% +21.6% ✅ faster
21 datafusion:arrow -13.0% -14.2% +1.4% +21.6% ➖ noise
21 datafusion:vortex-compact -22.3% -14.2% -9.4% +21.6% ➖ noise
21 datafusion:vortex-file-compressed -25.4% -14.2% -13.0% +21.6% ➖ noise
21 duckdb:duckdb -27.6% -14.2% -15.6% +21.6% ➖ noise
21 duckdb:vortex-compact -24.7% -14.2% -12.2% +21.6% ➖ noise
21 duckdb:vortex-file-compressed -20.9% -14.2% -7.7% +21.6% ➖ noise
22 datafusion:arrow -11.7% -11.1% -0.6% +21.6% ➖ noise
22 datafusion:vortex-compact -17.5% -11.1% -7.1% +21.6% ➖ noise
22 datafusion:vortex-file-compressed -16.4% -11.1% -5.9% +21.6% ➖ noise
22 duckdb:duckdb -15.1% -11.1% -4.5% +21.6% ➖ noise
22 duckdb:vortex-compact -20.2% -11.1% -10.2% +21.6% ➖ noise
22 duckdb:vortex-file-compressed -17.5% -11.1% -7.2% +21.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

File Size Changes (3 files changed, -0.0% overall, 0↑ 3↓)
File Scale Format Base HEAD Change %
orders_0.vortex 1.0 vortex-file-compressed 43.43 MB 43.42 MB 13.55 KB -0.0%
lineitem_1.vortex 1.0 vortex-file-compressed 84.90 MB 84.82 MB 83.95 KB -0.1%
lineitem_0.vortex 1.0 vortex-file-compressed 85.42 MB 85.34 MB 85.26 KB -0.1%

Totals:

  • vortex-compact: 194.82 MB → 194.82 MB (0.0%)
  • vortex-file-compressed: 266.61 MB → 266.43 MB (-0.1%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.3%
Vortex (geomean): 1.067x ➖
Parquet (geomean): 1.092x ➖
Shifts: Parquet (control) +9.2% · Median polish +7.3%


datafusion / vortex-file-compressed (1.056x ➖, 0↑ 3↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 6010632 5117935 1.17
fineweb_q01/datafusion:vortex-file-compressed 20826968 20766479 1.00
fineweb_q02/datafusion:vortex-file-compressed 21570142 21364550 1.01
fineweb_q03/datafusion:vortex-file-compressed 80296919 80878093 0.99
fineweb_q04/datafusion:vortex-file-compressed 230223070 228101229 1.01
fineweb_q05/datafusion:vortex-file-compressed 222824136 219949871 1.01
fineweb_q06/datafusion:vortex-file-compressed 54593156 52244519 1.04
fineweb_q07/datafusion:vortex-file-compressed 🚨 63045219 55090778 1.14
fineweb_q08/datafusion:vortex-file-compressed 🚨 23886670 21125375 1.13
datafusion / vortex-compact (1.074x ➖, 0↑ 4↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 6093547 6024412 1.01
fineweb_q01/datafusion:vortex-compact 99557696 97684086 1.02
fineweb_q02/datafusion:vortex-compact 🚨 129146317 105152284 1.23
fineweb_q03/datafusion:vortex-compact 🚨 954391314 863993340 1.10
fineweb_q04/datafusion:vortex-compact 1000793058 920948633 1.09
fineweb_q05/datafusion:vortex-compact 903984702 843703627 1.07
fineweb_q06/datafusion:vortex-compact 🚨 516748227 469455462 1.10
fineweb_q07/datafusion:vortex-compact 🚨 531269196 479496663 1.11
fineweb_q08/datafusion:vortex-compact 18738237 19506773 0.96
datafusion / parquet (1.095x ➖, 0↑ 4↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 7025023 6226686 1.13
fineweb_q01/datafusion:parquet 315468861 294257043 1.07
fineweb_q02/datafusion:parquet 🚨 333256226 297174451 1.12
fineweb_q03/datafusion:parquet 🚨 331591773 292485532 1.13
fineweb_q04/datafusion:parquet 328029821 304361653 1.08
fineweb_q05/datafusion:parquet 326336421 305105804 1.07
fineweb_q06/datafusion:parquet 312908356 298628903 1.05
fineweb_q07/datafusion:parquet 305383076 279759247 1.09
fineweb_q08/datafusion:parquet 🚨 308479787 276937457 1.11
duckdb / vortex-file-compressed (1.092x ➖, 0↑ 1↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3794775 3461558 1.10
fineweb_q01/duckdb:vortex-file-compressed 23299045 22075065 1.06
fineweb_q02/duckdb:vortex-file-compressed 25411454 23230164 1.09
fineweb_q03/duckdb:vortex-file-compressed 🚨 167207962 119435077 1.40
fineweb_q04/duckdb:vortex-file-compressed 225882008 222577575 1.01
fineweb_q05/duckdb:vortex-file-compressed 222213120 214402859 1.04
fineweb_q06/duckdb:vortex-file-compressed 57218625 53691602 1.07
fineweb_q07/duckdb:vortex-file-compressed 57415702 54721417 1.05
fineweb_q08/duckdb:vortex-file-compressed 23366993 22076830 1.06
duckdb / vortex-compact (1.045x ➖, 1↑ 1↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4501658 4123904 1.09
fineweb_q01/duckdb:vortex-compact 110458621 108538005 1.02
fineweb_q02/duckdb:vortex-compact 124305705 124001062 1.00
fineweb_q03/duckdb:vortex-compact 🚨 947765725 855680145 1.11
fineweb_q04/duckdb:vortex-compact 982006900 900999249 1.09
fineweb_q05/duckdb:vortex-compact 877369266 811524334 1.08
fineweb_q06/duckdb:vortex-compact 496979645 466787207 1.06
fineweb_q07/duckdb:vortex-compact 508807907 476480482 1.07
fineweb_q08/duckdb:vortex-compact 🚀 18688102 20808361 0.90
duckdb / parquet (1.089x ➖, 0↑ 2↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚨 34507598 29538458 1.17
fineweb_q01/duckdb:parquet 92128617 88596285 1.04
fineweb_q02/duckdb:parquet 94698351 86482785 1.09
fineweb_q03/duckdb:parquet 345454726 320132663 1.08
fineweb_q04/duckdb:parquet 472310895 449472225 1.05
fineweb_q05/duckdb:parquet 447540792 419026960 1.07
fineweb_q06/duckdb:parquet 218679186 204349406 1.07
fineweb_q07/duckdb:parquet 233887994 217140548 1.08
fineweb_q08/duckdb:parquet 🚨 38527659 33302326 1.16
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +1.1% +14.8% -11.9% +50.3% ➖ noise
0 datafusion:vortex-file-compressed +17.4% +14.8% +2.3% +53.4% ➖ noise
0 duckdb:vortex-compact +9.2% +14.8% -4.9% +48.9% ➖ noise
0 duckdb:vortex-file-compressed +9.6% +14.8% -4.5% +75.5% ➖ noise
1 datafusion:vortex-compact +1.9% +5.6% -3.5% +21.4% ➖ noise
1 datafusion:vortex-file-compressed +0.3% +5.6% -5.0% +16.4% ➖ noise
1 duckdb:vortex-compact +1.8% +5.6% -3.6% +22.3% ➖ noise
1 duckdb:vortex-file-compressed +5.5% +5.6% -0.0% +65.9% ➖ noise
2 datafusion:vortex-compact +22.8% +10.8% +10.8% +16.9% ➖ noise
2 datafusion:vortex-file-compressed +1.0% +10.8% -8.9% +10.0% ➖ noise
2 duckdb:vortex-compact +0.2% +10.8% -9.5% +16.8% ➖ noise
2 duckdb:vortex-file-compressed +9.4% +10.8% -1.3% +10.0% ➖ noise
3 datafusion:vortex-compact +10.5% +10.6% -0.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -0.7% +10.6% -10.2% +17.9% ➖ noise
3 duckdb:vortex-compact +10.8% +10.6% +0.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +40.0% +10.6% +26.6% +12.2% 🚨 regression
4 datafusion:vortex-compact +8.7% +6.4% +2.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.9% +6.4% -5.2% +10.0% ➖ noise
4 duckdb:vortex-compact +9.0% +6.4% +2.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.5% +6.4% -4.6% +10.0% ➖ noise
5 datafusion:vortex-compact +7.1% +6.9% +0.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.3% +6.9% -5.2% +10.0% ➖ noise
5 duckdb:vortex-compact +8.1% +6.9% +1.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +3.6% +6.9% -3.0% +10.0% ➖ noise
6 datafusion:vortex-compact +10.1% +5.9% +4.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +4.5% +5.9% -1.3% +10.0% ➖ noise
6 duckdb:vortex-compact +6.5% +5.9% +0.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +6.6% +5.9% +0.6% +12.1% ➖ noise
7 datafusion:vortex-compact +10.8% +8.4% +2.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +14.4% +8.4% +5.5% +12.8% ➖ noise
7 duckdb:vortex-compact +6.8% +8.4% -1.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +4.9% +8.4% -3.2% +25.0% ➖ noise
8 datafusion:vortex-compact -3.9% +13.5% -15.4% +34.3% ➖ noise
8 datafusion:vortex-file-compressed +13.1% +13.5% -0.4% +10.0% ➖ noise
8 duckdb:vortex-compact -10.2% +13.5% -20.9% +13.6% ✅ faster
8 duckdb:vortex-file-compressed +5.8% +13.5% -6.8% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.79 GB 1.79 GB 277.86 KB -0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.79 GB → 1.79 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.152x ❌


datafusion / vortex-file-compressed (1.152x ❌, 0↑ 7↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 126555759 119797140 1.06
polarsignals_q01/datafusion:vortex-file-compressed 284086282 287962621 0.99
polarsignals_q02/datafusion:vortex-file-compressed 🚨 27044773 22106321 1.22
polarsignals_q03/datafusion:vortex-file-compressed 🚨 301138044 256730773 1.17
polarsignals_q04/datafusion:vortex-file-compressed 🚨 13931938 11231733 1.24
polarsignals_q05/datafusion:vortex-file-compressed 🚨 18642537 14678050 1.27
polarsignals_q06/datafusion:vortex-file-compressed 🚨 21161492 17385282 1.22
polarsignals_q07/datafusion:vortex-file-compressed 🚨 15308602 12998361 1.18
polarsignals_q08/datafusion:vortex-file-compressed 🚨 448272297 399125414 1.12
polarsignals_q09/datafusion:vortex-file-compressed 11965846 11011374 1.09

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label May 27, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 27, 2026
@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Vortex (geomean): 1.122x ❌
Parquet (geomean): 1.102x ❌
Shifts: Parquet (control) +10.2% · Median polish +9.7%


datafusion / vortex-file-compressed (1.134x ❌, 0↑ 62↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚨 34006752 26775391 1.27
tpcds_q02/datafusion:vortex-file-compressed 🚨 57429019 47522719 1.21
tpcds_q03/datafusion:vortex-file-compressed 🚨 19053106 15458458 1.23
tpcds_q04/datafusion:vortex-file-compressed 🚨 333377447 267423861 1.25
tpcds_q05/datafusion:vortex-file-compressed 🚨 55426572 45416548 1.22
tpcds_q06/datafusion:vortex-file-compressed 🚨 68415469 60170878 1.14
tpcds_q07/datafusion:vortex-file-compressed 🚨 60092973 42874650 1.40
tpcds_q08/datafusion:vortex-file-compressed 🚨 33007101 29673492 1.11
tpcds_q09/datafusion:vortex-file-compressed 🚨 44169380 39160097 1.13
tpcds_q10/datafusion:vortex-file-compressed 🚨 50012496 41059158 1.22
tpcds_q11/datafusion:vortex-file-compressed 🚨 155190431 135266504 1.15
tpcds_q12/datafusion:vortex-file-compressed 🚨 22393345 19321996 1.16
tpcds_q13/datafusion:vortex-file-compressed 52858540 51582455 1.02
tpcds_q14/datafusion:vortex-file-compressed 🚨 206233949 175429580 1.18
tpcds_q15/datafusion:vortex-file-compressed 🚨 36227587 29453393 1.23
tpcds_q16/datafusion:vortex-file-compressed 🚨 36822628 28753741 1.28
tpcds_q17/datafusion:vortex-file-compressed 🚨 80602080 63411072 1.27
tpcds_q18/datafusion:vortex-file-compressed 🚨 89615587 69831705 1.28
tpcds_q19/datafusion:vortex-file-compressed 🚨 28802136 22865582 1.26
tpcds_q20/datafusion:vortex-file-compressed 🚨 29539452 21994121 1.34
tpcds_q21/datafusion:vortex-file-compressed 🚨 46681410 35698178 1.31
tpcds_q22/datafusion:vortex-file-compressed 🚨 151342144 126129387 1.20
tpcds_q23/datafusion:vortex-file-compressed 🚨 175691116 154073505 1.14
tpcds_q24/datafusion:vortex-file-compressed 🚨 96043886 84907852 1.13
tpcds_q25/datafusion:vortex-file-compressed 72589689 67973010 1.07
tpcds_q26/datafusion:vortex-file-compressed 🚨 39019523 33646196 1.16
tpcds_q27/datafusion:vortex-file-compressed 🚨 126701929 110481640 1.15
tpcds_q28/datafusion:vortex-file-compressed 🚨 38955498 33651788 1.16
tpcds_q29/datafusion:vortex-file-compressed 🚨 71687953 63567867 1.13
tpcds_q30/datafusion:vortex-file-compressed 🚨 27299417 24257018 1.13
tpcds_q31/datafusion:vortex-file-compressed 🚨 88267520 77814202 1.13
tpcds_q32/datafusion:vortex-file-compressed 23339760 21468930 1.09
tpcds_q33/datafusion:vortex-file-compressed 33383968 31490012 1.06
tpcds_q34/datafusion:vortex-file-compressed 27697208 25585720 1.08
tpcds_q35/datafusion:vortex-file-compressed 50314335 48085109 1.05
tpcds_q36/datafusion:vortex-file-compressed 65210655 61281168 1.06
tpcds_q37/datafusion:vortex-file-compressed 27670960 25818658 1.07
tpcds_q38/datafusion:vortex-file-compressed 🚨 49574956 44112586 1.12
tpcds_q39/datafusion:vortex-file-compressed 🚨 128604011 108328528 1.19
tpcds_q40/datafusion:vortex-file-compressed 🚨 37538105 33664818 1.12
tpcds_q41/datafusion:vortex-file-compressed 🚨 17635775 15724173 1.12
tpcds_q42/datafusion:vortex-file-compressed 🚨 15838741 14175261 1.12
tpcds_q43/datafusion:vortex-file-compressed 20637869 18763538 1.10
tpcds_q44/datafusion:vortex-file-compressed 36975270 35444171 1.04
tpcds_q45/datafusion:vortex-file-compressed 🚨 31106484 27929509 1.11
tpcds_q46/datafusion:vortex-file-compressed 🚨 38163704 34604283 1.10
tpcds_q47/datafusion:vortex-file-compressed 143339760 137947327 1.04
tpcds_q48/datafusion:vortex-file-compressed 38439409 36669028 1.05
tpcds_q49/datafusion:vortex-file-compressed 61912631 58990924 1.05
tpcds_q50/datafusion:vortex-file-compressed 42497650 39848483 1.07
tpcds_q51/datafusion:vortex-file-compressed 93604280 88406950 1.06
tpcds_q52/datafusion:vortex-file-compressed 15197978 14834975 1.02
tpcds_q53/datafusion:vortex-file-compressed 22913570 21630727 1.06
tpcds_q54/datafusion:vortex-file-compressed 37238697 36094295 1.03
tpcds_q55/datafusion:vortex-file-compressed 14929093 14626329 1.02
tpcds_q56/datafusion:vortex-file-compressed 30582712 30924198 0.99
tpcds_q57/datafusion:vortex-file-compressed 122708174 119518966 1.03
tpcds_q58/datafusion:vortex-file-compressed 🚨 59413980 53241125 1.12
tpcds_q59/datafusion:vortex-file-compressed 🚨 65542806 57707678 1.14
tpcds_q60/datafusion:vortex-file-compressed 🚨 36387603 30152526 1.21
tpcds_q61/datafusion:vortex-file-compressed 🚨 50796498 42253912 1.20
tpcds_q62/datafusion:vortex-file-compressed 🚨 33279271 22036294 1.51
tpcds_q63/datafusion:vortex-file-compressed 🚨 25645354 22386570 1.15
tpcds_q64/datafusion:vortex-file-compressed 🚨 513468844 427915528 1.20
tpcds_q65/datafusion:vortex-file-compressed 41555432 43089726 0.96
tpcds_q66/datafusion:vortex-file-compressed 76037332 74980256 1.01
tpcds_q67/datafusion:vortex-file-compressed 158595832 148759196 1.07
tpcds_q68/datafusion:vortex-file-compressed 34542228 33626869 1.03
tpcds_q69/datafusion:vortex-file-compressed 39344627 35816382 1.10
tpcds_q70/datafusion:vortex-file-compressed 90851692 84607258 1.07
tpcds_q71/datafusion:vortex-file-compressed 24806976 23689775 1.05
tpcds_q72/datafusion:vortex-file-compressed 🚨 2781453926 2301602381 1.21
tpcds_q73/datafusion:vortex-file-compressed 🚨 30686678 25551541 1.20
tpcds_q74/datafusion:vortex-file-compressed 96454170 91913585 1.05
tpcds_q75/datafusion:vortex-file-compressed 🚨 129621720 110620697 1.17
tpcds_q76/datafusion:vortex-file-compressed 37582269 35314002 1.06
tpcds_q77/datafusion:vortex-file-compressed 🚨 51790503 44049019 1.18
tpcds_q78/datafusion:vortex-file-compressed 132510468 131966758 1.00
tpcds_q79/datafusion:vortex-file-compressed 🚨 35915387 29241728 1.23
tpcds_q80/datafusion:vortex-file-compressed 🚨 122283260 105410689 1.16
tpcds_q81/datafusion:vortex-file-compressed 🚨 30127720 24799395 1.21
tpcds_q82/datafusion:vortex-file-compressed 🚨 31674555 26692664 1.19
tpcds_q83/datafusion:vortex-file-compressed 🚨 47384053 35723963 1.33
tpcds_q84/datafusion:vortex-file-compressed 🚨 16298674 13719038 1.19
tpcds_q85/datafusion:vortex-file-compressed 🚨 117397211 97710223 1.20
tpcds_q86/datafusion:vortex-file-compressed 🚨 22316846 19882848 1.12
tpcds_q87/datafusion:vortex-file-compressed 🚨 56658744 48918943 1.16
tpcds_q88/datafusion:vortex-file-compressed 🚨 66786597 59113262 1.13
tpcds_q89/datafusion:vortex-file-compressed 🚨 32274181 26825201 1.20
tpcds_q90/datafusion:vortex-file-compressed 🚨 17931112 15214845 1.18
tpcds_q91/datafusion:vortex-file-compressed 🚨 26592217 20379684 1.30
tpcds_q92/datafusion:vortex-file-compressed 🚨 27033390 19170827 1.41
tpcds_q93/datafusion:vortex-file-compressed 36633302 38012336 0.96
tpcds_q94/datafusion:vortex-file-compressed 🚨 27143851 23646325 1.15
tpcds_q95/datafusion:vortex-file-compressed 65649684 64099284 1.02
tpcds_q96/datafusion:vortex-file-compressed 16025508 14746115 1.09
tpcds_q97/datafusion:vortex-file-compressed 34197915 32989021 1.04
tpcds_q98/datafusion:vortex-file-compressed 24598627 24760425 0.99
tpcds_q99/datafusion:vortex-file-compressed 28537928 31655490 0.90
datafusion / vortex-compact (1.131x ❌, 1↑ 56↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 28034378 26454429 1.06
tpcds_q02/datafusion:vortex-compact 55214280 57366423 0.96
tpcds_q03/datafusion:vortex-compact 20656758 20234795 1.02
tpcds_q04/datafusion:vortex-compact 311329858 315864893 0.99
tpcds_q05/datafusion:vortex-compact 56957212 52053843 1.09
tpcds_q06/datafusion:vortex-compact 70274969 64838697 1.08
tpcds_q07/datafusion:vortex-compact 🚨 66078673 54429200 1.21
tpcds_q08/datafusion:vortex-compact 🚨 42094358 36958259 1.14
tpcds_q09/datafusion:vortex-compact 🚨 61496250 53756734 1.14
tpcds_q10/datafusion:vortex-compact 52492539 50650482 1.04
tpcds_q11/datafusion:vortex-compact 170349199 156936446 1.09
tpcds_q12/datafusion:vortex-compact 27830562 25573129 1.09
tpcds_q13/datafusion:vortex-compact 🚨 161243170 131642732 1.22
tpcds_q14/datafusion:vortex-compact 220802787 204044993 1.08
tpcds_q15/datafusion:vortex-compact 🚨 34047967 30615684 1.11
tpcds_q16/datafusion:vortex-compact 34227612 31954460 1.07
tpcds_q17/datafusion:vortex-compact 🚨 84692970 75597893 1.12
tpcds_q18/datafusion:vortex-compact 86544677 80505602 1.08
tpcds_q19/datafusion:vortex-compact 🚨 32060560 29074824 1.10
tpcds_q20/datafusion:vortex-compact 28801592 28441918 1.01
tpcds_q21/datafusion:vortex-compact 🚨 49872645 39632968 1.26
tpcds_q22/datafusion:vortex-compact 134504045 144947493 0.93
tpcds_q23/datafusion:vortex-compact 182450835 173211729 1.05
tpcds_q24/datafusion:vortex-compact 🚨 112013467 100701534 1.11
tpcds_q25/datafusion:vortex-compact 89353884 82465380 1.08
tpcds_q26/datafusion:vortex-compact 49465023 46178248 1.07
tpcds_q27/datafusion:vortex-compact 138600671 132841611 1.04
tpcds_q28/datafusion:vortex-compact 104360542 99963051 1.04
tpcds_q29/datafusion:vortex-compact 81189160 76566830 1.06
tpcds_q30/datafusion:vortex-compact 🚨 33425663 27545836 1.21
tpcds_q31/datafusion:vortex-compact 105088361 101371612 1.04
tpcds_q32/datafusion:vortex-compact 🚨 28098136 25415298 1.11
tpcds_q33/datafusion:vortex-compact 🚨 43890663 39360853 1.12
tpcds_q34/datafusion:vortex-compact 🚨 43557555 34409029 1.27
tpcds_q35/datafusion:vortex-compact 🚨 63870264 55759655 1.15
tpcds_q36/datafusion:vortex-compact 🚨 93409696 79038214 1.18
tpcds_q37/datafusion:vortex-compact 🚨 42369100 34932099 1.21
tpcds_q38/datafusion:vortex-compact 🚨 65435952 54764104 1.19
tpcds_q39/datafusion:vortex-compact 🚨 157819678 117462702 1.34
tpcds_q40/datafusion:vortex-compact 🚨 46450573 36676856 1.27
tpcds_q41/datafusion:vortex-compact 🚨 22827117 17510925 1.30
tpcds_q42/datafusion:vortex-compact 🚨 22912834 18588868 1.23
tpcds_q43/datafusion:vortex-compact 🚨 29573027 25719692 1.15
tpcds_q44/datafusion:vortex-compact 🚨 58810211 49429444 1.19
tpcds_q45/datafusion:vortex-compact 🚨 41953049 33323549 1.26
tpcds_q46/datafusion:vortex-compact 🚨 54164017 45587847 1.19
tpcds_q47/datafusion:vortex-compact 🚨 198176160 153910586 1.29
tpcds_q48/datafusion:vortex-compact 🚨 100214808 83360749 1.20
tpcds_q49/datafusion:vortex-compact 🚨 89385459 70679495 1.26
tpcds_q50/datafusion:vortex-compact 🚨 62055618 48178661 1.29
tpcds_q51/datafusion:vortex-compact 🚨 117034185 100981189 1.16
tpcds_q52/datafusion:vortex-compact 🚨 23399422 18830243 1.24
tpcds_q53/datafusion:vortex-compact 🚨 35610967 28756754 1.24
tpcds_q54/datafusion:vortex-compact 🚨 51247036 42999107 1.19
tpcds_q55/datafusion:vortex-compact 🚨 23342522 18243007 1.28
tpcds_q56/datafusion:vortex-compact 🚨 44812654 37044641 1.21
tpcds_q57/datafusion:vortex-compact 126916671 115667309 1.10
tpcds_q58/datafusion:vortex-compact 67816237 64408374 1.05
tpcds_q59/datafusion:vortex-compact 73108426 72619430 1.01
tpcds_q60/datafusion:vortex-compact 🚨 42627356 38140970 1.12
tpcds_q61/datafusion:vortex-compact 🚨 65643029 56437425 1.16
tpcds_q62/datafusion:vortex-compact 🚨 36672108 24472120 1.50
tpcds_q63/datafusion:vortex-compact 🚨 34985810 28620130 1.22
tpcds_q64/datafusion:vortex-compact 🚨 576457068 489140595 1.18
tpcds_q65/datafusion:vortex-compact 🚨 64865552 54569906 1.19
tpcds_q66/datafusion:vortex-compact 🚨 96090776 78261097 1.23
tpcds_q67/datafusion:vortex-compact 🚨 176893469 155559871 1.14
tpcds_q68/datafusion:vortex-compact 🚨 53501425 45653660 1.17
tpcds_q69/datafusion:vortex-compact 🚨 56513844 46912845 1.20
tpcds_q70/datafusion:vortex-compact 🚨 117798108 94365969 1.25
tpcds_q71/datafusion:vortex-compact 🚨 36134164 29804073 1.21
tpcds_q72/datafusion:vortex-compact 🚨 2681257891 2259523165 1.19
tpcds_q73/datafusion:vortex-compact 🚨 37030242 31569697 1.17
tpcds_q74/datafusion:vortex-compact 🚨 116958723 96535003 1.21
tpcds_q75/datafusion:vortex-compact 🚨 160431450 133277564 1.20
tpcds_q76/datafusion:vortex-compact 🚨 38613837 33705073 1.15
tpcds_q77/datafusion:vortex-compact 55541453 52584676 1.06
tpcds_q78/datafusion:vortex-compact 157266059 144722313 1.09
tpcds_q79/datafusion:vortex-compact 41168954 38618501 1.07
tpcds_q80/datafusion:vortex-compact 118397763 110405694 1.07
tpcds_q81/datafusion:vortex-compact 🚨 33133645 28719072 1.15
tpcds_q82/datafusion:vortex-compact 38846904 35533941 1.09
tpcds_q83/datafusion:vortex-compact 38188766 37312074 1.02
tpcds_q84/datafusion:vortex-compact 🚨 16791215 14866148 1.13
tpcds_q85/datafusion:vortex-compact 171249613 160323376 1.07
tpcds_q86/datafusion:vortex-compact 🚀 20428346 23063535 0.89
tpcds_q87/datafusion:vortex-compact 56072521 52713812 1.06
tpcds_q88/datafusion:vortex-compact 85738342 78625918 1.09
tpcds_q89/datafusion:vortex-compact 34968788 32296620 1.08
tpcds_q90/datafusion:vortex-compact 17421696 16586611 1.05
tpcds_q91/datafusion:vortex-compact 35723127 33834434 1.06
tpcds_q92/datafusion:vortex-compact 26487304 24807055 1.07
tpcds_q93/datafusion:vortex-compact 🚨 45824554 39371405 1.16
tpcds_q94/datafusion:vortex-compact 29739720 29520914 1.01
tpcds_q95/datafusion:vortex-compact 72170304 67620474 1.07
tpcds_q96/datafusion:vortex-compact 18590279 17960681 1.04
tpcds_q97/datafusion:vortex-compact 40518311 36876725 1.10
tpcds_q98/datafusion:vortex-compact 🚨 34762488 30294077 1.15
tpcds_q99/datafusion:vortex-compact 34309875 34806265 0.99
datafusion / parquet (1.125x ❌, 0↑ 63↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 34266669 31351983 1.09
tpcds_q02/datafusion:parquet 44355749 42711771 1.04
tpcds_q03/datafusion:parquet 14275781 14330677 1.00
tpcds_q04/datafusion:parquet 🚨 305619240 271220201 1.13
tpcds_q05/datafusion:parquet 45473761 42191987 1.08
tpcds_q06/datafusion:parquet 63422117 58453345 1.09
tpcds_q07/datafusion:parquet 🚨 87470736 77455986 1.13
tpcds_q08/datafusion:parquet 🚨 29493218 26555720 1.11
tpcds_q09/datafusion:parquet 🚨 53892659 44729952 1.20
tpcds_q10/datafusion:parquet 🚨 84506740 68687374 1.23
tpcds_q11/datafusion:parquet 🚨 190573242 154324967 1.23
tpcds_q12/datafusion:parquet 🚨 22209566 16628987 1.34
tpcds_q13/datafusion:parquet 🚨 91686947 77410352 1.18
tpcds_q14/datafusion:parquet 🚨 184180070 162429137 1.13
tpcds_q15/datafusion:parquet 🚨 23795680 21064414 1.13
tpcds_q16/datafusion:parquet 25357839 23997064 1.06
tpcds_q17/datafusion:parquet 72644144 68083643 1.07
tpcds_q18/datafusion:parquet 124417667 116363238 1.07
tpcds_q19/datafusion:parquet 24872550 22862344 1.09
tpcds_q20/datafusion:parquet 🚨 18620998 16136969 1.15
tpcds_q21/datafusion:parquet 🚨 20874450 18090982 1.15
tpcds_q22/datafusion:parquet 157198633 173716713 0.90
tpcds_q23/datafusion:parquet 🚨 169880234 147026567 1.16
tpcds_q24/datafusion:parquet 102463123 93544589 1.10
tpcds_q25/datafusion:parquet 🚨 71970519 64993858 1.11
tpcds_q26/datafusion:parquet 🚨 74652067 65994782 1.13
tpcds_q27/datafusion:parquet 🚨 167946203 145593170 1.15
tpcds_q28/datafusion:parquet 🚨 51737802 44419792 1.16
tpcds_q29/datafusion:parquet 🚨 76284162 67028673 1.14
tpcds_q30/datafusion:parquet 37598536 34542635 1.09
tpcds_q31/datafusion:parquet 🚨 76322152 66051648 1.16
tpcds_q32/datafusion:parquet 🚨 20630789 18568729 1.11
tpcds_q33/datafusion:parquet 29573110 27672457 1.07
tpcds_q34/datafusion:parquet 🚨 24273192 20930350 1.16
tpcds_q35/datafusion:parquet 🚨 78821541 70202925 1.12
tpcds_q36/datafusion:parquet 62161751 58417634 1.06
tpcds_q37/datafusion:parquet 🚨 20801278 18350139 1.13
tpcds_q38/datafusion:parquet 45340825 42700718 1.06
tpcds_q39/datafusion:parquet 🚨 89726968 76034464 1.18
tpcds_q40/datafusion:parquet 26352808 24281139 1.09
tpcds_q41/datafusion:parquet 🚨 15234707 13307587 1.14
tpcds_q42/datafusion:parquet 12869838 11885249 1.08
tpcds_q43/datafusion:parquet 🚨 19171194 17351935 1.10
tpcds_q44/datafusion:parquet 36570569 36678425 1.00
tpcds_q45/datafusion:parquet 30730813 29064633 1.06
tpcds_q46/datafusion:parquet 35145551 32905377 1.07
tpcds_q47/datafusion:parquet 142400811 133084667 1.07
tpcds_q48/datafusion:parquet 🚨 76956943 69481775 1.11
tpcds_q49/datafusion:parquet 61295523 58001863 1.06
tpcds_q50/datafusion:parquet 47442443 45606295 1.04
tpcds_q51/datafusion:parquet 🚨 96731692 87158609 1.11
tpcds_q52/datafusion:parquet 🚨 14530886 12550670 1.16
tpcds_q53/datafusion:parquet 🚨 20046864 17884290 1.12
tpcds_q54/datafusion:parquet 37518849 34768716 1.08
tpcds_q55/datafusion:parquet 12377441 12073764 1.03
tpcds_q56/datafusion:parquet 30231143 28845029 1.05
tpcds_q57/datafusion:parquet 🚨 108990977 97097029 1.12
tpcds_q58/datafusion:parquet 🚨 56110877 48863825 1.15
tpcds_q59/datafusion:parquet 64092940 59204532 1.08
tpcds_q60/datafusion:parquet 🚨 31431271 28466816 1.10
tpcds_q61/datafusion:parquet 47752954 44428793 1.07
tpcds_q62/datafusion:parquet 23168177 24849440 0.93
tpcds_q63/datafusion:parquet 19036110 19155023 0.99
tpcds_q64/datafusion:parquet 568993891 519171065 1.10
tpcds_q65/datafusion:parquet 42603389 40155164 1.06
tpcds_q66/datafusion:parquet 🚨 84795786 66225323 1.28
tpcds_q67/datafusion:parquet 🚨 189182357 140494893 1.35
tpcds_q68/datafusion:parquet 🚨 38311238 32191028 1.19
tpcds_q69/datafusion:parquet 🚨 79738609 67464600 1.18
tpcds_q70/datafusion:parquet 🚨 116751416 88387888 1.32
tpcds_q71/datafusion:parquet 🚨 24338894 21658230 1.12
tpcds_q72/datafusion:parquet 🚨 708321581 613000260 1.16
tpcds_q73/datafusion:parquet 21973108 21427892 1.03
tpcds_q74/datafusion:parquet 🚨 97392092 85417416 1.14
tpcds_q75/datafusion:parquet 🚨 111144264 100375461 1.11
tpcds_q76/datafusion:parquet 33301854 35016170 0.95
tpcds_q77/datafusion:parquet 🚨 43188120 38811938 1.11
tpcds_q78/datafusion:parquet 🚨 133031215 114076594 1.17
tpcds_q79/datafusion:parquet 🚨 30995662 28173475 1.10
tpcds_q80/datafusion:parquet 🚨 105734918 81756348 1.29
tpcds_q81/datafusion:parquet 🚨 39293545 31900462 1.23
tpcds_q82/datafusion:parquet 🚨 23962133 19065633 1.26
tpcds_q83/datafusion:parquet 🚨 48042901 38331224 1.25
tpcds_q84/datafusion:parquet 🚨 47632077 39482193 1.21
tpcds_q85/datafusion:parquet 🚨 176396163 152064073 1.16
tpcds_q86/datafusion:parquet 🚨 18782038 16367319 1.15
tpcds_q87/datafusion:parquet 45992960 44001244 1.05
tpcds_q88/datafusion:parquet 64319107 62026452 1.04
tpcds_q89/datafusion:parquet 🚨 27115475 22407821 1.21
tpcds_q90/datafusion:parquet 🚨 18645444 14785338 1.26
tpcds_q91/datafusion:parquet 🚨 69601134 61745702 1.13
tpcds_q92/datafusion:parquet 🚨 22811247 17744653 1.29
tpcds_q93/datafusion:parquet 🚨 41340878 32392607 1.28
tpcds_q94/datafusion:parquet 🚨 25204490 21271456 1.18
tpcds_q95/datafusion:parquet 🚨 69477892 60429925 1.15
tpcds_q96/datafusion:parquet 🚨 14712613 12676187 1.16
tpcds_q97/datafusion:parquet 🚨 36981878 31604404 1.17
tpcds_q98/datafusion:parquet 🚨 26824994 22692293 1.18
tpcds_q99/datafusion:parquet 🚨 33541119 28979081 1.16
duckdb / vortex-file-compressed (1.105x ❌, 0↑ 51↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 27375901 25420590 1.08
tpcds_q02/duckdb:vortex-file-compressed 34975411 34616265 1.01
tpcds_q03/duckdb:vortex-file-compressed 🚨 24122553 21887608 1.10
tpcds_q04/duckdb:vortex-file-compressed 🚨 103275055 93297620 1.11
tpcds_q05/duckdb:vortex-file-compressed 🚨 37487327 32996991 1.14
tpcds_q06/duckdb:vortex-file-compressed 37339141 34449971 1.08
tpcds_q07/duckdb:vortex-file-compressed 23562866 21959363 1.07
tpcds_q08/duckdb:vortex-file-compressed 🚨 31312995 27633942 1.13
tpcds_q09/duckdb:vortex-file-compressed 🚨 17624368 15480130 1.14
tpcds_q10/duckdb:vortex-file-compressed 🚨 43076805 38118654 1.13
tpcds_q11/duckdb:vortex-file-compressed 71928170 66492795 1.08
tpcds_q12/duckdb:vortex-file-compressed 17888993 16279518 1.10
tpcds_q13/duckdb:vortex-file-compressed 35126573 33738957 1.04
tpcds_q14/duckdb:vortex-file-compressed 🚨 105908880 95570532 1.11
tpcds_q15/duckdb:vortex-file-compressed 30308863 27938718 1.08
tpcds_q16/duckdb:vortex-file-compressed 29125512 26778755 1.09
tpcds_q17/duckdb:vortex-file-compressed 🚨 48838408 43967157 1.11
tpcds_q18/duckdb:vortex-file-compressed 🚨 42886101 36916508 1.16
tpcds_q19/duckdb:vortex-file-compressed 35985901 33648362 1.07
tpcds_q20/duckdb:vortex-file-compressed 19286150 18045803 1.07
tpcds_q21/duckdb:vortex-file-compressed 17831194 16384631 1.09
tpcds_q22/duckdb:vortex-file-compressed 🚨 89647038 78551099 1.14
tpcds_q23/duckdb:vortex-file-compressed 102819490 94081843 1.09
tpcds_q24/duckdb:vortex-file-compressed 🚨 53259482 47667298 1.12
tpcds_q25/duckdb:vortex-file-compressed 45187191 41689879 1.08
tpcds_q26/duckdb:vortex-file-compressed 🚨 21042394 19114724 1.10
tpcds_q27/duckdb:vortex-file-compressed 27489958 25307363 1.09
tpcds_q28/duckdb:vortex-file-compressed 13043677 12741481 1.02
tpcds_q29/duckdb:vortex-file-compressed 44038421 40431918 1.09
tpcds_q30/duckdb:vortex-file-compressed 27855486 26927076 1.03
tpcds_q31/duckdb:vortex-file-compressed 🚨 32943514 29833049 1.10
tpcds_q32/duckdb:vortex-file-compressed 15501250 14241054 1.09
tpcds_q33/duckdb:vortex-file-compressed 25585969 24363938 1.05
tpcds_q34/duckdb:vortex-file-compressed 27237438 25457230 1.07
tpcds_q35/duckdb:vortex-file-compressed 69578042 66047079 1.05
tpcds_q36/duckdb:vortex-file-compressed 🚨 26388606 23869184 1.11
tpcds_q37/duckdb:vortex-file-compressed 🚨 21845458 19816058 1.10
tpcds_q38/duckdb:vortex-file-compressed 🚨 40163367 36224836 1.11
tpcds_q39/duckdb:vortex-file-compressed 38739173 37694413 1.03
tpcds_q40/duckdb:vortex-file-compressed 22919979 21312810 1.08
tpcds_q41/duckdb:vortex-file-compressed 11290905 10500599 1.08
tpcds_q42/duckdb:vortex-file-compressed 🚨 15214408 13457888 1.13
tpcds_q43/duckdb:vortex-file-compressed 21775340 21281838 1.02
tpcds_q44/duckdb:vortex-file-compressed 23331543 21337837 1.09
tpcds_q45/duckdb:vortex-file-compressed 🚨 33917913 30515181 1.11
tpcds_q46/duckdb:vortex-file-compressed 32317337 30848542 1.05
tpcds_q47/duckdb:vortex-file-compressed 🚨 59394338 51520317 1.15
tpcds_q48/duckdb:vortex-file-compressed 32334290 31114642 1.04
tpcds_q49/duckdb:vortex-file-compressed 🚨 37191021 31052121 1.20
tpcds_q50/duckdb:vortex-file-compressed 🚨 28608776 25436862 1.12
tpcds_q51/duckdb:vortex-file-compressed 🚨 116229014 105599353 1.10
tpcds_q52/duckdb:vortex-file-compressed 14337365 13388030 1.07
tpcds_q53/duckdb:vortex-file-compressed 🚨 24762725 21860498 1.13
tpcds_q54/duckdb:vortex-file-compressed 🚨 34809104 28963086 1.20
tpcds_q55/duckdb:vortex-file-compressed 🚨 14760082 12599881 1.17
tpcds_q56/duckdb:vortex-file-compressed 27564685 26610112 1.04
tpcds_q57/duckdb:vortex-file-compressed 46356220 42725544 1.08
tpcds_q58/duckdb:vortex-file-compressed 🚨 33588151 28886928 1.16
tpcds_q59/duckdb:vortex-file-compressed 60090107 56688249 1.06
tpcds_q60/duckdb:vortex-file-compressed 🚨 28404642 25811316 1.10
tpcds_q61/duckdb:vortex-file-compressed 35288000 32782063 1.08
tpcds_q62/duckdb:vortex-file-compressed 17979794 17109622 1.05
tpcds_q63/duckdb:vortex-file-compressed 🚨 23515049 20660424 1.14
tpcds_q64/duckdb:vortex-file-compressed 105403532 97611206 1.08
tpcds_q65/duckdb:vortex-file-compressed 🚨 24561580 22318169 1.10
tpcds_q66/duckdb:vortex-file-compressed 32774276 30397273 1.08
tpcds_q67/duckdb:vortex-file-compressed 157545942 145809881 1.08
tpcds_q68/duckdb:vortex-file-compressed 🚨 32802305 29472246 1.11
tpcds_q69/duckdb:vortex-file-compressed 🚨 46945051 40910867 1.15
tpcds_q70/duckdb:vortex-file-compressed 39736157 38909368 1.02
tpcds_q71/duckdb:vortex-file-compressed 22759567 21274068 1.07
tpcds_q72/duckdb:vortex-file-compressed 🚨 191769091 170968214 1.12
tpcds_q73/duckdb:vortex-file-compressed 🚨 31093510 25731548 1.21
tpcds_q74/duckdb:vortex-file-compressed 🚨 52839240 44140138 1.20
tpcds_q75/duckdb:vortex-file-compressed 🚨 59517748 50759901 1.17
tpcds_q76/duckdb:vortex-file-compressed 🚨 25068096 20926608 1.20
tpcds_q77/duckdb:vortex-file-compressed 🚨 29527317 24096734 1.23
tpcds_q78/duckdb:vortex-file-compressed 🚨 91908134 76829773 1.20
tpcds_q79/duckdb:vortex-file-compressed 🚨 32085907 25146620 1.28
tpcds_q80/duckdb:vortex-file-compressed 🚨 57503250 50795404 1.13
tpcds_q81/duckdb:vortex-file-compressed 🚨 39249266 30784885 1.27
tpcds_q82/duckdb:vortex-file-compressed 🚨 56289430 46102663 1.22
tpcds_q83/duckdb:vortex-file-compressed 🚨 31828151 27518971 1.16
tpcds_q84/duckdb:vortex-file-compressed 18918072 17568643 1.08
tpcds_q85/duckdb:vortex-file-compressed 🚨 48015368 42127224 1.14
tpcds_q86/duckdb:vortex-file-compressed 18221269 16567196 1.10
tpcds_q87/duckdb:vortex-file-compressed 43878808 41206563 1.06
tpcds_q88/duckdb:vortex-file-compressed 58359048 54590255 1.07
tpcds_q89/duckdb:vortex-file-compressed 24261632 22748906 1.07
tpcds_q90/duckdb:vortex-file-compressed 🚨 12008701 10472847 1.15
tpcds_q91/duckdb:vortex-file-compressed 🚨 26572980 22660537 1.17
tpcds_q92/duckdb:vortex-file-compressed 21879163 21056127 1.04
tpcds_q93/duckdb:vortex-file-compressed 🚨 34686494 30671252 1.13
tpcds_q94/duckdb:vortex-file-compressed 🚨 24686639 22206907 1.11
tpcds_q95/duckdb:vortex-file-compressed 156922704 162462933 0.97
tpcds_q96/duckdb:vortex-file-compressed 🚨 13956141 12620079 1.11
tpcds_q97/duckdb:vortex-file-compressed 41837659 39565189 1.06
tpcds_q98/duckdb:vortex-file-compressed 🚨 23309391 19507746 1.19
tpcds_q99/duckdb:vortex-file-compressed 🚨 25518141 22786337 1.12
duckdb / vortex-compact (1.118x ❌, 0↑ 49↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 29692747 28746361 1.03
tpcds_q02/duckdb:vortex-compact 38282512 35852812 1.07
tpcds_q03/duckdb:vortex-compact 52436838 48641772 1.08
tpcds_q04/duckdb:vortex-compact 112407535 110661726 1.02
tpcds_q05/duckdb:vortex-compact 43955667 42035306 1.05
tpcds_q06/duckdb:vortex-compact 43501390 40184004 1.08
tpcds_q07/duckdb:vortex-compact 37471129 34813641 1.08
tpcds_q08/duckdb:vortex-compact 45428637 41342846 1.10
tpcds_q09/duckdb:vortex-compact 🚨 21765450 19398009 1.12
tpcds_q10/duckdb:vortex-compact 57088791 53207466 1.07
tpcds_q11/duckdb:vortex-compact 81449772 75823290 1.07
tpcds_q12/duckdb:vortex-compact 🚨 24754138 21292173 1.16
tpcds_q13/duckdb:vortex-compact 56210659 51251440 1.10
tpcds_q14/duckdb:vortex-compact 123177977 116365825 1.06
tpcds_q15/duckdb:vortex-compact 🚨 34833446 30079298 1.16
tpcds_q16/duckdb:vortex-compact 🚨 34105065 27816471 1.23
tpcds_q17/duckdb:vortex-compact 🚨 68797354 55063209 1.25
tpcds_q18/duckdb:vortex-compact 🚨 61532060 52407800 1.17
tpcds_q19/duckdb:vortex-compact 🚨 53193254 44778708 1.19
tpcds_q20/duckdb:vortex-compact 🚨 26790144 21562615 1.24
tpcds_q21/duckdb:vortex-compact 🚨 23033569 18306727 1.26
tpcds_q22/duckdb:vortex-compact 88123063 82526927 1.07
tpcds_q23/duckdb:vortex-compact 118495283 109367275 1.08
tpcds_q24/duckdb:vortex-compact 62972604 59310178 1.06
tpcds_q25/duckdb:vortex-compact 🚨 61000846 54225412 1.12
tpcds_q26/duckdb:vortex-compact 33633198 32740830 1.03
tpcds_q27/duckdb:vortex-compact 38620369 37233331 1.04
tpcds_q28/duckdb:vortex-compact 37026511 33839713 1.09
tpcds_q29/duckdb:vortex-compact 58186848 54361420 1.07
tpcds_q30/duckdb:vortex-compact 33600595 31327629 1.07
tpcds_q31/duckdb:vortex-compact 🚨 40052627 35182936 1.14
tpcds_q32/duckdb:vortex-compact 🚨 24974460 21899867 1.14
tpcds_q33/duckdb:vortex-compact 🚨 35431033 31527085 1.12
tpcds_q34/duckdb:vortex-compact 33114389 30911576 1.07
tpcds_q35/duckdb:vortex-compact 🚨 84753947 76848184 1.10
tpcds_q36/duckdb:vortex-compact 37923350 36560567 1.04
tpcds_q37/duckdb:vortex-compact 27068971 24884027 1.09
tpcds_q38/duckdb:vortex-compact 46068973 43145120 1.07
tpcds_q39/duckdb:vortex-compact 🚨 43949010 38302527 1.15
tpcds_q40/duckdb:vortex-compact 🚨 29858341 25219369 1.18
tpcds_q41/duckdb:vortex-compact 🚨 14734524 12325319 1.20
tpcds_q42/duckdb:vortex-compact 🚨 24350290 19333067 1.26
tpcds_q43/duckdb:vortex-compact 🚨 34934162 31363072 1.11
tpcds_q44/duckdb:vortex-compact 🚨 38285171 29102544 1.32
tpcds_q45/duckdb:vortex-compact 🚨 50639184 36788374 1.38
tpcds_q46/duckdb:vortex-compact 🚨 49719199 44903024 1.11
tpcds_q47/duckdb:vortex-compact 🚨 76116945 63587986 1.20
tpcds_q48/duckdb:vortex-compact 52349923 49460056 1.06
tpcds_q49/duckdb:vortex-compact 🚨 56651642 44941137 1.26
tpcds_q50/duckdb:vortex-compact 🚨 46092618 38021901 1.21
tpcds_q51/duckdb:vortex-compact 🚨 133605320 114994073 1.16
tpcds_q52/duckdb:vortex-compact 🚨 24055845 19545367 1.23
tpcds_q53/duckdb:vortex-compact 🚨 39161275 32525126 1.20
tpcds_q54/duckdb:vortex-compact 🚨 44609669 39257192 1.14
tpcds_q55/duckdb:vortex-compact 🚨 23286311 19018369 1.22
tpcds_q56/duckdb:vortex-compact 🚨 38265792 33616199 1.14
tpcds_q57/duckdb:vortex-compact 🚨 52854425 45795686 1.15
tpcds_q58/duckdb:vortex-compact 39462531 38524175 1.02
tpcds_q59/duckdb:vortex-compact 72697542 67474752 1.08
tpcds_q60/duckdb:vortex-compact 🚨 42114574 34913612 1.21
tpcds_q61/duckdb:vortex-compact 🚨 61519315 55852185 1.10
tpcds_q62/duckdb:vortex-compact 🚨 26491773 21357639 1.24
tpcds_q63/duckdb:vortex-compact 34534680 31830927 1.08
tpcds_q64/duckdb:vortex-compact 132467924 129582671 1.02
tpcds_q65/duckdb:vortex-compact 32853077 30707167 1.07
tpcds_q66/duckdb:vortex-compact 38988840 36162911 1.08
tpcds_q67/duckdb:vortex-compact 160686335 151249778 1.06
tpcds_q68/duckdb:vortex-compact 46996188 46994502 1.00
tpcds_q69/duckdb:vortex-compact 🚨 61459051 55668886 1.10
tpcds_q70/duckdb:vortex-compact 🚨 67144437 59923699 1.12
tpcds_q71/duckdb:vortex-compact 🚨 36936270 31234903 1.18
tpcds_q72/duckdb:vortex-compact 205483017 187017476 1.10
tpcds_q73/duckdb:vortex-compact 🚨 35136372 28959625 1.21
tpcds_q74/duckdb:vortex-compact 54916023 50859810 1.08
tpcds_q75/duckdb:vortex-compact 🚨 71376075 63927246 1.12
tpcds_q76/duckdb:vortex-compact 32086770 30365470 1.06
tpcds_q77/duckdb:vortex-compact 38923650 36744962 1.06
tpcds_q78/duckdb:vortex-compact 🚨 98792810 88945234 1.11
tpcds_q79/duckdb:vortex-compact 43060216 39191612 1.10
tpcds_q80/duckdb:vortex-compact 76809125 70643324 1.09
tpcds_q81/duckdb:vortex-compact 38836053 35637654 1.09
tpcds_q82/duckdb:vortex-compact 54017839 49822270 1.08
tpcds_q83/duckdb:vortex-compact 39048057 36056413 1.08
tpcds_q84/duckdb:vortex-compact 🚨 24875493 22133637 1.12
tpcds_q85/duckdb:vortex-compact 58360631 53183174 1.10
tpcds_q86/duckdb:vortex-compact 23985040 23243608 1.03
tpcds_q87/duckdb:vortex-compact 49951496 47131876 1.06
tpcds_q88/duckdb:vortex-compact 80319986 77557217 1.04
tpcds_q89/duckdb:vortex-compact 35232091 32363152 1.09
tpcds_q90/duckdb:vortex-compact 🚨 13079351 11105833 1.18
tpcds_q91/duckdb:vortex-compact 44370679 42009062 1.06
tpcds_q92/duckdb:vortex-compact 45743187 43784139 1.04
tpcds_q93/duckdb:vortex-compact 🚨 37284979 32976594 1.13
tpcds_q94/duckdb:vortex-compact 28741175 26727468 1.08
tpcds_q95/duckdb:vortex-compact 🚨 173577053 152968884 1.13
tpcds_q96/duckdb:vortex-compact 🚨 18621686 16364978 1.14
tpcds_q97/duckdb:vortex-compact 🚨 49033484 42525410 1.15
tpcds_q98/duckdb:vortex-compact 🚨 32065421 27795971 1.15
tpcds_q99/duckdb:vortex-compact 🚨 30717966 26624918 1.15
duckdb / parquet (1.080x ➖, 0↑ 24↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 🚨 36200391 29308516 1.24
tpcds_q02/duckdb:parquet 25304090 24160052 1.05
tpcds_q03/duckdb:parquet 🚨 14886568 13018207 1.14
tpcds_q04/duckdb:parquet 🚨 193571936 171072852 1.13
tpcds_q05/duckdb:parquet 🚨 37741752 33098442 1.14
tpcds_q06/duckdb:parquet 🚨 40795976 34394922 1.19
tpcds_q07/duckdb:parquet 26636705 24386244 1.09
tpcds_q08/duckdb:parquet 🚨 34081032 29403785 1.16
tpcds_q09/duckdb:parquet 🚨 49906109 45230088 1.10
tpcds_q10/duckdb:parquet 🚨 44247372 37740688 1.17
tpcds_q11/duckdb:parquet 🚨 112263321 93441572 1.20
tpcds_q12/duckdb:parquet 🚨 21021956 17355591 1.21
tpcds_q13/duckdb:parquet 🚨 39209887 35386593 1.11
tpcds_q14/duckdb:parquet 110674751 104876317 1.06
tpcds_q15/duckdb:parquet 🚨 38596580 31335049 1.23
tpcds_q16/duckdb:parquet 🚨 26982282 22747407 1.19
tpcds_q17/duckdb:parquet 🚨 46299402 40806948 1.13
tpcds_q18/duckdb:parquet 52649279 49142807 1.07
tpcds_q19/duckdb:parquet 34364439 32454508 1.06
tpcds_q20/duckdb:parquet 20242818 19026734 1.06
tpcds_q21/duckdb:parquet 12839896 11940189 1.08
tpcds_q22/duckdb:parquet 76407149 73750748 1.04
tpcds_q23/duckdb:parquet 87724893 84401116 1.04
tpcds_q24/duckdb:parquet 🚨 53817509 47893057 1.12
tpcds_q25/duckdb:parquet 38438107 36254406 1.06
tpcds_q26/duckdb:parquet 42799763 40373744 1.06
tpcds_q27/duckdb:parquet 57018516 53036144 1.08
tpcds_q28/duckdb:parquet 45353108 42352434 1.07
tpcds_q29/duckdb:parquet 39442635 38616902 1.02
tpcds_q30/duckdb:parquet 40067839 38061897 1.05
tpcds_q31/duckdb:parquet 30749687 28512246 1.08
tpcds_q32/duckdb:parquet 14203005 13312444 1.07
tpcds_q33/duckdb:parquet 25096564 24729489 1.01
tpcds_q34/duckdb:parquet 24922244 22961411 1.09
tpcds_q35/duckdb:parquet 67338913 62756806 1.07
tpcds_q36/duckdb:parquet 24650670 22766039 1.08
tpcds_q37/duckdb:parquet 15812531 14931410 1.06
tpcds_q38/duckdb:parquet 39754211 37927412 1.05
tpcds_q39/duckdb:parquet 34706690 32455989 1.07
tpcds_q40/duckdb:parquet 🚨 21994156 19697880 1.12
tpcds_q41/duckdb:parquet 9855249 9026564 1.09
tpcds_q42/duckdb:parquet 13756476 12532789 1.10
tpcds_q43/duckdb:parquet 🚨 19931443 18079038 1.10
tpcds_q44/duckdb:parquet 28406079 26425505 1.07
tpcds_q45/duckdb:parquet 32478103 29583709 1.10
tpcds_q46/duckdb:parquet 🚨 53079021 47957598 1.11
tpcds_q47/duckdb:parquet 54845831 51818351 1.06
tpcds_q48/duckdb:parquet 34543785 32931519 1.05
tpcds_q49/duckdb:parquet 30049366 29184771 1.03
tpcds_q50/duckdb:parquet 27583282 26502102 1.04
tpcds_q51/duckdb:parquet 108792059 104498875 1.04
tpcds_q52/duckdb:parquet 13848786 13088621 1.06
tpcds_q53/duckdb:parquet 20914134 19708064 1.06
tpcds_q54/duckdb:parquet 30042634 29774460 1.01
tpcds_q55/duckdb:parquet 🚨 13925451 12598461 1.11
tpcds_q56/duckdb:parquet 25749395 24552370 1.05
tpcds_q57/duckdb:parquet 41215221 37818153 1.09
tpcds_q58/duckdb:parquet 27672755 26218265 1.06
tpcds_q59/duckdb:parquet 38124779 36517494 1.04
tpcds_q60/duckdb:parquet 26550314 25454403 1.04
tpcds_q61/duckdb:parquet 36323285 34138827 1.06
tpcds_q62/duckdb:parquet 13692397 13023739 1.05
tpcds_q63/duckdb:parquet 18921780 18133573 1.04
tpcds_q64/duckdb:parquet 🚨 86172316 76330060 1.13
tpcds_q65/duckdb:parquet 24453557 23227104 1.05
tpcds_q66/duckdb:parquet 34398204 33068188 1.04
tpcds_q67/duckdb:parquet 151926239 140730775 1.08
tpcds_q68/duckdb:parquet 41281771 39276282 1.05
tpcds_q69/duckdb:parquet 41280097 38584254 1.07
tpcds_q70/duckdb:parquet 22951974 22309850 1.03
tpcds_q71/duckdb:parquet 24580636 22410113 1.10
tpcds_q72/duckdb:parquet 172819592 169969116 1.02
tpcds_q73/duckdb:parquet 21021791 20049368 1.05
tpcds_q74/duckdb:parquet 136130624 129494415 1.05
tpcds_q75/duckdb:parquet 63174833 60449734 1.05
tpcds_q76/duckdb:parquet 23487448 22681586 1.04
tpcds_q77/duckdb:parquet 27710582 25674879 1.08
tpcds_q78/duckdb:parquet 83708810 77056913 1.09
tpcds_q79/duckdb:parquet 32107955 30513756 1.05
tpcds_q80/duckdb:parquet 47354631 43152208 1.10
tpcds_q81/duckdb:parquet 38374301 35862143 1.07
tpcds_q82/duckdb:parquet 18359706 16884390 1.09
tpcds_q83/duckdb:parquet 20139140 19039728 1.06
tpcds_q84/duckdb:parquet 22289802 21046551 1.06
tpcds_q85/duckdb:parquet 46379718 42381595 1.09
tpcds_q86/duckdb:parquet 14851648 13811403 1.08
tpcds_q87/duckdb:parquet 42279896 39976858 1.06
tpcds_q88/duckdb:parquet 55825628 54190418 1.03
tpcds_q89/duckdb:parquet 22645835 21819515 1.04
tpcds_q90/duckdb:parquet 🚨 9293258 8377324 1.11
tpcds_q91/duckdb:parquet 27822367 25940170 1.07
tpcds_q92/duckdb:parquet 14563674 14429704 1.01
tpcds_q93/duckdb:parquet 🚨 36142654 32093939 1.13
tpcds_q94/duckdb:parquet 19802900 18580323 1.07
tpcds_q95/duckdb:parquet 🚨 153216824 126934141 1.21
tpcds_q96/duckdb:parquet 11169150 10738250 1.04
tpcds_q97/duckdb:parquet 🚨 43748006 38385184 1.14
tpcds_q98/duckdb:parquet 25445889 23471125 1.08
tpcds_q99/duckdb:parquet 21919065 20389408 1.08
duckdb / duckdb (1.064x ➖, 0↑ 19↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚨 28555745 22899141 1.25
tpcds_q02/duckdb:duckdb 🚨 22344416 19815884 1.13
tpcds_q03/duckdb:duckdb 🚨 13061354 10490486 1.25
tpcds_q04/duckdb:duckdb 🚨 200583332 180533191 1.11
tpcds_q05/duckdb:duckdb 🚨 24848025 21823669 1.14
tpcds_q06/duckdb:duckdb 🚨 33536109 28565938 1.17
tpcds_q07/duckdb:duckdb 🚨 49020623 41980294 1.17
tpcds_q08/duckdb:duckdb 125506427 121931501 1.03
tpcds_q09/duckdb:duckdb 🚨 23139123 20996439 1.10
tpcds_q10/duckdb:duckdb 31932812 29082111 1.10
tpcds_q11/duckdb:duckdb 103571642 94539267 1.10
tpcds_q12/duckdb:duckdb 15695737 14598532 1.08
tpcds_q13/duckdb:duckdb 27942808 26305055 1.06
tpcds_q14/duckdb:duckdb 102790637 96084156 1.07
tpcds_q15/duckdb:duckdb 🚨 28334362 25674188 1.10
tpcds_q16/duckdb:duckdb 21392547 19995212 1.07
tpcds_q17/duckdb:duckdb 27780543 25440147 1.09
tpcds_q18/duckdb:duckdb 53484049 49020938 1.09
tpcds_q19/duckdb:duckdb 21652762 19926098 1.09
tpcds_q20/duckdb:duckdb 15993894 14774690 1.08
tpcds_q21/duckdb:duckdb 8382500 7841797 1.07
tpcds_q22/duckdb:duckdb 🚨 71893021 64536010 1.11
tpcds_q23/duckdb:duckdb 🚨 86670171 77723778 1.12
tpcds_q24/duckdb:duckdb 27855148 26692128 1.04
tpcds_q25/duckdb:duckdb 21164107 19275248 1.10
tpcds_q26/duckdb:duckdb 🚨 32277851 29045863 1.11
tpcds_q27/duckdb:duckdb 44795707 43377617 1.03
tpcds_q28/duckdb:duckdb 26076198 26690423 0.98
tpcds_q29/duckdb:duckdb 🚨 25456036 23066072 1.10
tpcds_q30/duckdb:duckdb 32227195 31977222 1.01
tpcds_q31/duckdb:duckdb 57890884 55223221 1.05
tpcds_q32/duckdb:duckdb 9277125 9086586 1.02
tpcds_q33/duckdb:duckdb 16644137 16424885 1.01
tpcds_q34/duckdb:duckdb 19174807 18052716 1.06
tpcds_q35/duckdb:duckdb 🚨 40619868 36652668 1.11
tpcds_q36/duckdb:duckdb 81342226 74972743 1.08
tpcds_q37/duckdb:duckdb 10137996 9362607 1.08
tpcds_q38/duckdb:duckdb 36497631 34024464 1.07
tpcds_q39/duckdb:duckdb 30339989 28413935 1.07
tpcds_q40/duckdb:duckdb 17003795 15924536 1.07
tpcds_q41/duckdb:duckdb 10680529 10224352 1.04
tpcds_q42/duckdb:duckdb 11351684 10515420 1.08
tpcds_q43/duckdb:duckdb 15359220 15386932 1.00
tpcds_q44/duckdb:duckdb 🚨 16983691 15391154 1.10
tpcds_q45/duckdb:duckdb 21530505 19617069 1.10
tpcds_q46/duckdb:duckdb 45120494 41078188 1.10
tpcds_q47/duckdb:duckdb 50940119 46448220 1.10
tpcds_q48/duckdb:duckdb 26639506 25502001 1.04
tpcds_q49/duckdb:duckdb 22210567 22340266 0.99
tpcds_q50/duckdb:duckdb 17644287 16331255 1.08
tpcds_q51/duckdb:duckdb 107696511 103638893 1.04
tpcds_q52/duckdb:duckdb 10769789 10844736 0.99
tpcds_q53/duckdb:duckdb 19381565 17846150 1.09
tpcds_q54/duckdb:duckdb 20752213 19856372 1.05
tpcds_q55/duckdb:duckdb 10733703 9812509 1.09
tpcds_q56/duckdb:duckdb 17635005 17486142 1.01
tpcds_q57/duckdb:duckdb 39198245 36723001 1.07
tpcds_q58/duckdb:duckdb 17761365 18141019 0.98
tpcds_q59/duckdb:duckdb 39302441 37472606 1.05
tpcds_q60/duckdb:duckdb 19424557 19201142 1.01
tpcds_q61/duckdb:duckdb 18116704 17456306 1.04
tpcds_q62/duckdb:duckdb 10964904 10535606 1.04
tpcds_q63/duckdb:duckdb 17547615 16454493 1.07
tpcds_q64/duckdb:duckdb 63881550 61494910 1.04
tpcds_q65/duckdb:duckdb 39931626 37288966 1.07
tpcds_q66/duckdb:duckdb 29437248 27835051 1.06
tpcds_q67/duckdb:duckdb 146771365 138652048 1.06
tpcds_q68/duckdb:duckdb 30540367 28095776 1.09
tpcds_q69/duckdb:duckdb 31083506 29027867 1.07
tpcds_q70/duckdb:duckdb 17814369 17390013 1.02
tpcds_q71/duckdb:duckdb 18380015 17485792 1.05
tpcds_q72/duckdb:duckdb 49912918 46890553 1.06
tpcds_q73/duckdb:duckdb 14808722 14232151 1.04
tpcds_q74/duckdb:duckdb 154057993 150877222 1.02
tpcds_q75/duckdb:duckdb 50280780 48625375 1.03
tpcds_q76/duckdb:duckdb 🚨 16531580 14976173 1.10
tpcds_q77/duckdb:duckdb 16449145 16475639 1.00
tpcds_q78/duckdb:duckdb 71500040 69209848 1.03
tpcds_q79/duckdb:duckdb 21779673 20724152 1.05
tpcds_q80/duckdb:duckdb 34895996 33063104 1.06
tpcds_q81/duckdb:duckdb 44974718 43198588 1.04
tpcds_q82/duckdb:duckdb 10979794 10235008 1.07
tpcds_q83/duckdb:duckdb 12207865 11961893 1.02
tpcds_q84/duckdb:duckdb 🚨 17512888 15523734 1.13
tpcds_q85/duckdb:duckdb 29536225 27229922 1.08
tpcds_q86/duckdb:duckdb 13407131 13164680 1.02
tpcds_q87/duckdb:duckdb 38561915 37174468 1.04
tpcds_q88/duckdb:duckdb 31042377 31601590 0.98
tpcds_q89/duckdb:duckdb 23293402 22576328 1.03
tpcds_q90/duckdb:duckdb 7108860 6841155 1.04
tpcds_q91/duckdb:duckdb 16710450 16354235 1.02
tpcds_q92/duckdb:duckdb 11431950 10810132 1.06
tpcds_q93/duckdb:duckdb 🚨 28207711 25057545 1.13
tpcds_q94/duckdb:duckdb 15918832 16016953 0.99
tpcds_q95/duckdb:duckdb 🚨 128090344 113446898 1.13
tpcds_q96/duckdb:duckdb 6500604 6242047 1.04
tpcds_q97/duckdb:duckdb 35408142 34369436 1.03
tpcds_q98/duckdb:duckdb 22082684 22273644 0.99
tpcds_q99/duckdb:duckdb 17962080 17977634 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +6.0% +16.2% -8.8% +23.3% ➖ noise
1 datafusion:vortex-file-compressed +27.0% +16.2% +9.3% +24.1% ➖ noise
1 duckdb:duckdb +24.7% +16.2% +7.3% +25.6% ➖ noise
1 duckdb:vortex-compact +3.3% +16.2% -11.1% +22.1% ➖ noise
1 duckdb:vortex-file-compressed +7.7% +16.2% -7.3% +26.1% ➖ noise
2 datafusion:vortex-compact -3.8% +4.3% -7.7% +12.8% ➖ noise
2 datafusion:vortex-file-compressed +20.8% +4.3% +15.9% +12.3% 🚨 regression
2 duckdb:duckdb +12.8% +4.3% +8.1% +12.3% ➖ noise
2 duckdb:vortex-compact +6.8% +4.3% +2.4% +26.6% ➖ noise
2 duckdb:vortex-file-compressed +1.0% +4.3% -3.1% +14.6% ➖ noise
3 datafusion:vortex-compact +2.1% +6.7% -4.4% +28.6% ➖ noise
3 datafusion:vortex-file-compressed +23.3% +6.7% +15.5% +14.8% 🚨 regression
3 duckdb:duckdb +24.5% +6.7% +16.7% +12.3% 🚨 regression
3 duckdb:vortex-compact +7.8% +6.7% +1.0% +12.3% ➖ noise
3 duckdb:vortex-file-compressed +10.2% +6.7% +3.3% +12.3% ➖ noise
4 datafusion:vortex-compact -1.4% +12.9% -12.7% +12.3% ✅ faster
4 datafusion:vortex-file-compressed +24.7% +12.9% +10.4% +12.3% ➖ noise
4 duckdb:duckdb +11.1% +12.9% -1.6% +12.3% ➖ noise
4 duckdb:vortex-compact +1.6% +12.9% -10.0% +14.2% ➖ noise
4 duckdb:vortex-file-compressed +10.7% +12.9% -2.0% +13.1% ➖ noise
5 datafusion:vortex-compact +9.4% +10.9% -1.3% +12.3% ➖ noise
5 datafusion:vortex-file-compressed +22.0% +10.9% +10.1% +16.0% ➖ noise
5 duckdb:duckdb +13.9% +10.9% +2.7% +17.0% ➖ noise
5 duckdb:vortex-compact +4.6% +10.9% -5.7% +12.3% ➖ noise
5 duckdb:vortex-file-compressed +13.6% +10.9% +2.5% +12.3% ➖ noise
6 datafusion:vortex-compact +8.4% +13.4% -4.5% +14.7% ➖ noise
6 datafusion:vortex-file-compressed +13.7% +13.4% +0.2% +18.3% ➖ noise
6 duckdb:duckdb +17.4% +13.4% +3.5% +12.3% ➖ noise
6 duckdb:vortex-compact +8.3% +13.4% -4.6% +12.4% ➖ noise
6 duckdb:vortex-file-compressed +8.4% +13.4% -4.5% +12.3% ➖ noise
7 datafusion:vortex-compact +21.4% +11.1% +9.3% +28.0% ➖ noise
7 datafusion:vortex-file-compressed +40.2% +11.1% +26.2% +13.5% 🚨 regression
7 duckdb:duckdb +16.8% +11.1% +5.1% +12.3% ➖ noise
7 duckdb:vortex-compact +7.6% +11.1% -3.1% +33.5% ➖ noise
7 duckdb:vortex-file-compressed +7.3% +11.1% -3.4% +12.3% ➖ noise
8 datafusion:vortex-compact +13.9% +13.5% +0.4% +12.3% ➖ noise
8 datafusion:vortex-file-compressed +11.2% +13.5% -2.0% +12.3% ➖ noise
8 duckdb:duckdb +2.9% +13.5% -9.3% +12.3% ➖ noise
8 duckdb:vortex-compact +9.9% +13.5% -3.2% +12.3% ➖ noise
8 duckdb:vortex-file-compressed +13.3% +13.5% -0.1% +16.3% ➖ noise
9 datafusion:vortex-compact +14.4% +15.3% -0.8% +16.2% ➖ noise
9 datafusion:vortex-file-compressed +12.8% +15.3% -2.2% +12.3% ➖ noise
9 duckdb:duckdb +10.2% +15.3% -4.4% +12.3% ➖ noise
9 duckdb:vortex-compact +12.2% +15.3% -2.7% +13.5% ➖ noise
9 duckdb:vortex-file-compressed +13.9% +15.3% -1.3% +12.7% ➖ noise
10 datafusion:vortex-compact +3.6% +20.1% -13.7% +12.3% ✅ faster
10 datafusion:vortex-file-compressed +21.8% +20.1% +1.4% +21.0% ➖ noise
10 duckdb:duckdb +9.8% +20.1% -8.6% +12.3% ➖ noise
10 duckdb:vortex-compact +7.3% +20.1% -10.7% +12.3% ➖ noise
10 duckdb:vortex-file-compressed +13.0% +20.1% -5.9% +12.3% ➖ noise
11 datafusion:vortex-compact +8.5% +21.8% -10.9% +14.7% ➖ noise
11 datafusion:vortex-file-compressed +14.7% +21.8% -5.8% +12.3% ➖ noise
11 duckdb:duckdb +9.6% +21.8% -10.1% +12.3% ➖ noise
11 duckdb:vortex-compact +7.4% +21.8% -11.8% +12.3% ✅ faster
11 duckdb:vortex-file-compressed +8.2% +21.8% -11.2% +12.3% ✅ faster
12 datafusion:vortex-compact +8.8% +27.2% -14.4% +18.3% ➖ noise
12 datafusion:vortex-file-compressed +15.9% +27.2% -8.9% +24.3% ➖ noise
12 duckdb:duckdb +7.5% +27.2% -15.5% +12.3% ✅ faster
12 duckdb:vortex-compact +16.3% +27.2% -8.6% +12.3% ➖ noise
12 duckdb:vortex-file-compressed +9.9% +27.2% -13.6% +28.6% ➖ noise
13 datafusion:vortex-compact +22.5% +14.6% +6.9% +22.7% ➖ noise
13 datafusion:vortex-file-compressed +2.5% +14.6% -10.5% +12.3% ➖ noise
13 duckdb:duckdb +6.2% +14.6% -7.3% +12.3% ➖ noise
13 duckdb:vortex-compact +9.7% +14.6% -4.3% +13.4% ➖ noise
13 duckdb:vortex-file-compressed +4.1% +14.6% -9.1% +12.3% ➖ noise
14 datafusion:vortex-compact +8.2% +9.4% -1.1% +12.3% ➖ noise
14 datafusion:vortex-file-compressed +17.6% +9.4% +7.5% +12.3% ➖ noise
14 duckdb:duckdb +7.0% +9.4% -2.2% +12.3% ➖ noise
14 duckdb:vortex-compact +5.9% +9.4% -3.2% +12.3% ➖ noise
14 duckdb:vortex-file-compressed +10.8% +9.4% +1.3% +12.3% ➖ noise
15 datafusion:vortex-compact +11.2% +18.0% -5.7% +12.3% ➖ noise
15 datafusion:vortex-file-compressed +23.0% +18.0% +4.3% +13.2% ➖ noise
15 duckdb:duckdb +10.4% +18.0% -6.4% +12.3% ➖ noise
15 duckdb:vortex-compact +15.8% +18.0% -1.8% +13.9% ➖ noise
15 duckdb:vortex-file-compressed +8.5% +18.0% -8.0% +18.4% ➖ noise
16 datafusion:vortex-compact +7.1% +12.0% -4.3% +12.5% ➖ noise
16 datafusion:vortex-file-compressed +28.1% +12.0% +14.4% +14.7% ➖ noise
16 duckdb:duckdb +7.0% +12.0% -4.4% +13.7% ➖ noise
16 duckdb:vortex-compact +22.6% +12.0% +9.5% +12.6% ➖ noise
16 duckdb:vortex-file-compressed +8.8% +12.0% -2.9% +12.3% ➖ noise
17 datafusion:vortex-compact +12.0% +10.0% +1.8% +22.6% ➖ noise
17 datafusion:vortex-file-compressed +27.1% +10.0% +15.5% +15.2% 🚨 regression
17 duckdb:duckdb +9.2% +10.0% -0.8% +12.3% ➖ noise
17 duckdb:vortex-compact +24.9% +10.0% +13.6% +12.3% 🚨 regression
17 duckdb:vortex-file-compressed +11.1% +10.0% +1.0% +20.1% ➖ noise
18 datafusion:vortex-compact +7.5% +7.0% +0.4% +12.3% ➖ noise
18 datafusion:vortex-file-compressed +28.3% +7.0% +19.9% +12.3% 🚨 regression
18 duckdb:duckdb +9.1% +7.0% +1.9% +12.3% ➖ noise
18 duckdb:vortex-compact +17.4% +7.0% +9.7% +12.3% ➖ noise
18 duckdb:vortex-file-compressed +16.2% +7.0% +8.5% +12.3% ➖ noise
19 datafusion:vortex-compact +10.3% +7.3% +2.7% +12.3% ➖ noise
19 datafusion:vortex-file-compressed +26.0% +7.3% +17.4% +12.3% 🚨 regression
19 duckdb:duckdb +8.7% +7.3% +1.2% +12.3% ➖ noise
19 duckdb:vortex-compact +18.8% +7.3% +10.7% +12.3% ➖ noise
19 duckdb:vortex-file-compressed +6.9% +7.3% -0.4% +12.8% ➖ noise
20 datafusion:vortex-compact +1.3% +10.8% -8.6% +24.7% ➖ noise
20 datafusion:vortex-file-compressed +34.3% +10.8% +21.2% +12.3% 🚨 regression
20 duckdb:duckdb +8.3% +10.8% -2.3% +12.3% ➖ noise
20 duckdb:vortex-compact +24.2% +10.8% +12.1% +12.3% ➖ noise
20 duckdb:vortex-file-compressed +6.9% +10.8% -3.5% +12.3% ➖ noise
21 datafusion:vortex-compact +25.8% +11.4% +13.0% +18.5% ➖ noise
21 datafusion:vortex-file-compressed +30.8% +11.4% +17.4% +16.4% 🚨 regression
21 duckdb:duckdb +6.9% +11.4% -4.0% +20.0% ➖ noise
21 duckdb:vortex-compact +25.8% +11.4% +13.0% +18.9% ➖ noise
21 duckdb:vortex-file-compressed +8.8% +11.4% -2.3% +12.3% ➖ noise
22 datafusion:vortex-compact -7.2% -3.2% -4.2% +31.4% ➖ noise
22 datafusion:vortex-file-compressed +20.0% -3.2% +23.9% +23.5% 🚨 regression
22 duckdb:duckdb +11.4% -3.2% +15.1% +14.3% 🚨 regression
22 duckdb:vortex-compact +6.8% -3.2% +10.3% +14.3% ➖ noise
22 duckdb:vortex-file-compressed +14.1% -3.2% +17.9% +19.2% ➖ noise
23 datafusion:vortex-compact +5.3% +9.6% -3.9% +12.3% ➖ noise
23 datafusion:vortex-file-compressed +14.0% +9.6% +4.1% +15.5% ➖ noise
23 duckdb:duckdb +11.5% +9.6% +1.8% +12.9% ➖ noise
23 duckdb:vortex-compact +8.3% +9.6% -1.1% +13.2% ➖ noise
23 duckdb:vortex-file-compressed +9.3% +9.6% -0.3% +12.6% ➖ noise
24 datafusion:vortex-compact +11.2% +10.9% +0.3% +19.9% ➖ noise
24 datafusion:vortex-file-compressed +13.1% +10.9% +2.0% +12.6% ➖ noise
24 duckdb:duckdb +4.4% +10.9% -5.9% +12.3% ➖ noise
24 duckdb:vortex-compact +6.2% +10.9% -4.3% +12.3% ➖ noise
24 duckdb:vortex-file-compressed +11.7% +10.9% +0.7% +12.3% ➖ noise
25 datafusion:vortex-compact +8.4% +8.4% +0.0% +12.3% ➖ noise
25 datafusion:vortex-file-compressed +6.8% +8.4% -1.4% +12.3% ➖ noise
25 duckdb:duckdb +9.8% +8.4% +1.3% +16.6% ➖ noise
25 duckdb:vortex-compact +12.5% +8.4% +3.8% +12.3% ➖ noise
25 duckdb:vortex-file-compressed +8.4% +8.4% +0.0% +14.1% ➖ noise
26 datafusion:vortex-compact +7.1% +9.5% -2.2% +32.8% ➖ noise
26 datafusion:vortex-file-compressed +16.0% +9.5% +5.9% +12.3% ➖ noise
26 duckdb:duckdb +11.1% +9.5% +1.5% +12.3% ➖ noise
26 duckdb:vortex-compact +2.7% +9.5% -6.2% +15.0% ➖ noise
26 duckdb:vortex-file-compressed +10.1% +9.5% +0.5% +29.1% ➖ noise
27 datafusion:vortex-compact +4.3% +11.4% -6.3% +12.3% ➖ noise
27 datafusion:vortex-file-compressed +14.7% +11.4% +3.0% +12.3% ➖ noise
27 duckdb:duckdb +3.3% +11.4% -7.3% +12.3% ➖ noise
27 duckdb:vortex-compact +3.7% +11.4% -6.9% +12.3% ➖ noise
27 duckdb:vortex-file-compressed +8.6% +11.4% -2.5% +12.3% ➖ noise
28 datafusion:vortex-compact +4.4% +11.7% -6.5% +14.5% ➖ noise
28 datafusion:vortex-file-compressed +15.8% +11.7% +3.7% +12.3% ➖ noise
28 duckdb:duckdb -2.3% +11.7% -12.5% +12.3% ✅ faster
28 duckdb:vortex-compact +9.4% +11.7% -2.0% +18.2% ➖ noise
28 duckdb:vortex-file-compressed +2.4% +11.7% -8.3% +12.3% ➖ noise
29 datafusion:vortex-compact +6.0% +7.8% -1.6% +12.3% ➖ noise
29 datafusion:vortex-file-compressed +12.8% +7.8% +4.6% +26.9% ➖ noise
29 duckdb:duckdb +10.4% +7.8% +2.4% +12.3% ➖ noise
29 duckdb:vortex-compact +7.0% +7.8% -0.7% +12.3% ➖ noise
29 duckdb:vortex-file-compressed +8.9% +7.8% +1.0% +12.3% ➖ noise
30 datafusion:vortex-compact +21.3% +7.0% +13.4% +21.6% ➖ noise
30 datafusion:vortex-file-compressed +12.5% +7.0% +5.1% +22.2% ➖ noise
30 duckdb:duckdb +0.8% +7.0% -5.8% +12.3% ➖ noise
30 duckdb:vortex-compact +7.3% +7.0% +0.2% +12.3% ➖ noise
30 duckdb:vortex-file-compressed +3.4% +7.0% -3.4% +22.8% ➖ noise
31 datafusion:vortex-compact +3.7% +11.6% -7.1% +12.3% ➖ noise
31 datafusion:vortex-file-compressed +13.4% +11.6% +1.6% +12.3% ➖ noise
31 duckdb:duckdb +4.8% +11.6% -6.1% +12.3% ➖ noise
31 duckdb:vortex-compact +13.8% +11.6% +2.0% +14.3% ➖ noise
31 duckdb:vortex-file-compressed +10.4% +11.6% -1.1% +13.7% ➖ noise
32 datafusion:vortex-compact +10.6% +8.9% +1.5% +12.3% ➖ noise
32 datafusion:vortex-file-compressed +8.7% +8.9% -0.1% +12.3% ➖ noise
32 duckdb:duckdb +2.1% +8.9% -6.2% +12.3% ➖ noise
32 duckdb:vortex-compact +14.0% +8.9% +4.7% +12.3% ➖ noise
32 duckdb:vortex-file-compressed +8.8% +8.9% -0.0% +12.3% ➖ noise
33 datafusion:vortex-compact +11.5% +4.1% +7.1% +20.1% ➖ noise
33 datafusion:vortex-file-compressed +6.0% +4.1% +1.8% +23.3% ➖ noise
33 duckdb:duckdb +1.3% +4.1% -2.7% +12.3% ➖ noise
33 duckdb:vortex-compact +12.4% +4.1% +7.9% +12.3% ➖ noise
33 duckdb:vortex-file-compressed +5.0% +4.1% +0.8% +12.3% ➖ noise
34 datafusion:vortex-compact +26.6% +12.2% +12.8% +12.3% 🚨 regression
34 datafusion:vortex-file-compressed +8.3% +12.2% -3.5% +30.9% ➖ noise
34 duckdb:duckdb +6.2% +12.2% -5.3% +12.3% ➖ noise
34 duckdb:vortex-compact +7.1% +12.2% -4.5% +20.8% ➖ noise
34 duckdb:vortex-file-compressed +7.0% +12.2% -4.6% +12.3% ➖ noise
35 datafusion:vortex-compact +14.5% +9.8% +4.4% +12.3% ➖ noise
35 datafusion:vortex-file-compressed +4.6% +9.8% -4.7% +12.3% ➖ noise
35 duckdb:duckdb +10.8% +9.8% +1.0% +12.3% ➖ noise
35 duckdb:vortex-compact +10.3% +9.8% +0.5% +12.3% ➖ noise
35 duckdb:vortex-file-compressed +5.3% +9.8% -4.0% +12.3% ➖ noise
36 datafusion:vortex-compact +18.2% +7.3% +10.1% +12.3% ➖ noise
36 datafusion:vortex-file-compressed +6.4% +7.3% -0.9% +12.3% ➖ noise
36 duckdb:duckdb +8.5% +7.3% +1.1% +12.3% ➖ noise
36 duckdb:vortex-compact +3.7% +7.3% -3.4% +12.3% ➖ noise
36 duckdb:vortex-file-compressed +10.6% +7.3% +3.0% +12.3% ➖ noise
37 datafusion:vortex-compact +21.3% +9.6% +10.7% +14.0% ➖ noise
37 datafusion:vortex-file-compressed +7.2% +9.6% -2.2% +13.9% ➖ noise
37 duckdb:duckdb +8.3% +9.6% -1.2% +12.3% ➖ noise
37 duckdb:vortex-compact +8.8% +9.6% -0.7% +34.7% ➖ noise
37 duckdb:vortex-file-compressed +10.2% +9.6% +0.6% +12.3% ➖ noise
38 datafusion:vortex-compact +19.5% +5.5% +13.3% +14.4% ➖ noise
38 datafusion:vortex-file-compressed +12.4% +5.5% +6.5% +17.1% ➖ noise
38 duckdb:duckdb +7.3% +5.5% +1.7% +12.3% ➖ noise
38 duckdb:vortex-compact +6.8% +5.5% +1.2% +12.3% ➖ noise
38 duckdb:vortex-file-compressed +10.9% +5.5% +5.1% +12.3% ➖ noise
39 datafusion:vortex-compact +34.4% +12.3% +19.6% +13.2% 🚨 regression
39 datafusion:vortex-file-compressed +18.7% +12.3% +5.7% +12.6% ➖ noise
39 duckdb:duckdb +6.8% +12.3% -4.9% +15.8% ➖ noise
39 duckdb:vortex-compact +14.7% +12.3% +2.1% +14.5% ➖ noise
39 duckdb:vortex-file-compressed +2.8% +12.3% -8.5% +12.3% ➖ noise
40 datafusion:vortex-compact +26.6% +10.1% +15.0% +12.3% 🚨 regression
40 datafusion:vortex-file-compressed +11.5% +10.1% +1.3% +17.5% ➖ noise
40 duckdb:duckdb +6.8% +10.1% -3.0% +12.3% ➖ noise
40 duckdb:vortex-compact +18.4% +10.1% +7.5% +12.3% ➖ noise
40 duckdb:vortex-file-compressed +7.5% +10.1% -2.3% +19.4% ➖ noise
41 datafusion:vortex-compact +30.4% +11.8% +16.6% +12.3% 🚨 regression
41 datafusion:vortex-file-compressed +12.2% +11.8% +0.3% +12.3% ➖ noise
41 duckdb:duckdb +4.5% +11.8% -6.6% +12.3% ➖ noise
41 duckdb:vortex-compact +19.5% +11.8% +6.9% +12.3% ➖ noise
41 duckdb:vortex-file-compressed +7.5% +11.8% -3.8% +12.3% ➖ noise
42 datafusion:vortex-compact +23.3% +9.0% +13.1% +12.3% 🚨 regression
42 datafusion:vortex-file-compressed +11.7% +9.0% +2.5% +12.3% ➖ noise
42 duckdb:duckdb +8.0% +9.0% -1.0% +12.3% ➖ noise
42 duckdb:vortex-compact +26.0% +9.0% +15.5% +13.9% 🚨 regression
42 duckdb:vortex-file-compressed +13.1% +9.0% +3.7% +12.3% ➖ noise
43 datafusion:vortex-compact +15.0% +10.4% +4.2% +25.3% ➖ noise
43 datafusion:vortex-file-compressed +10.0% +10.4% -0.3% +12.3% ➖ noise
43 duckdb:duckdb -0.2% +10.4% -9.6% +12.3% ➖ noise
43 duckdb:vortex-compact +11.4% +10.4% +0.9% +24.9% ➖ noise
43 duckdb:vortex-file-compressed +2.3% +10.4% -7.3% +27.4% ➖ noise
44 datafusion:vortex-compact +19.0% +3.5% +14.9% +12.3% 🚨 regression
44 datafusion:vortex-file-compressed +4.3% +3.5% +0.8% +15.1% ➖ noise
44 duckdb:duckdb +10.3% +3.5% +6.6% +12.3% ➖ noise
44 duckdb:vortex-compact +31.6% +3.5% +27.1% +12.3% 🚨 regression
44 duckdb:vortex-file-compressed +9.3% +3.5% +5.6% +19.9% ➖ noise
45 datafusion:vortex-compact +25.9% +7.7% +16.9% +12.3% 🚨 regression
45 datafusion:vortex-file-compressed +11.4% +7.7% +3.4% +12.3% ➖ noise
45 duckdb:duckdb +9.8% +7.7% +1.9% +12.3% ➖ noise
45 duckdb:vortex-compact +37.6% +7.7% +27.8% +12.3% 🚨 regression
45 duckdb:vortex-file-compressed +11.2% +7.7% +3.2% +12.3% ➖ noise
46 datafusion:vortex-compact +18.8% +8.7% +9.3% +12.3% ➖ noise
46 datafusion:vortex-file-compressed +10.3% +8.7% +1.4% +12.3% ➖ noise
46 duckdb:duckdb +9.8% +8.7% +1.0% +12.3% ➖ noise
46 duckdb:vortex-compact +10.7% +8.7% +1.8% +12.3% ➖ noise
46 duckdb:vortex-file-compressed +4.8% +8.7% -3.6% +12.3% ➖ noise
47 datafusion:vortex-compact +28.8% +6.4% +21.0% +12.3% 🚨 regression
47 datafusion:vortex-file-compressed +3.9% +6.4% -2.4% +12.3% ➖ noise
47 duckdb:duckdb +9.7% +6.4% +3.1% +12.3% ➖ noise
47 duckdb:vortex-compact +19.7% +6.4% +12.5% +12.3% 🚨 regression
47 duckdb:vortex-file-compressed +15.3% +6.4% +8.3% +13.0% ➖ noise
48 datafusion:vortex-compact +20.2% +7.8% +11.5% +16.7% ➖ noise
48 datafusion:vortex-file-compressed +4.8% +7.8% -2.7% +12.3% ➖ noise
48 duckdb:duckdb +4.5% +7.8% -3.1% +12.3% ➖ noise
48 duckdb:vortex-compact +5.8% +7.8% -1.8% +12.3% ➖ noise
48 duckdb:vortex-file-compressed +3.9% +7.8% -3.6% +22.0% ➖ noise
49 datafusion:vortex-compact +26.5% +4.3% +21.2% +14.2% 🚨 regression
49 datafusion:vortex-file-compressed +5.0% +4.3% +0.6% +12.3% ➖ noise
49 duckdb:duckdb -0.6% +4.3% -4.7% +13.0% ➖ noise
49 duckdb:vortex-compact +26.1% +4.3% +20.8% +22.0% ➖ noise
49 duckdb:vortex-file-compressed +19.8% +4.3% +14.8% +12.8% 🚨 regression
50 datafusion:vortex-compact +28.8% +4.1% +23.8% +12.3% 🚨 regression
50 datafusion:vortex-file-compressed +6.6% +4.1% +2.5% +12.3% ➖ noise
50 duckdb:duckdb +8.0% +4.1% +3.8% +12.3% ➖ noise
50 duckdb:vortex-compact +21.2% +4.1% +16.5% +12.3% 🚨 regression
50 duckdb:vortex-file-compressed +12.5% +4.1% +8.1% +12.3% ➖ noise
51 datafusion:vortex-compact +15.9% +7.5% +7.8% +12.3% ➖ noise
51 datafusion:vortex-file-compressed +5.9% +7.5% -1.5% +13.6% ➖ noise
51 duckdb:duckdb +3.9% +7.5% -3.3% +12.3% ➖ noise
51 duckdb:vortex-compact +16.2% +7.5% +8.1% +14.5% ➖ noise
51 duckdb:vortex-file-compressed +10.1% +7.5% +2.4% +24.2% ➖ noise
52 datafusion:vortex-compact +24.3% +10.7% +12.3% +15.2% ➖ noise
52 datafusion:vortex-file-compressed +2.4% +10.7% -7.4% +12.3% ➖ noise
52 duckdb:duckdb -0.7% +10.7% -10.3% +18.3% ➖ noise
52 duckdb:vortex-compact +23.1% +10.7% +11.2% +14.2% ➖ noise
52 duckdb:vortex-file-compressed +7.1% +10.7% -3.2% +13.9% ➖ noise
53 datafusion:vortex-compact +23.8% +9.1% +13.5% +19.1% ➖ noise
53 datafusion:vortex-file-compressed +5.9% +9.1% -2.9% +25.4% ➖ noise
53 duckdb:duckdb +8.6% +9.1% -0.4% +12.3% ➖ noise
53 duckdb:vortex-compact +20.4% +9.1% +10.4% +12.3% ➖ noise
53 duckdb:vortex-file-compressed +13.3% +9.1% +3.9% +12.3% ➖ noise
54 datafusion:vortex-compact +19.2% +4.3% +14.2% +12.3% 🚨 regression
54 datafusion:vortex-file-compressed +3.2% +4.3% -1.1% +12.3% ➖ noise
54 duckdb:duckdb +4.5% +4.3% +0.2% +12.3% ➖ noise
54 duckdb:vortex-compact +13.6% +4.3% +8.9% +18.1% ➖ noise
54 duckdb:vortex-file-compressed +20.2% +4.3% +15.2% +12.3% 🚨 regression
55 datafusion:vortex-compact +28.0% +6.4% +20.2% +13.7% 🚨 regression
55 datafusion:vortex-file-compressed +2.1% +6.4% -4.1% +12.3% ➖ noise
55 duckdb:duckdb +9.4% +6.4% +2.8% +14.9% ➖ noise
55 duckdb:vortex-compact +22.4% +6.4% +15.0% +12.3% 🚨 regression
55 duckdb:vortex-file-compressed +17.1% +6.4% +10.0% +12.3% ➖ noise
56 datafusion:vortex-compact +21.0% +4.8% +15.4% +12.3% 🚨 regression
56 datafusion:vortex-file-compressed -1.1% +4.8% -5.7% +12.3% ➖ noise
56 duckdb:duckdb +0.9% +4.8% -3.8% +12.3% ➖ noise
56 duckdb:vortex-compact +13.8% +4.8% +8.6% +12.3% ➖ noise
56 duckdb:vortex-file-compressed +3.6% +4.8% -1.2% +40.4% ➖ noise
57 datafusion:vortex-compact +9.7% +10.6% -0.8% +12.3% ➖ noise
57 datafusion:vortex-file-compressed +2.7% +10.6% -7.2% +14.9% ➖ noise
57 duckdb:duckdb +6.7% +10.6% -3.5% +12.3% ➖ noise
57 duckdb:vortex-compact +15.4% +10.6% +4.3% +12.3% ➖ noise
57 duckdb:vortex-file-compressed +8.5% +10.6% -1.9% +12.3% ➖ noise
58 datafusion:vortex-compact +5.3% +10.1% -4.4% +12.3% ➖ noise
58 datafusion:vortex-file-compressed +11.6% +10.1% +1.4% +12.6% ➖ noise
58 duckdb:duckdb -2.1% +10.1% -11.1% +12.3% ✅ faster
58 duckdb:vortex-compact +2.4% +10.1% -7.0% +22.2% ➖ noise
58 duckdb:vortex-file-compressed +16.3% +10.1% +5.6% +14.3% ➖ noise
59 datafusion:vortex-compact +0.7% +6.3% -5.3% +14.9% ➖ noise
59 datafusion:vortex-file-compressed +13.6% +6.3% +6.8% +14.9% ➖ noise
59 duckdb:duckdb +4.9% +6.3% -1.3% +12.3% ➖ noise
59 duckdb:vortex-compact +7.7% +6.3% +1.3% +12.3% ➖ noise
59 duckdb:vortex-file-compressed +6.0% +6.3% -0.3% +25.4% ➖ noise
60 datafusion:vortex-compact +11.8% +7.3% +4.1% +13.0% ➖ noise
60 datafusion:vortex-file-compressed +20.7% +7.3% +12.5% +12.3% 🚨 regression
60 duckdb:duckdb +1.2% +7.3% -5.7% +12.3% ➖ noise
60 duckdb:vortex-compact +20.6% +7.3% +12.4% +15.5% ➖ noise
60 duckdb:vortex-file-compressed +10.0% +7.3% +2.5% +12.3% ➖ noise
61 datafusion:vortex-compact +16.3% +6.9% +8.8% +12.3% ➖ noise
61 datafusion:vortex-file-compressed +20.2% +6.9% +12.4% +14.7% ➖ noise
61 duckdb:duckdb +3.8% +6.9% -3.0% +12.3% ➖ noise
61 duckdb:vortex-compact +10.1% +6.9% +3.0% +12.3% ➖ noise
61 duckdb:vortex-file-compressed +7.6% +6.9% +0.7% +22.9% ➖ noise
62 datafusion:vortex-compact +49.9% -1.0% +51.4% +24.9% 🚨 regression
62 datafusion:vortex-file-compressed +51.0% -1.0% +52.5% +26.9% 🚨 regression
62 duckdb:duckdb +4.1% -1.0% +5.1% +15.1% ➖ noise
62 duckdb:vortex-compact +24.0% -1.0% +25.3% +17.9% 🚨 regression
62 duckdb:vortex-file-compressed +5.1% -1.0% +6.1% +14.6% ➖ noise
63 datafusion:vortex-compact +22.2% +1.8% +20.0% +14.5% 🚨 regression
63 datafusion:vortex-file-compressed +14.6% +1.8% +12.5% +17.5% ➖ noise
63 duckdb:duckdb +6.6% +1.8% +4.7% +12.3% ➖ noise
63 duckdb:vortex-compact +8.5% +1.8% +6.5% +14.0% ➖ noise
63 duckdb:vortex-file-compressed +13.8% +1.8% +11.8% +12.3% ➖ noise
64 datafusion:vortex-compact +17.9% +11.2% +5.9% +12.3% ➖ noise
64 datafusion:vortex-file-compressed +20.0% +11.2% +7.9% +12.3% ➖ noise
64 duckdb:duckdb +3.9% +11.2% -6.6% +12.3% ➖ noise
64 duckdb:vortex-compact +2.2% +11.2% -8.1% +12.3% ➖ noise
64 duckdb:vortex-file-compressed +8.0% +11.2% -2.9% +12.3% ➖ noise
65 datafusion:vortex-compact +18.9% +5.7% +12.5% +29.5% ➖ noise
65 datafusion:vortex-file-compressed -3.6% +5.7% -8.8% +33.4% ➖ noise
65 duckdb:duckdb +7.1% +5.7% +1.3% +12.3% ➖ noise
65 duckdb:vortex-compact +7.0% +5.7% +1.2% +12.3% ➖ noise
65 duckdb:vortex-file-compressed +10.1% +5.7% +4.1% +12.3% ➖ noise
66 datafusion:vortex-compact +22.8% +15.4% +6.4% +19.0% ➖ noise
66 datafusion:vortex-file-compressed +1.4% +15.4% -12.1% +12.3% ✅ faster
66 duckdb:duckdb +5.8% +15.4% -8.4% +12.3% ➖ noise
66 duckdb:vortex-compact +7.8% +15.4% -6.6% +13.6% ➖ noise
66 duckdb:vortex-file-compressed +7.8% +15.4% -6.6% +12.3% ➖ noise
67 datafusion:vortex-compact +13.7% +20.6% -5.7% +12.3% ➖ noise
67 datafusion:vortex-file-compressed +6.6% +20.6% -11.6% +18.9% ➖ noise
67 duckdb:duckdb +5.9% +20.6% -12.2% +14.7% ➖ noise
67 duckdb:vortex-compact +6.2% +20.6% -11.9% +12.3% ✅ faster
67 duckdb:vortex-file-compressed +8.0% +20.6% -10.4% +12.3% ➖ noise
68 datafusion:vortex-compact +17.2% +11.8% +4.8% +23.0% ➖ noise
68 datafusion:vortex-file-compressed +2.7% +11.8% -8.2% +12.3% ➖ noise
68 duckdb:duckdb +8.7% +11.8% -2.8% +12.3% ➖ noise
68 duckdb:vortex-compact +0.0% +11.8% -10.6% +12.3% ➖ noise
68 duckdb:vortex-file-compressed +11.3% +11.8% -0.5% +29.4% ➖ noise
69 datafusion:vortex-compact +20.5% +12.5% +7.1% +31.1% ➖ noise
69 datafusion:vortex-file-compressed +9.9% +12.5% -2.3% +14.4% ➖ noise
69 duckdb:duckdb +7.1% +12.5% -4.8% +12.3% ➖ noise
69 duckdb:vortex-compact +10.4% +12.5% -1.8% +12.3% ➖ noise
69 duckdb:vortex-file-compressed +14.7% +12.5% +2.0% +12.3% ➖ noise
70 datafusion:vortex-compact +24.8% +16.6% +7.1% +12.3% ➖ noise
70 datafusion:vortex-file-compressed +7.4% +16.6% -7.9% +27.0% ➖ noise
70 duckdb:duckdb +2.4% +16.6% -12.1% +12.3% ✅ faster
70 duckdb:vortex-compact +12.0% +16.6% -3.9% +12.3% ➖ noise
70 duckdb:vortex-file-compressed +2.1% +16.6% -12.4% +12.3% ✅ faster
71 datafusion:vortex-compact +21.2% +11.0% +9.2% +12.3% ➖ noise
71 datafusion:vortex-file-compressed +4.7% +11.0% -5.7% +12.3% ➖ noise
71 duckdb:duckdb +5.1% +11.0% -5.3% +12.3% ➖ noise
71 duckdb:vortex-compact +18.3% +11.0% +6.5% +20.8% ➖ noise
71 duckdb:vortex-file-compressed +7.0% +11.0% -3.6% +12.3% ➖ noise
72 datafusion:vortex-compact +18.7% +8.4% +9.5% +12.3% ➖ noise
72 datafusion:vortex-file-compressed +20.8% +8.4% +11.5% +12.3% ➖ noise
72 duckdb:duckdb +6.4% +8.4% -1.8% +12.3% ➖ noise
72 duckdb:vortex-compact +9.9% +8.4% +1.4% +12.3% ➖ noise
72 duckdb:vortex-file-compressed +12.2% +8.4% +3.5% +12.3% ➖ noise
73 datafusion:vortex-compact +17.3% +3.7% +13.1% +13.4% ➖ noise
73 datafusion:vortex-file-compressed +20.1% +3.7% +15.8% +12.3% 🚨 regression
73 duckdb:duckdb +4.1% +3.7% +0.3% +12.3% ➖ noise
73 duckdb:vortex-compact +21.3% +3.7% +17.0% +12.3% 🚨 regression
73 duckdb:vortex-file-compressed +20.8% +3.7% +16.5% +18.4% ➖ noise
74 datafusion:vortex-compact +21.2% +9.5% +10.7% +12.3% ➖ noise
74 datafusion:vortex-file-compressed +4.9% +9.5% -4.1% +21.1% ➖ noise
74 duckdb:duckdb +2.1% +9.5% -6.7% +12.3% ➖ noise
74 duckdb:vortex-compact +8.0% +9.5% -1.4% +12.3% ➖ noise
74 duckdb:vortex-file-compressed +19.7% +9.5% +9.3% +12.7% ➖ noise
75 datafusion:vortex-compact +20.4% +7.6% +11.9% +16.9% ➖ noise
75 datafusion:vortex-file-compressed +17.2% +7.6% +8.9% +13.0% ➖ noise
75 duckdb:duckdb +3.4% +7.6% -3.9% +12.3% ➖ noise
75 duckdb:vortex-compact +11.7% +7.6% +3.8% +16.0% ➖ noise
75 duckdb:vortex-file-compressed +17.3% +7.6% +9.0% +12.3% ➖ noise
76 datafusion:vortex-compact +14.6% -0.8% +15.4% +12.3% 🚨 regression
76 datafusion:vortex-file-compressed +6.4% -0.8% +7.2% +12.3% ➖ noise
76 duckdb:duckdb +10.4% -0.8% +11.2% +12.7% ➖ noise
76 duckdb:vortex-compact +5.7% -0.8% +6.5% +12.8% ➖ noise
76 duckdb:vortex-file-compressed +19.8% -0.8% +20.7% +21.6% ➖ noise
77 datafusion:vortex-compact +5.6% +9.6% -3.6% +27.1% ➖ noise
77 datafusion:vortex-file-compressed +17.6% +9.6% +7.3% +30.1% ➖ noise
77 duckdb:duckdb -0.2% +9.6% -8.9% +13.2% ➖ noise
77 duckdb:vortex-compact +5.9% +9.6% -3.3% +16.3% ➖ noise
77 duckdb:vortex-file-compressed +22.5% +9.6% +11.8% +13.7% ➖ noise
78 datafusion:vortex-compact +8.7% +12.6% -3.5% +12.3% ➖ noise
78 datafusion:vortex-file-compressed +0.4% +12.6% -10.8% +12.3% ➖ noise
78 duckdb:duckdb +3.3% +12.6% -8.2% +12.3% ➖ noise
78 duckdb:vortex-compact +11.1% +12.6% -1.3% +12.3% ➖ noise
78 duckdb:vortex-file-compressed +19.6% +12.6% +6.3% +12.3% ➖ noise
79 datafusion:vortex-compact +6.6% +7.6% -0.9% +17.5% ➖ noise
79 datafusion:vortex-file-compressed +22.8% +7.6% +14.2% +28.8% ➖ noise
79 duckdb:duckdb +5.1% +7.6% -2.3% +12.3% ➖ noise
79 duckdb:vortex-compact +9.9% +7.6% +2.1% +13.6% ➖ noise
79 duckdb:vortex-file-compressed +27.6% +7.6% +18.6% +14.4% 🚨 regression
80 datafusion:vortex-compact +7.2% +19.1% -10.0% +12.3% ➖ noise
80 datafusion:vortex-file-compressed +16.0% +19.1% -2.6% +12.3% ➖ noise
80 duckdb:duckdb +5.5% +19.1% -11.4% +12.3% ✅ faster
80 duckdb:vortex-compact +8.7% +19.1% -8.7% +12.3% ➖ noise
80 duckdb:vortex-file-compressed +13.2% +19.1% -5.0% +12.3% ➖ noise
81 datafusion:vortex-compact +15.4% +14.8% +0.5% +16.8% ➖ noise
81 datafusion:vortex-file-compressed +21.5% +14.8% +5.8% +12.3% ➖ noise
81 duckdb:duckdb +4.1% +14.8% -9.3% +12.3% ➖ noise
81 duckdb:vortex-compact +9.0% +14.8% -5.1% +12.3% ➖ noise
81 duckdb:vortex-file-compressed +27.5% +14.8% +11.1% +15.7% ➖ noise
82 datafusion:vortex-compact +9.3% +16.9% -6.5% +12.3% ➖ noise
82 datafusion:vortex-file-compressed +18.7% +16.9% +1.5% +31.2% ➖ noise
82 duckdb:duckdb +7.3% +16.9% -8.2% +12.3% ➖ noise
82 duckdb:vortex-compact +8.4% +16.9% -7.3% +12.3% ➖ noise
82 duckdb:vortex-file-compressed +22.1% +16.9% +4.4% +12.3% ➖ noise
83 datafusion:vortex-compact +2.3% +15.1% -11.1% +20.9% ➖ noise
83 datafusion:vortex-file-compressed +32.6% +15.1% +15.2% +12.3% 🚨 regression
83 duckdb:duckdb +2.1% +15.1% -11.4% +12.3% ✅ faster
83 duckdb:vortex-compact +8.3% +15.1% -5.9% +12.3% ➖ noise
83 duckdb:vortex-file-compressed +15.7% +15.1% +0.5% +13.3% ➖ noise
84 datafusion:vortex-compact +12.9% +13.0% -0.1% +12.3% ➖ noise
84 datafusion:vortex-file-compressed +18.8% +13.0% +5.1% +12.3% ➖ noise
84 duckdb:duckdb +12.8% +13.0% -0.2% +12.3% ➖ noise
84 duckdb:vortex-compact +12.4% +13.0% -0.6% +33.4% ➖ noise
84 duckdb:vortex-file-compressed +7.7% +13.0% -4.7% +27.1% ➖ noise
85 datafusion:vortex-compact +6.8% +12.7% -5.2% +12.3% ➖ noise
85 datafusion:vortex-file-compressed +20.1% +12.7% +6.6% +12.3% ➖ noise
85 duckdb:duckdb +8.5% +12.7% -3.7% +12.3% ➖ noise
85 duckdb:vortex-compact +9.7% +12.7% -2.6% +12.3% ➖ noise
85 duckdb:vortex-file-compressed +14.0% +12.7% +1.2% +16.0% ➖ noise
86 datafusion:vortex-compact -11.4% +11.1% -20.3% +16.1% ✅ faster
86 datafusion:vortex-file-compressed +12.2% +11.1% +1.0% +37.4% ➖ noise
86 duckdb:duckdb +1.8% +11.1% -8.3% +12.3% ➖ noise
86 duckdb:vortex-compact +3.2% +11.1% -7.1% +30.8% ➖ noise
86 duckdb:vortex-file-compressed +10.0% +11.1% -1.0% +12.3% ➖ noise
87 datafusion:vortex-compact +6.4% +5.1% +1.2% +12.3% ➖ noise
87 datafusion:vortex-file-compressed +15.8% +5.1% +10.2% +13.5% ➖ noise
87 duckdb:duckdb +3.7% +5.1% -1.3% +12.6% ➖ noise
87 duckdb:vortex-compact +6.0% +5.1% +0.8% +12.4% ➖ noise
87 duckdb:vortex-file-compressed +6.5% +5.1% +1.3% +12.3% ➖ noise
88 datafusion:vortex-compact +9.0% +3.4% +5.5% +12.3% ➖ noise
88 datafusion:vortex-file-compressed +13.0% +3.4% +9.3% +12.3% ➖ noise
88 duckdb:duckdb -1.8% +3.4% -5.0% +12.3% ➖ noise
88 duckdb:vortex-compact +3.6% +3.4% +0.2% +12.3% ➖ noise
88 duckdb:vortex-file-compressed +6.9% +3.4% +3.4% +12.3% ➖ noise
89 datafusion:vortex-compact +8.3% +12.1% -3.4% +16.8% ➖ noise
89 datafusion:vortex-file-compressed +20.3% +12.1% +7.4% +21.5% ➖ noise
89 duckdb:duckdb +3.2% +12.1% -7.9% +14.0% ➖ noise
89 duckdb:vortex-compact +8.9% +12.1% -2.9% +26.0% ➖ noise
89 duckdb:vortex-file-compressed +6.6% +12.1% -4.8% +14.6% ➖ noise
90 datafusion:vortex-compact +5.0% +18.3% -11.2% +33.5% ➖ noise
90 datafusion:vortex-file-compressed +17.9% +18.3% -0.4% +13.0% ➖ noise
90 duckdb:duckdb +3.9% +18.3% -12.1% +12.3% ✅ faster
90 duckdb:vortex-compact +17.8% +18.3% -0.4% +12.3% ➖ noise
90 duckdb:vortex-file-compressed +14.7% +18.3% -3.1% +12.3% ➖ noise
91 datafusion:vortex-compact +5.6% +10.0% -4.0% +12.3% ➖ noise
91 datafusion:vortex-file-compressed +30.5% +10.0% +18.7% +23.7% ➖ noise
91 duckdb:duckdb +2.2% +10.0% -7.1% +16.2% ➖ noise
91 duckdb:vortex-compact +5.6% +10.0% -3.9% +16.7% ➖ noise
91 duckdb:vortex-file-compressed +17.3% +10.0% +6.6% +12.3% ➖ noise
92 datafusion:vortex-compact +6.8% +13.9% -6.3% +12.3% ➖ noise
92 datafusion:vortex-file-compressed +41.0% +13.9% +23.8% +16.1% 🚨 regression
92 duckdb:duckdb +5.8% +13.9% -7.2% +12.3% ➖ noise
92 duckdb:vortex-compact +4.5% +13.9% -8.3% +21.3% ➖ noise
92 duckdb:vortex-file-compressed +3.9% +13.9% -8.8% +14.0% ➖ noise
93 datafusion:vortex-compact +16.4% +19.9% -2.9% +15.1% ➖ noise
93 datafusion:vortex-file-compressed -3.6% +19.9% -19.6% +15.2% ✅ faster
93 duckdb:duckdb +12.6% +19.9% -6.1% +12.3% ➖ noise
93 duckdb:vortex-compact +13.1% +19.9% -5.7% +12.3% ➖ noise
93 duckdb:vortex-file-compressed +13.1% +19.9% -5.7% +12.3% ➖ noise
94 datafusion:vortex-compact +0.7% +12.4% -10.4% +13.1% ➖ noise
94 datafusion:vortex-file-compressed +14.8% +12.4% +2.1% +15.6% ➖ noise
94 duckdb:duckdb -0.6% +12.4% -11.6% +12.3% ✅ faster
94 duckdb:vortex-compact +7.5% +12.4% -4.3% +12.3% ➖ noise
94 duckdb:vortex-file-compressed +11.2% +12.4% -1.1% +12.3% ➖ noise
95 datafusion:vortex-compact +6.7% +17.8% -9.4% +12.3% ➖ noise
95 datafusion:vortex-file-compressed +2.4% +17.8% -13.1% +12.3% ✅ faster
95 duckdb:duckdb +12.9% +17.8% -4.2% +15.6% ➖ noise
95 duckdb:vortex-compact +13.5% +17.8% -3.7% +17.1% ➖ noise
95 duckdb:vortex-file-compressed -3.4% +17.8% -18.0% +12.6% ✅ faster
96 datafusion:vortex-compact +3.5% +9.9% -5.8% +12.3% ➖ noise
96 datafusion:vortex-file-compressed +8.7% +9.9% -1.1% +28.8% ➖ noise
96 duckdb:duckdb +4.1% +9.9% -5.2% +20.2% ➖ noise
96 duckdb:vortex-compact +13.8% +9.9% +3.6% +24.1% ➖ noise
96 duckdb:vortex-file-compressed +10.6% +9.9% +0.6% +14.8% ➖ noise
97 datafusion:vortex-compact +9.9% +15.5% -4.9% +12.3% ➖ noise
97 datafusion:vortex-file-compressed +3.7% +15.5% -10.2% +12.3% ➖ noise
97 duckdb:duckdb +3.0% +15.5% -10.8% +12.3% ➖ noise
97 duckdb:vortex-compact +15.3% +15.5% -0.2% +12.3% ➖ noise
97 duckdb:vortex-file-compressed +5.7% +15.5% -8.4% +12.3% ➖ noise
98 datafusion:vortex-compact +14.8% +13.2% +1.4% +22.8% ➖ noise
98 datafusion:vortex-file-compressed -0.7% +13.2% -12.2% +30.9% ➖ noise
98 duckdb:duckdb -0.9% +13.2% -12.4% +12.3% ✅ faster
98 duckdb:vortex-compact +15.4% +13.2% +1.9% +12.3% ➖ noise
98 duckdb:vortex-file-compressed +19.5% +13.2% +5.5% +25.1% ➖ noise
99 datafusion:vortex-compact -1.4% +11.5% -11.6% +18.8% ➖ noise
99 datafusion:vortex-file-compressed -9.8% +11.5% -19.2% +20.2% ✅ faster
99 duckdb:duckdb -0.1% +11.5% -10.4% +12.3% ➖ noise
99 duckdb:vortex-compact +15.4% +11.5% +3.4% +12.4% ➖ noise
99 duckdb:vortex-file-compressed +12.0% +11.5% +0.4% +30.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

File Size Changes (11 files changed, -0.5% overall, 0↑ 11↓)
File Scale Format Base HEAD Change %
catalog_sales.vortex 1.0 vortex-compact 59.31 MB 59.31 MB 40 B -0.0%
store_sales.vortex 1.0 vortex-file-compressed 97.04 MB 97.04 MB 4.68 KB -0.0%
promotion.vortex 1.0 vortex-file-compressed 60.19 KB 60.09 KB 104 B -0.2%
item.vortex 1.0 vortex-file-compressed 1.75 MB 1.74 MB 3.72 KB -0.2%
customer.vortex 1.0 vortex-file-compressed 4.52 MB 4.51 MB 11.40 KB -0.2%
customer_address.vortex 1.0 vortex-file-compressed 1012.96 KB 1007.23 KB 5.73 KB -0.6%
catalog_returns.vortex 1.0 vortex-file-compressed 7.43 MB 7.32 MB 115.12 KB -1.5%
catalog_sales.vortex 1.0 vortex-file-compressed 70.78 MB 69.63 MB 1.16 MB -1.6%
web_returns.vortex 1.0 vortex-file-compressed 3.55 MB 3.49 MB 60.14 KB -1.7%
web_sales.vortex 1.0 vortex-file-compressed 34.27 MB 33.70 MB 583.86 KB -1.7%
store_returns.vortex 1.0 vortex-file-compressed 11.39 MB 11.14 MB 247.97 KB -2.1%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (-0.0%)
  • vortex-file-compressed: 272.70 MB → 270.54 MB (-0.8%)

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label May 27, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 27, 2026
@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.9%
Vortex (geomean): 1.000x ➖
Parquet (geomean): 1.041x ➖
Shifts: Parquet (control) +4.1% · Median polish +0.8%


datafusion / vortex-file-compressed (1.019x ➖, 0↑ 1↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 56407174 38522319 1.46
fineweb_q01/datafusion:vortex-file-compressed 662018956 637075947 1.04
fineweb_q02/datafusion:vortex-file-compressed 591217812 694394614 0.85
fineweb_q03/datafusion:vortex-file-compressed 1397861681 1912223579 0.73
fineweb_q04/datafusion:vortex-file-compressed 1355053753 1505366015 0.90
fineweb_q05/datafusion:vortex-file-compressed 1418757605 1406304048 1.01
fineweb_q06/datafusion:vortex-file-compressed 1907166345 1687550972 1.13
fineweb_q07/datafusion:vortex-file-compressed 1615601036 1424007091 1.13
fineweb_q08/datafusion:vortex-file-compressed 665326350 617334810 1.08
datafusion / vortex-compact (1.031x ➖, 0↑ 1↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 67919692 44417811 1.53
fineweb_q01/datafusion:vortex-compact 673448693 648439509 1.04
fineweb_q02/datafusion:vortex-compact 688366452 635575845 1.08
fineweb_q03/datafusion:vortex-compact 1337318922 1362783484 0.98
fineweb_q04/datafusion:vortex-compact 1612381030 1606990217 1.00
fineweb_q05/datafusion:vortex-compact 1408122827 1384815896 1.02
fineweb_q06/datafusion:vortex-compact 1322817393 1422977446 0.93
fineweb_q07/datafusion:vortex-compact 1194782686 1179860416 1.01
fineweb_q08/datafusion:vortex-compact 374087530 460076337 0.81
datafusion / parquet (1.088x ➖, 0↑ 2↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 1429193390 1059504034 1.35
fineweb_q01/datafusion:parquet 2285403305 1764547183 1.30
fineweb_q02/datafusion:parquet 2199900961 2207347310 1.00
fineweb_q03/datafusion:parquet 2458618594 1913542127 1.28
fineweb_q04/datafusion:parquet 2084400842 1861689259 1.12
fineweb_q05/datafusion:parquet 2048854061 2301474796 0.89
fineweb_q06/datafusion:parquet 1904394139 2071555351 0.92
fineweb_q07/datafusion:parquet 1867120668 2368147652 0.79
fineweb_q08/datafusion:parquet 🚨 2985434990 2264353503 1.32
duckdb / vortex-file-compressed (0.947x ➖, 0↑ 0↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 80122195 111447207 0.72
fineweb_q01/duckdb:vortex-file-compressed 690434897 737995443 0.94
fineweb_q02/duckdb:vortex-file-compressed 561679793 532700841 1.05
fineweb_q03/duckdb:vortex-file-compressed 1738529209 1645967277 1.06
fineweb_q04/duckdb:vortex-file-compressed 1728102265 1772106659 0.98
fineweb_q05/duckdb:vortex-file-compressed 1784427907 1678804675 1.06
fineweb_q06/duckdb:vortex-file-compressed 1729664176 1839257766 0.94
fineweb_q07/duckdb:vortex-file-compressed 1654593523 1694570554 0.98
fineweb_q08/duckdb:vortex-file-compressed 671011276 777348752 0.86
duckdb / vortex-compact (1.006x ➖, 0↑ 0↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 93436689 86016009 1.09
fineweb_q01/duckdb:vortex-compact 582532860 598471835 0.97
fineweb_q02/duckdb:vortex-compact 686881355 625337101 1.10
fineweb_q03/duckdb:vortex-compact 1773109760 1780100897 1.00
fineweb_q04/duckdb:vortex-compact 1972172236 1940617223 1.02
fineweb_q05/duckdb:vortex-compact 1812880133 1696696312 1.07
fineweb_q06/duckdb:vortex-compact 1578775870 1632690016 0.97
fineweb_q07/duckdb:vortex-compact 1566087992 1523191672 1.03
fineweb_q08/duckdb:vortex-compact 548468060 649051570 0.85
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1209640119 1293608998 0.94
fineweb_q01/duckdb:parquet 1446953674 1475280470 0.98
fineweb_q02/duckdb:parquet 1503608494 1576510460 0.95
fineweb_q03/duckdb:parquet 4452530128 4080743829 1.09
fineweb_q04/duckdb:parquet 2019722000 2052816272 0.98
fineweb_q05/duckdb:parquet 2470056168 2249282196 1.10
fineweb_q06/duckdb:parquet 4569131239 4772896970 0.96
fineweb_q07/duckdb:parquet 2708368003 2877110506 0.94
fineweb_q08/duckdb:parquet 1302439280 1255746138 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +52.9% +12.3% +36.2% +155.2% ➖ noise
0 datafusion:vortex-file-compressed +46.4% +12.3% +30.4% +141.3% ➖ noise
0 duckdb:vortex-compact +8.6% +12.3% -3.3% +71.9% ➖ noise
0 duckdb:vortex-file-compressed -28.1% +12.3% -36.0% +113.7% ➖ noise
1 datafusion:vortex-compact +3.9% +12.7% -7.9% +109.7% ➖ noise
1 datafusion:vortex-file-compressed +3.9% +12.7% -7.8% +89.9% ➖ noise
1 duckdb:vortex-compact -2.7% +12.7% -13.6% +41.0% ➖ noise
1 duckdb:vortex-file-compressed -6.4% +12.7% -17.0% +64.1% ➖ noise
2 datafusion:vortex-compact +8.3% -2.5% +11.1% +47.7% ➖ noise
2 datafusion:vortex-file-compressed -14.9% -2.5% -12.7% +32.6% ➖ noise
2 duckdb:vortex-compact +9.8% -2.5% +12.7% +71.1% ➖ noise
2 duckdb:vortex-file-compressed +5.4% -2.5% +8.1% +36.0% ➖ noise
3 datafusion:vortex-compact -1.9% +18.4% -17.1% +82.3% ➖ noise
3 datafusion:vortex-file-compressed -26.9% +18.4% -38.3% +90.0% ➖ noise
3 duckdb:vortex-compact -0.4% +18.4% -15.9% +80.5% ➖ noise
3 duckdb:vortex-file-compressed +5.6% +18.4% -10.8% +81.6% ➖ noise
4 datafusion:vortex-compact +0.3% +5.0% -4.4% +32.6% ➖ noise
4 datafusion:vortex-file-compressed -10.0% +5.0% -14.2% +32.6% ➖ noise
4 duckdb:vortex-compact +1.6% +5.0% -3.2% +32.6% ➖ noise
4 duckdb:vortex-file-compressed -2.5% +5.0% -7.1% +32.6% ➖ noise
5 datafusion:vortex-compact +1.7% -1.1% +2.8% +32.6% ➖ noise
5 datafusion:vortex-file-compressed +0.9% -1.1% +2.0% +32.6% ➖ noise
5 duckdb:vortex-compact +6.8% -1.1% +8.1% +32.6% ➖ noise
5 duckdb:vortex-file-compressed +6.3% -1.1% +7.5% +32.6% ➖ noise
6 datafusion:vortex-compact -7.0% -6.2% -0.9% +32.6% ➖ noise
6 datafusion:vortex-file-compressed +13.0% -6.2% +20.5% +32.6% ➖ noise
6 duckdb:vortex-compact -3.3% -6.2% +3.1% +32.6% ➖ noise
6 duckdb:vortex-file-compressed -6.0% -6.2% +0.2% +32.6% ➖ noise
7 datafusion:vortex-compact +1.3% -13.8% +17.5% +32.6% ➖ noise
7 datafusion:vortex-file-compressed +13.5% -13.8% +31.7% +32.6% ➖ noise
7 duckdb:vortex-compact +2.8% -13.8% +19.3% +32.6% ➖ noise
7 duckdb:vortex-file-compressed -2.4% -13.8% +13.3% +32.6% ➖ noise
8 datafusion:vortex-compact -18.7% +16.9% -30.5% +32.6% ✅ faster
8 datafusion:vortex-file-compressed +7.8% +16.9% -7.8% +32.6% ➖ noise
8 duckdb:vortex-compact -15.5% +16.9% -27.7% +46.0% ➖ noise
8 duckdb:vortex-file-compressed -13.7% +16.9% -26.2% +38.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.949x ➖
Parquet (geomean): 0.967x ➖


unknown / unknown (0.963x ➖, 1↑ 0↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 377789 386799 0.98
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1041432 1093651 0.95
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8468406579 8698896955 0.97
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8308280449 8398299252 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7620934 8163803 0.93
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 7383261 7748724 0.95
random-access/feature-vectors/uniform/lance-tokio-local-disk 1184014 1208414 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1849997 1888499 0.98
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8305368828 8478370433 0.98
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8261656779 8506645729 0.97
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13264282 13945952 0.95
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 13086565 13867767 0.94
random-access/lance-tokio-local-disk 633053 656952 0.96
random-access/lance-tokio-local-disk-footer 1304433 1324538 0.98
random-access/nested-lists/correlated/lance-tokio-local-disk 234817 246275 0.95
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 583425 599005 0.97
random-access/nested-lists/correlated/parquet-tokio-local-disk 129760042 132580227 0.98
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 128283294 130951333 0.98
random-access/nested-lists/correlated/vortex-tokio-local-disk 594872 649137 0.92
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 584675 669740 0.87
random-access/nested-lists/uniform/lance-tokio-local-disk 1002696 1020446 0.98
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1356753 1397719 0.97
random-access/nested-lists/uniform/parquet-tokio-local-disk 128311900 133727042 0.96
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 127926282 129843986 0.99
random-access/nested-lists/uniform/vortex-tokio-local-disk 2118412 2164843 0.98
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2098136 2157853 0.97
random-access/nested-structs/correlated/lance-tokio-local-disk 367994 379537 0.97
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 553607 568235 0.97
random-access/nested-structs/correlated/parquet-tokio-local-disk 22826825 23869223 0.96
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 22850115 23724537 0.96
random-access/nested-structs/correlated/vortex-tokio-local-disk 735011 792573 0.93
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 733093 793228 0.92
random-access/nested-structs/uniform/lance-tokio-local-disk 2627793 2671962 0.98
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2770414 2812376 0.99
random-access/nested-structs/uniform/parquet-tokio-local-disk 22821416 24092778 0.95
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 22893971 24168675 0.95
random-access/nested-structs/uniform/vortex-tokio-local-disk 1658847 1712951 0.97
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1629239 1715752 0.95
random-access/parquet-tokio-local-disk 167389063 173748318 0.96
random-access/parquet-tokio-local-disk-footer 168594280 174849354 0.96
random-access/taxi/correlated/lance-tokio-local-disk 940931 966253 0.97
random-access/taxi/correlated/lance-tokio-local-disk-footer 1828384 1907681 0.96
random-access/taxi/correlated/parquet-tokio-local-disk 253149450 262474050 0.96
random-access/taxi/correlated/parquet-tokio-local-disk-footer 253867606 263549265 0.96
random-access/taxi/correlated/vortex-tokio-local-disk 1830263 1912733 0.96
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1804045 1938306 0.93
random-access/taxi/uniform/lance-tokio-local-disk 9107600 9377716 0.97
random-access/taxi/uniform/lance-tokio-local-disk-footer 9744784 10055983 0.97
random-access/taxi/uniform/parquet-tokio-local-disk 268467851 278851280 0.96
random-access/taxi/uniform/parquet-tokio-local-disk-footer 268272038 278064592 0.96
random-access/taxi/uniform/vortex-tokio-local-disk 4950372 4932561 1.00
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4865218 4903569 0.99
random-access/vortex-tokio-local-disk 1254073 1313324 0.95
random-access/vortex-tokio-local-disk-footer 1308260 1352498 0.97

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.9%
Vortex (geomean): 1.155x ❌
Parquet (geomean): 1.123x ❌
Shifts: Parquet (control) +12.3% · Median polish +12.7%


duckdb / vortex-file-compressed (1.166x ❌, 1↑ 6↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 🚨 13308152 11829101 1.13
statpopgen_q01/duckdb:vortex-file-compressed 🚨 29478025 26520781 1.11
statpopgen_q02/duckdb:vortex-file-compressed 🚀 483444813 541423180 0.89
statpopgen_q03/duckdb:vortex-file-compressed 1141177816 1060887979 1.08
statpopgen_q04/duckdb:vortex-file-compressed 🚨 1247543500 1079689482 1.16
statpopgen_q05/duckdb:vortex-file-compressed 517713405 487899567 1.06
statpopgen_q06/duckdb:vortex-file-compressed 1565955350 1527606530 1.03
statpopgen_q07/duckdb:vortex-file-compressed 🚨 365002758 201638556 1.81
statpopgen_q08/duckdb:vortex-file-compressed 🚨 385132960 237007448 1.62
statpopgen_q09/duckdb:vortex-file-compressed 890292307 837862159 1.06
statpopgen_q10/duckdb:vortex-file-compressed 🚨 2955907494 2580311506 1.15
duckdb / vortex-compact (1.144x ❌, 0↑ 10↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 🚨 13043802 11608005 1.12
statpopgen_q01/duckdb:vortex-compact 🚨 247133909 214117060 1.15
statpopgen_q02/duckdb:vortex-compact 🚨 633583136 554633101 1.14
statpopgen_q03/duckdb:vortex-compact 🚨 1305954977 1147818309 1.14
statpopgen_q04/duckdb:vortex-compact 🚨 1299304957 1153969138 1.13
statpopgen_q05/duckdb:vortex-compact 🚨 647847883 561162889 1.15
statpopgen_q06/duckdb:vortex-compact 🚨 1696884369 1506325926 1.13
statpopgen_q07/duckdb:vortex-compact 🚨 986164206 879827470 1.12
statpopgen_q08/duckdb:vortex-compact 995277449 915008263 1.09
statpopgen_q09/duckdb:vortex-compact 🚨 1118553147 910409853 1.23
statpopgen_q10/duckdb:vortex-compact 🚨 3118145970 2613016108 1.19
duckdb / parquet (1.123x ❌, 0↑ 8↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 320133568 304324375 1.05
statpopgen_q01/duckdb:parquet 411335940 380083990 1.08
statpopgen_q02/duckdb:parquet 🚨 852299629 761548468 1.12
statpopgen_q03/duckdb:parquet 🚨 1341652932 1190788195 1.13
statpopgen_q04/duckdb:parquet 🚨 1398651308 1180084712 1.19
statpopgen_q05/duckdb:parquet 🚨 953075511 804166985 1.19
statpopgen_q06/duckdb:parquet 🚨 1632065556 1433055552 1.14
statpopgen_q07/duckdb:parquet 926079718 867914281 1.07
statpopgen_q08/duckdb:parquet 🚨 952423106 855743730 1.11
statpopgen_q09/duckdb:parquet 🚨 1173304484 1017380222 1.15
statpopgen_q10/duckdb:parquet 🚨 2587099707 2275665676 1.14
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +12.4% +5.2% +6.8% +10.6% ➖ noise
0 duckdb:vortex-file-compressed +12.5% +5.2% +6.9% +17.2% ➖ noise
1 duckdb:vortex-compact +15.4% +8.2% +6.7% +13.1% ➖ noise
1 duckdb:vortex-file-compressed +11.2% +8.2% +2.7% +229.2% ➖ noise
2 duckdb:vortex-compact +14.2% +11.9% +2.1% +10.6% ➖ noise
2 duckdb:vortex-file-compressed -10.7% +11.9% -20.2% +10.6% ✅ faster
3 duckdb:vortex-compact +13.8% +12.7% +1.0% +10.6% ➖ noise
3 duckdb:vortex-file-compressed +7.6% +12.7% -4.5% +10.6% ➖ noise
4 duckdb:vortex-compact +12.6% +18.5% -5.0% +10.6% ➖ noise
4 duckdb:vortex-file-compressed +15.5% +18.5% -2.5% +10.6% ➖ noise
5 duckdb:vortex-compact +15.4% +18.5% -2.6% +10.6% ➖ noise
5 duckdb:vortex-file-compressed +6.1% +18.5% -10.5% +12.0% ➖ noise
6 duckdb:vortex-compact +12.7% +13.9% -1.1% +10.6% ➖ noise
6 duckdb:vortex-file-compressed +2.5% +13.9% -10.0% +10.6% ✅ faster
7 duckdb:vortex-compact +12.1% +6.7% +5.0% +10.6% ➖ noise
7 duckdb:vortex-file-compressed +81.0% +6.7% +69.6% +10.6% 🚨 regression
8 duckdb:vortex-compact +8.8% +11.3% -2.3% +10.6% ➖ noise
8 duckdb:vortex-file-compressed +62.5% +11.3% +46.0% +10.6% 🚨 regression
9 duckdb:vortex-compact +22.9% +15.3% +6.5% +10.6% ➖ noise
9 duckdb:vortex-file-compressed +6.3% +15.3% -7.9% +10.6% ➖ noise
10 duckdb:vortex-compact +19.3% +13.7% +5.0% +10.6% ➖ noise
10 duckdb:vortex-file-compressed +14.6% +13.7% +0.8% +10.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

File Size Changes (2 files changed, -6.0% overall, 1↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 959.35 MB 959.44 MB +86.88 KB +0.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.97 GB 1.79 GB 178.20 MB -8.9%

Totals:

  • vortex-compact: 959.62 MB → 959.70 MB (+0.0%)
  • vortex-file-compressed: 1.97 GB → 1.79 GB (-8.9%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.9%
Vortex (geomean): 1.116x ❌
Parquet (geomean): 1.077x ➖
Shifts: Parquet (control) +7.7% · Median polish +9.1%


datafusion / vortex-file-compressed (1.133x ❌, 0↑ 30↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1750657 1620822 1.08
clickbench_q01/datafusion:vortex-file-compressed 18330424 17988144 1.02
clickbench_q02/datafusion:vortex-file-compressed 40091035 37703848 1.06
clickbench_q03/datafusion:vortex-file-compressed 🚨 48066683 42201848 1.14
clickbench_q04/datafusion:vortex-file-compressed 🚨 328164232 279712451 1.17
clickbench_q05/datafusion:vortex-file-compressed 🚨 362200508 314467363 1.15
clickbench_q06/datafusion:vortex-file-compressed 1776410 1631536 1.09
clickbench_q07/datafusion:vortex-file-compressed 23619150 25095924 0.94
clickbench_q08/datafusion:vortex-file-compressed 🚨 414745085 350037596 1.18
clickbench_q09/datafusion:vortex-file-compressed 🚨 636274022 556530469 1.14
clickbench_q10/datafusion:vortex-file-compressed 🚨 88321900 75064799 1.18
clickbench_q11/datafusion:vortex-file-compressed 🚨 95795656 84297610 1.14
clickbench_q12/datafusion:vortex-file-compressed 🚨 320819768 268839138 1.19
clickbench_q13/datafusion:vortex-file-compressed 🚨 506620974 417480379 1.21
clickbench_q14/datafusion:vortex-file-compressed 🚨 298116725 245898313 1.21
clickbench_q15/datafusion:vortex-file-compressed 🚨 379641211 330922817 1.15
clickbench_q16/datafusion:vortex-file-compressed 🚨 774428435 654746642 1.18
clickbench_q17/datafusion:vortex-file-compressed 🚨 754200937 637483280 1.18
clickbench_q18/datafusion:vortex-file-compressed 🚨 1618072612 1314037111 1.23
clickbench_q19/datafusion:vortex-file-compressed 🚨 35648890 29858679 1.19
clickbench_q20/datafusion:vortex-file-compressed 378740632 354227668 1.07
clickbench_q21/datafusion:vortex-file-compressed 414481099 384827741 1.08
clickbench_q22/datafusion:vortex-file-compressed 🚨 524234440 457960667 1.14
clickbench_q23/datafusion:vortex-file-compressed 🚨 724183833 625383767 1.16
clickbench_q24/datafusion:vortex-file-compressed 52346429 49081613 1.07
clickbench_q25/datafusion:vortex-file-compressed 84453732 77936624 1.08
clickbench_q26/datafusion:vortex-file-compressed 🚨 52898890 45762921 1.16
clickbench_q27/datafusion:vortex-file-compressed 812214157 771786789 1.05
clickbench_q28/datafusion:vortex-file-compressed 6915532310 6761681231 1.02
clickbench_q29/datafusion:vortex-file-compressed 249240986 243308125 1.02
clickbench_q30/datafusion:vortex-file-compressed 🚨 272217604 222725460 1.22
clickbench_q31/datafusion:vortex-file-compressed 🚨 307930459 262442738 1.17
clickbench_q32/datafusion:vortex-file-compressed 🚨 1356424287 1096531682 1.24
clickbench_q33/datafusion:vortex-file-compressed 🚨 1541986053 1343388958 1.15
clickbench_q34/datafusion:vortex-file-compressed 🚨 1534023196 1337652437 1.15
clickbench_q35/datafusion:vortex-file-compressed 🚨 530374069 480775833 1.10
clickbench_q36/datafusion:vortex-file-compressed 🚨 83021915 69758005 1.19
clickbench_q37/datafusion:vortex-file-compressed 🚨 44555339 34778580 1.28
clickbench_q38/datafusion:vortex-file-compressed 🚨 20952792 18365745 1.14
clickbench_q39/datafusion:vortex-file-compressed 🚨 155243102 139200905 1.12
clickbench_q40/datafusion:vortex-file-compressed 🚨 17858423 16041991 1.11
clickbench_q41/datafusion:vortex-file-compressed 🚨 16842767 14286189 1.18
clickbench_q42/datafusion:vortex-file-compressed 17931222 17167178 1.04
datafusion / parquet (1.101x ❌, 1↑ 26↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚀 1932245 2469003 0.78
clickbench_q01/datafusion:parquet 20121449 19215942 1.05
clickbench_q02/datafusion:parquet 49107101 47272114 1.04
clickbench_q03/datafusion:parquet 40138721 37974341 1.06
clickbench_q04/datafusion:parquet 🚨 350043679 307131800 1.14
clickbench_q05/datafusion:parquet 🚨 384047447 344901257 1.11
clickbench_q06/datafusion:parquet 🚨 1722640 1554695 1.11
clickbench_q07/datafusion:parquet 🚨 24747840 21818249 1.13
clickbench_q08/datafusion:parquet 415756913 381802016 1.09
clickbench_q09/datafusion:parquet 🚨 698840662 613316578 1.14
clickbench_q10/datafusion:parquet 🚨 122375060 108245624 1.13
clickbench_q11/datafusion:parquet 141042157 128761696 1.10
clickbench_q12/datafusion:parquet 🚨 386013129 345655817 1.12
clickbench_q13/datafusion:parquet 544423927 510204178 1.07
clickbench_q14/datafusion:parquet 376078630 346618218 1.08
clickbench_q15/datafusion:parquet 🚨 381699148 342565331 1.11
clickbench_q16/datafusion:parquet 🚨 748971228 678859825 1.10
clickbench_q17/datafusion:parquet 🚨 753178689 637719325 1.18
clickbench_q18/datafusion:parquet 1543157464 1445732368 1.07
clickbench_q19/datafusion:parquet 🚨 33149622 29935340 1.11
clickbench_q20/datafusion:parquet 🚨 680546454 593162485 1.15
clickbench_q21/datafusion:parquet 🚨 716432067 647961190 1.11
clickbench_q22/datafusion:parquet 🚨 1062031228 964481406 1.10
clickbench_q23/datafusion:parquet 🚨 4141779221 3630363096 1.14
clickbench_q24/datafusion:parquet 87817694 85263228 1.03
clickbench_q25/datafusion:parquet 142846678 130118446 1.10
clickbench_q26/datafusion:parquet 🚨 87246443 79299030 1.10
clickbench_q27/datafusion:parquet 1132418822 1060311109 1.07
clickbench_q28/datafusion:parquet 6849307965 6547886557 1.05
clickbench_q29/datafusion:parquet 254717264 234844515 1.08
clickbench_q30/datafusion:parquet 🚨 370486939 329397977 1.12
clickbench_q31/datafusion:parquet 🚨 409144982 361644806 1.13
clickbench_q32/datafusion:parquet 🚨 1411217260 1171792760 1.20
clickbench_q33/datafusion:parquet 🚨 1706090980 1483455848 1.15
clickbench_q34/datafusion:parquet 🚨 1680080144 1488345937 1.13
clickbench_q35/datafusion:parquet 🚨 531387173 460409571 1.15
clickbench_q36/datafusion:parquet 🚨 167992401 142817538 1.18
clickbench_q37/datafusion:parquet 🚨 64453059 55737556 1.16
clickbench_q38/datafusion:parquet 94451515 86671045 1.09
clickbench_q39/datafusion:parquet 291749990 265655326 1.10
clickbench_q40/datafusion:parquet 33840854 31124756 1.09
clickbench_q41/datafusion:parquet 🚨 29748599 26409490 1.13
clickbench_q42/datafusion:parquet 🚨 35771920 30419739 1.18
duckdb / vortex-file-compressed (1.099x ➖, 1↑ 25↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6868250 7212555 0.95
clickbench_q01/duckdb:vortex-file-compressed 🚨 12280112 11026844 1.11
clickbench_q02/duckdb:vortex-file-compressed 🚨 29124140 25538171 1.14
clickbench_q03/duckdb:vortex-file-compressed 32153668 31731317 1.01
clickbench_q04/duckdb:vortex-file-compressed 197575263 186846779 1.06
clickbench_q05/duckdb:vortex-file-compressed 🚨 203030020 175783923 1.15
clickbench_q06/duckdb:vortex-file-compressed 21801520 20215499 1.08
clickbench_q07/duckdb:vortex-file-compressed 15850743 16061053 0.99
clickbench_q08/duckdb:vortex-file-compressed 272337603 259627063 1.05
clickbench_q09/duckdb:vortex-file-compressed 367123821 336451804 1.09
clickbench_q10/duckdb:vortex-file-compressed 🚨 75245360 67710562 1.11
clickbench_q11/duckdb:vortex-file-compressed 85152342 77665581 1.10
clickbench_q12/duckdb:vortex-file-compressed 🚨 222644640 192772371 1.15
clickbench_q13/duckdb:vortex-file-compressed 🚨 448960253 400678347 1.12
clickbench_q14/duckdb:vortex-file-compressed 🚨 262599308 228461051 1.15
clickbench_q15/duckdb:vortex-file-compressed 257548584 241973410 1.06
clickbench_q16/duckdb:vortex-file-compressed 🚨 592039583 514443234 1.15
clickbench_q17/duckdb:vortex-file-compressed 452671791 420405762 1.08
clickbench_q18/duckdb:vortex-file-compressed 1022693935 941650271 1.09
clickbench_q19/duckdb:vortex-file-compressed 🚨 23769789 20816120 1.14
clickbench_q20/duckdb:vortex-file-compressed 342400125 330288046 1.04
clickbench_q21/duckdb:vortex-file-compressed 🚨 417707203 365859921 1.14
clickbench_q22/duckdb:vortex-file-compressed 🚀 567404358 650313214 0.87
clickbench_q23/duckdb:vortex-file-compressed 🚨 199789917 165301374 1.21
clickbench_q24/duckdb:vortex-file-compressed 🚨 39901908 35525964 1.12
clickbench_q25/duckdb:vortex-file-compressed 🚨 78490187 68887926 1.14
clickbench_q26/duckdb:vortex-file-compressed 🚨 48958983 42378207 1.16
clickbench_q27/duckdb:vortex-file-compressed 527279835 482220525 1.09
clickbench_q28/duckdb:vortex-file-compressed 3146522859 3069180521 1.03
clickbench_q29/duckdb:vortex-file-compressed 🚨 30825670 27532654 1.12
clickbench_q30/duckdb:vortex-file-compressed 🚨 209046534 189654333 1.10
clickbench_q31/duckdb:vortex-file-compressed 🚨 315868678 281790197 1.12
clickbench_q32/duckdb:vortex-file-compressed 1206247150 1120139322 1.08
clickbench_q33/duckdb:vortex-file-compressed 🚨 1211920740 1080319052 1.12
clickbench_q34/duckdb:vortex-file-compressed 🚨 1298517386 1171455416 1.11
clickbench_q35/duckdb:vortex-file-compressed 394873016 375164697 1.05
clickbench_q36/duckdb:vortex-file-compressed 🚨 29090112 25690556 1.13
clickbench_q37/duckdb:vortex-file-compressed 🚨 21468120 17747678 1.21
clickbench_q38/duckdb:vortex-file-compressed 🚨 21817988 18927235 1.15
clickbench_q39/duckdb:vortex-file-compressed 🚨 44720049 39877582 1.12
clickbench_q40/duckdb:vortex-file-compressed 🚨 22306325 17872266 1.25
clickbench_q41/duckdb:vortex-file-compressed 19387703 17861809 1.09
clickbench_q42/duckdb:vortex-file-compressed 🚨 22067305 19867176 1.11
duckdb / parquet (1.054x ➖, 0↑ 4↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 24861010 23770494 1.05
clickbench_q01/duckdb:parquet 29652969 29654923 1.00
clickbench_q02/duckdb:parquet 50798953 51557231 0.99
clickbench_q03/duckdb:parquet 40934225 39829309 1.03
clickbench_q04/duckdb:parquet 215880979 203587234 1.06
clickbench_q05/duckdb:parquet 270232042 254917720 1.06
clickbench_q06/duckdb:parquet 47495108 47034914 1.01
clickbench_q07/duckdb:parquet 32136593 31481786 1.02
clickbench_q08/duckdb:parquet 287050702 269932003 1.06
clickbench_q09/duckdb:parquet 420221304 399320240 1.05
clickbench_q10/duckdb:parquet 87716405 81753510 1.07
clickbench_q11/duckdb:parquet 104694416 99121534 1.06
clickbench_q12/duckdb:parquet 294692351 278336504 1.06
clickbench_q13/duckdb:parquet 502373739 460813046 1.09
clickbench_q14/duckdb:parquet 329899940 310891650 1.06
clickbench_q15/duckdb:parquet 274575723 254616874 1.08
clickbench_q16/duckdb:parquet 645584361 599648479 1.08
clickbench_q17/duckdb:parquet 537690943 495002805 1.09
clickbench_q18/duckdb:parquet 1118481174 1032487936 1.08
clickbench_q19/duckdb:parquet 28856657 27975614 1.03
clickbench_q20/duckdb:parquet 435665805 417135571 1.04
clickbench_q21/duckdb:parquet 561566184 532223098 1.06
clickbench_q22/duckdb:parquet 948354562 917127341 1.03
clickbench_q23/duckdb:parquet 268626281 258234598 1.04
clickbench_q24/duckdb:parquet 72948296 71481531 1.02
clickbench_q25/duckdb:parquet 166258298 163508417 1.02
clickbench_q26/duckdb:parquet 55965075 56127301 1.00
clickbench_q27/duckdb:parquet 666308442 644153605 1.03
clickbench_q28/duckdb:parquet 5001423669 4872027889 1.03
clickbench_q29/duckdb:parquet 43917816 41727937 1.05
clickbench_q30/duckdb:parquet 322505709 312305832 1.03
clickbench_q31/duckdb:parquet 397488329 371686354 1.07
clickbench_q32/duckdb:parquet 1191316191 1105191375 1.08
clickbench_q33/duckdb:parquet 1200858274 1098193675 1.09
clickbench_q34/duckdb:parquet 🚨 1254349638 1138952041 1.10
clickbench_q35/duckdb:parquet 384818829 369577015 1.04
clickbench_q36/duckdb:parquet 🚨 51035502 45049337 1.13
clickbench_q37/duckdb:parquet 35526710 33477820 1.06
clickbench_q38/duckdb:parquet 36499540 36002001 1.01
clickbench_q39/duckdb:parquet 🚨 93501694 75633369 1.24
clickbench_q40/duckdb:parquet 20605716 20513524 1.00
clickbench_q41/duckdb:parquet 🚨 22093208 20072970 1.10
clickbench_q42/duckdb:parquet 23200052 22428967 1.03
duckdb / duckdb (1.063x ➖, 1↑ 7↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚨 19203618 16991726 1.13
clickbench_q01/duckdb:duckdb 36625829 33772256 1.08
clickbench_q02/duckdb:duckdb 53460800 50288071 1.06
clickbench_q03/duckdb:duckdb 58316858 55068320 1.06
clickbench_q04/duckdb:duckdb 217774083 208997814 1.04
clickbench_q05/duckdb:duckdb 297618210 281716924 1.06
clickbench_q06/duckdb:duckdb 🚨 36632854 33229469 1.10
clickbench_q07/duckdb:duckdb 37505887 34787950 1.08
clickbench_q08/duckdb:duckdb 290986770 273723042 1.06
clickbench_q09/duckdb:duckdb 410729411 399221628 1.03
clickbench_q10/duckdb:duckdb 124354107 115629607 1.08
clickbench_q11/duckdb:duckdb 131658411 126318073 1.04
clickbench_q12/duckdb:duckdb 276635171 255948536 1.08
clickbench_q13/duckdb:duckdb 469083889 438184007 1.07
clickbench_q14/duckdb:duckdb 305220317 285137154 1.07
clickbench_q15/duckdb:duckdb 258009113 238424286 1.08
clickbench_q16/duckdb:duckdb 598461146 556148215 1.08
clickbench_q17/duckdb:duckdb 509051103 468979654 1.09
clickbench_q18/duckdb:duckdb 🚨 1101582289 985011880 1.12
clickbench_q19/duckdb:duckdb 36803042 34516419 1.07
clickbench_q20/duckdb:duckdb 487158854 490524877 0.99
clickbench_q21/duckdb:duckdb 491240957 503637175 0.98
clickbench_q22/duckdb:duckdb 576862793 531125237 1.09
clickbench_q23/duckdb:duckdb 260485872 247140545 1.05
clickbench_q24/duckdb:duckdb 64914880 61048855 1.06
clickbench_q25/duckdb:duckdb 154803958 148955799 1.04
clickbench_q26/duckdb:duckdb 65679077 61354442 1.07
clickbench_q27/duckdb:duckdb 567613072 563272514 1.01
clickbench_q28/duckdb:duckdb 4630087397 4502956936 1.03
clickbench_q29/duckdb:duckdb 53976794 50084970 1.08
clickbench_q30/duckdb:duckdb 294148817 273097322 1.08
clickbench_q31/duckdb:duckdb 🚨 394355673 357789711 1.10
clickbench_q32/duckdb:duckdb 1192250947 1093049484 1.09
clickbench_q33/duckdb:duckdb 🚨 1232585119 1115455241 1.11
clickbench_q34/duckdb:duckdb 1307050692 1190104120 1.10
clickbench_q35/duckdb:duckdb 311231937 296562999 1.05
clickbench_q36/duckdb:duckdb 52175289 48217820 1.08
clickbench_q37/duckdb:duckdb 🚀 30499889 34920559 0.87
clickbench_q38/duckdb:duckdb 35623405 32482621 1.10
clickbench_q39/duckdb:duckdb 83972027 82984681 1.01
clickbench_q40/duckdb:duckdb 🚨 30667282 27529546 1.11
clickbench_q41/duckdb:duckdb 🚨 29695377 26990965 1.10
clickbench_q42/duckdb:duckdb 31679704 29030245 1.09
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +8.0% -9.5% +19.4% +778.4% ➖ noise
0 duckdb:duckdb +13.0% -9.5% +24.9% +283.8% ➖ noise
0 duckdb:vortex-file-compressed -4.8% -9.5% +5.3% +473.3% ➖ noise
1 datafusion:vortex-file-compressed +1.9% +2.3% -0.4% +24.8% ➖ noise
1 duckdb:duckdb +8.4% +2.3% +6.0% +54.4% ➖ noise
1 duckdb:vortex-file-compressed +11.4% +2.3% +8.8% +23.8% ➖ noise
2 datafusion:vortex-file-compressed +6.3% +1.2% +5.1% +16.9% ➖ noise
2 duckdb:duckdb +6.3% +1.2% +5.1% +30.8% ➖ noise
2 duckdb:vortex-file-compressed +14.0% +1.2% +12.7% +14.4% ➖ noise
3 datafusion:vortex-file-compressed +13.9% +4.2% +9.3% +139.1% ➖ noise
3 duckdb:duckdb +5.9% +4.2% +1.6% +56.9% ➖ noise
3 duckdb:vortex-file-compressed +1.3% +4.2% -2.8% +94.3% ➖ noise
4 datafusion:vortex-file-compressed +17.3% +9.9% +6.7% +11.1% ➖ noise
4 duckdb:duckdb +4.2% +9.9% -5.2% +11.1% ➖ noise
4 duckdb:vortex-file-compressed +5.7% +9.9% -3.8% +11.1% ➖ noise
5 datafusion:vortex-file-compressed +15.2% +8.6% +6.0% +11.1% ➖ noise
5 duckdb:duckdb +5.6% +8.6% -2.8% +11.1% ➖ noise
5 duckdb:vortex-file-compressed +15.5% +8.6% +6.3% +11.1% ➖ noise
6 datafusion:vortex-file-compressed +8.9% +5.8% +2.9% +42.2% ➖ noise
6 duckdb:duckdb +10.2% +5.8% +4.2% +13.7% ➖ noise
6 duckdb:vortex-file-compressed +7.8% +5.8% +2.0% +14.9% ➖ noise
7 datafusion:vortex-file-compressed -5.9% +7.6% -12.5% +27.2% ➖ noise
7 duckdb:duckdb +7.8% +7.6% +0.2% +11.1% ➖ noise
7 duckdb:vortex-file-compressed -1.3% +7.6% -8.3% +11.1% ➖ noise
8 datafusion:vortex-file-compressed +18.5% +7.6% +10.1% +11.1% ➖ noise
8 duckdb:duckdb +6.3% +7.6% -1.2% +11.1% ➖ noise
8 duckdb:vortex-file-compressed +4.9% +7.6% -2.5% +11.1% ➖ noise
9 datafusion:vortex-file-compressed +14.3% +9.5% +4.4% +11.1% ➖ noise
9 duckdb:duckdb +2.9% +9.5% -6.0% +11.1% ➖ noise
9 duckdb:vortex-file-compressed +9.1% +9.5% -0.4% +11.1% ➖ noise
10 datafusion:vortex-file-compressed +17.7% +10.1% +6.8% +11.1% ➖ noise
10 duckdb:duckdb +7.5% +10.1% -2.4% +11.1% ➖ noise
10 duckdb:vortex-file-compressed +11.1% +10.1% +0.9% +11.1% ➖ noise
11 datafusion:vortex-file-compressed +13.6% +7.6% +5.7% +11.8% ➖ noise
11 duckdb:duckdb +4.2% +7.6% -3.1% +11.1% ➖ noise
11 duckdb:vortex-file-compressed +9.6% +7.6% +1.9% +11.1% ➖ noise
12 datafusion:vortex-file-compressed +19.3% +8.7% +9.7% +11.1% ➖ noise
12 duckdb:duckdb +8.1% +8.7% -0.6% +11.1% ➖ noise
12 duckdb:vortex-file-compressed +15.5% +8.7% +6.2% +11.9% ➖ noise
13 datafusion:vortex-file-compressed +21.4% +7.9% +12.5% +11.1% 🚨 regression
13 duckdb:duckdb +7.1% +7.9% -0.7% +11.1% ➖ noise
13 duckdb:vortex-file-compressed +12.1% +7.9% +3.9% +11.1% ➖ noise
14 datafusion:vortex-file-compressed +21.2% +7.3% +13.0% +11.1% 🚨 regression
14 duckdb:duckdb +7.0% +7.3% -0.2% +11.1% ➖ noise
14 duckdb:vortex-file-compressed +14.9% +7.3% +7.1% +11.1% ➖ noise
15 datafusion:vortex-file-compressed +14.7% +9.6% +4.7% +11.1% ➖ noise
15 duckdb:duckdb +8.2% +9.6% -1.3% +11.1% ➖ noise
15 duckdb:vortex-file-compressed +6.4% +9.6% -2.9% +11.1% ➖ noise
16 datafusion:vortex-file-compressed +18.3% +9.0% +8.5% +11.1% ➖ noise
16 duckdb:duckdb +7.6% +9.0% -1.3% +11.1% ➖ noise
16 duckdb:vortex-file-compressed +15.1% +9.0% +5.6% +11.1% ➖ noise
17 datafusion:vortex-file-compressed +18.3% +13.3% +4.5% +11.1% ➖ noise
17 duckdb:duckdb +8.5% +13.3% -4.2% +11.1% ➖ noise
17 duckdb:vortex-file-compressed +7.7% +13.3% -4.9% +11.1% ➖ noise
18 datafusion:vortex-file-compressed +23.1% +7.5% +14.5% +11.1% 🚨 regression
18 duckdb:duckdb +11.8% +7.5% +4.0% +11.1% ➖ noise
18 duckdb:vortex-file-compressed +8.6% +7.5% +1.0% +11.1% ➖ noise
19 datafusion:vortex-file-compressed +19.4% +6.9% +11.7% +26.9% ➖ noise
19 duckdb:duckdb +6.6% +6.9% -0.2% +16.3% ➖ noise
19 duckdb:vortex-file-compressed +14.2% +6.9% +6.8% +23.8% ➖ noise
20 datafusion:vortex-file-compressed +6.9% +9.5% -2.3% +195.2% ➖ noise
20 duckdb:duckdb -0.7% +9.5% -9.3% +87.4% ➖ noise
20 duckdb:vortex-file-compressed +3.7% +9.5% -5.3% +71.8% ➖ noise
21 datafusion:vortex-file-compressed +7.7% +8.0% -0.3% +11.1% ➖ noise
21 duckdb:duckdb -2.5% +8.0% -9.7% +11.1% ➖ noise
21 duckdb:vortex-file-compressed +14.2% +8.0% +5.7% +11.1% ➖ noise
22 datafusion:vortex-file-compressed +14.5% +6.7% +7.3% +12.5% ➖ noise
22 duckdb:duckdb +8.6% +6.7% +1.8% +43.8% ➖ noise
22 duckdb:vortex-file-compressed -12.7% +6.7% -18.2% +11.1% ✅ faster
23 datafusion:vortex-file-compressed +15.8% +8.9% +6.3% +44.5% ➖ noise
23 duckdb:duckdb +5.4% +8.9% -3.2% +11.1% ➖ noise
23 duckdb:vortex-file-compressed +20.9% +8.9% +10.9% +19.8% ➖ noise
24 datafusion:vortex-file-compressed +6.7% +2.5% +4.0% +18.1% ➖ noise
24 duckdb:duckdb +6.3% +2.5% +3.7% +39.3% ➖ noise
24 duckdb:vortex-file-compressed +12.3% +2.5% +9.6% +19.4% ➖ noise
25 datafusion:vortex-file-compressed +8.4% +5.7% +2.6% +11.1% ➖ noise
25 duckdb:duckdb +3.9% +5.7% -1.6% +11.1% ➖ noise
25 duckdb:vortex-file-compressed +13.9% +5.7% +7.8% +11.9% ➖ noise
26 datafusion:vortex-file-compressed +15.6% +4.7% +10.4% +12.9% ➖ noise
26 duckdb:duckdb +7.0% +4.7% +2.2% +11.1% ➖ noise
26 duckdb:vortex-file-compressed +15.5% +4.7% +10.3% +18.3% ➖ noise
27 datafusion:vortex-file-compressed +5.2% +5.1% +0.1% +11.1% ➖ noise
27 duckdb:duckdb +0.8% +5.1% -4.1% +11.1% ➖ noise
27 duckdb:vortex-file-compressed +9.3% +5.1% +4.0% +11.1% ➖ noise
28 datafusion:vortex-file-compressed +2.3% +3.6% -1.3% +11.1% ➖ noise
28 duckdb:duckdb +2.8% +3.6% -0.8% +11.1% ➖ noise
28 duckdb:vortex-file-compressed +2.5% +3.6% -1.1% +14.9% ➖ noise
29 datafusion:vortex-file-compressed +2.4% +6.8% -4.1% +13.3% ➖ noise
29 duckdb:duckdb +7.8% +6.8% +0.9% +11.1% ➖ noise
29 duckdb:vortex-file-compressed +12.0% +6.8% +4.8% +31.8% ➖ noise
30 datafusion:vortex-file-compressed +22.2% +7.8% +13.4% +11.1% 🚨 regression
30 duckdb:duckdb +7.7% +7.8% -0.1% +11.1% ➖ noise
30 duckdb:vortex-file-compressed +10.2% +7.8% +2.3% +11.1% ➖ noise
31 datafusion:vortex-file-compressed +17.3% +10.0% +6.7% +11.1% ➖ noise
31 duckdb:duckdb +10.2% +10.0% +0.2% +11.1% ➖ noise
31 duckdb:vortex-file-compressed +12.1% +10.0% +1.9% +11.1% ➖ noise
32 datafusion:vortex-file-compressed +23.7% +13.9% +8.6% +11.1% ➖ noise
32 duckdb:duckdb +9.1% +13.9% -4.3% +11.1% ➖ noise
32 duckdb:vortex-file-compressed +7.7% +13.9% -5.5% +11.1% ➖ noise
33 datafusion:vortex-file-compressed +14.8% +12.1% +2.4% +11.1% ➖ noise
33 duckdb:duckdb +10.5% +12.1% -1.5% +11.1% ➖ noise
33 duckdb:vortex-file-compressed +12.2% +12.1% +0.0% +17.3% ➖ noise
34 datafusion:vortex-file-compressed +14.7% +11.5% +2.9% +11.1% ➖ noise
34 duckdb:duckdb +9.8% +11.5% -1.5% +11.1% ➖ noise
34 duckdb:vortex-file-compressed +10.8% +11.5% -0.6% +11.1% ➖ noise
35 datafusion:vortex-file-compressed +10.3% +9.6% +0.6% +11.1% ➖ noise
35 duckdb:duckdb +4.9% +9.6% -4.3% +11.1% ➖ noise
35 duckdb:vortex-file-compressed +5.3% +9.6% -4.0% +11.1% ➖ noise
36 datafusion:vortex-file-compressed +19.0% +15.4% +3.1% +11.4% ➖ noise
36 duckdb:duckdb +8.2% +15.4% -6.3% +19.3% ➖ noise
36 duckdb:vortex-file-compressed +13.2% +15.4% -1.9% +11.1% ➖ noise
37 datafusion:vortex-file-compressed +28.1% +10.8% +15.6% +16.7% ➖ noise
37 duckdb:duckdb -12.7% +10.8% -21.2% +11.1% ✅ faster
37 duckdb:vortex-file-compressed +21.0% +10.8% +9.2% +19.5% ➖ noise
38 datafusion:vortex-file-compressed +14.1% +5.1% +8.5% +11.1% ➖ noise
38 duckdb:duckdb +9.7% +5.1% +4.3% +11.1% ➖ noise
38 duckdb:vortex-file-compressed +15.3% +5.1% +9.7% +12.0% ➖ noise
39 datafusion:vortex-file-compressed +11.5% +16.5% -4.3% +11.9% ➖ noise
39 duckdb:duckdb +1.2% +16.5% -13.2% +14.3% ✅ faster
39 duckdb:vortex-file-compressed +12.1% +16.5% -3.8% +11.1% ➖ noise
40 datafusion:vortex-file-compressed +11.3% +4.5% +6.5% +11.1% ➖ noise
40 duckdb:duckdb +11.4% +4.5% +6.6% +11.1% ➖ noise
40 duckdb:vortex-file-compressed +24.8% +4.5% +19.4% +15.3% 🚨 regression
41 datafusion:vortex-file-compressed +17.9% +11.3% +5.9% +11.1% ➖ noise
41 duckdb:duckdb +10.0% +11.3% -1.2% +11.1% ➖ noise
41 duckdb:vortex-file-compressed +8.5% +11.3% -2.5% +11.1% ➖ noise
42 datafusion:vortex-file-compressed +4.5% +10.3% -5.3% +12.0% ➖ noise
42 duckdb:duckdb +9.1% +10.3% -1.1% +11.1% ➖ noise
42 duckdb:vortex-file-compressed +11.1% +10.3% +0.7% +14.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (184 files changed, -0.5% overall, 40↑ 144↓)
File Scale Format Base HEAD Change %
hits_16.vortex 1.0 vortex-compact 48.30 MB 48.35 MB +50.33 KB +0.1%
hits_33.vortex 1.0 vortex-compact 35.95 MB 35.97 MB +27.05 KB +0.1%
hits_66.vortex 1.0 vortex-compact 53.49 MB 53.53 MB +38.77 KB +0.1%
hits_77.vortex 1.0 vortex-compact 118.11 MB 118.17 MB +61.56 KB +0.1%
hits_72.vortex 1.0 vortex-compact 51.79 MB 51.81 MB +25.11 KB +0.0%
hits_88.vortex 1.0 vortex-compact 73.31 MB 73.35 MB +35.17 KB +0.0%
hits_61.vortex 1.0 vortex-compact 57.66 MB 57.69 MB +24.13 KB +0.0%
hits_56.vortex 1.0 vortex-compact 77.87 MB 77.90 MB +26.34 KB +0.0%
hits_93.vortex 1.0 vortex-compact 58.90 MB 58.92 MB +16.41 KB +0.0%
hits_18.vortex 1.0 vortex-compact 64.28 MB 64.30 MB +15.91 KB +0.0%
hits_15.vortex 1.0 vortex-compact 48.14 MB 48.15 MB +10.24 KB +0.0%
hits_23.vortex 1.0 vortex-compact 44.17 MB 44.18 MB +7.70 KB +0.0%
hits_37.vortex 1.0 vortex-compact 53.83 MB 53.84 MB +7.79 KB +0.0%
hits_12.vortex 1.0 vortex-compact 69.27 MB 69.28 MB +9.11 KB +0.0%
hits_69.vortex 1.0 vortex-compact 81.02 MB 81.03 MB +6.95 KB +0.0%
hits_70.vortex 1.0 vortex-compact 61.29 MB 61.29 MB +5.18 KB +0.0%
hits_25.vortex 1.0 vortex-compact 73.14 MB 73.14 MB +5.82 KB +0.0%
hits_36.vortex 1.0 vortex-compact 48.99 MB 49.00 MB +3.70 KB +0.0%
hits_73.vortex 1.0 vortex-compact 70.04 MB 70.04 MB +4.20 KB +0.0%
hits_29.vortex 1.0 vortex-compact 36.61 MB 36.61 MB +1.58 KB +0.0%
hits_81.vortex 1.0 vortex-compact 65.45 MB 65.45 MB +2.82 KB +0.0%
hits_28.vortex 1.0 vortex-compact 70.27 MB 70.28 MB +2.71 KB +0.0%
hits_27.vortex 1.0 vortex-compact 69.88 MB 69.89 MB +2.10 KB +0.0%
hits_24.vortex 1.0 vortex-compact 43.63 MB 43.63 MB +1.20 KB +0.0%
hits_17.vortex 1.0 vortex-compact 58.32 MB 58.32 MB +1.52 KB +0.0%
hits_63.vortex 1.0 vortex-compact 46.10 MB 46.10 MB +1.05 KB +0.0%
hits_62.vortex 1.0 vortex-compact 74.26 MB 74.26 MB +1000 B +0.0%
hits_26.vortex 1.0 vortex-compact 70.89 MB 70.89 MB +928 B +0.0%
hits_43.vortex 1.0 vortex-compact 168.91 MB 168.91 MB +1.79 KB +0.0%
hits_38.vortex 1.0 vortex-compact 63.10 MB 63.10 MB +640 B +0.0%
hits_11.vortex 1.0 vortex-compact 54.35 MB 54.35 MB +496 B +0.0%
hits_74.vortex 1.0 vortex-compact 71.62 MB 71.62 MB +640 B +0.0%
hits_2.vortex 1.0 vortex-compact 129.36 MB 129.36 MB +1.01 KB +0.0%
hits_4.vortex 1.0 vortex-compact 71.81 MB 71.81 MB +424 B +0.0%
hits_14.vortex 1.0 vortex-compact 73.75 MB 73.75 MB +424 B +0.0%
hits_40.vortex 1.0 vortex-compact 75.92 MB 75.92 MB +344 B +0.0%
hits_80.vortex 1.0 vortex-compact 68.07 MB 68.07 MB +264 B +0.0%
hits_42.vortex 1.0 vortex-compact 164.22 MB 164.22 MB +424 B +0.0%
hits_90.vortex 1.0 vortex-compact 81.86 MB 81.86 MB +48 B +0.0%
hits_57.vortex 1.0 vortex-compact 83.54 MB 83.54 MB +48 B +0.0%
hits_94.vortex 1.0 vortex-compact 90.63 MB 90.63 MB 848 B -0.0%
hits_41.vortex 1.0 vortex-compact 165.78 MB 165.77 MB 5.24 KB -0.0%
hits_96.vortex 1.0 vortex-compact 91.08 MB 91.08 MB 3.23 KB -0.0%
hits_71.vortex 1.0 vortex-compact 69.29 MB 69.29 MB 3.05 KB -0.0%
hits_86.vortex 1.0 vortex-compact 48.25 MB 48.24 MB 2.91 KB -0.0%
hits_87.vortex 1.0 vortex-compact 119.04 MB 119.04 MB 7.34 KB -0.0%
hits_55.vortex 1.0 vortex-compact 93.77 MB 93.76 MB 6.10 KB -0.0%
hits_92.vortex 1.0 vortex-compact 94.27 MB 94.27 MB 6.19 KB -0.0%
hits_99.vortex 1.0 vortex-compact 77.31 MB 77.31 MB 5.10 KB -0.0%
hits_3.vortex 1.0 vortex-compact 94.23 MB 94.22 MB 6.32 KB -0.0%
hits_44.vortex 1.0 vortex-compact 132.46 MB 132.45 MB 10.34 KB -0.0%
hits_98.vortex 1.0 vortex-compact 72.77 MB 72.76 MB 6.63 KB -0.0%
hits_85.vortex 1.0 vortex-compact 52.73 MB 52.73 MB 5.23 KB -0.0%
hits_65.vortex 1.0 vortex-compact 129.95 MB 129.92 MB 20.90 KB -0.0%
hits_97.vortex 1.0 vortex-compact 69.16 MB 69.15 MB 11.48 KB -0.0%
hits_91.vortex 1.0 vortex-compact 60.94 MB 60.93 MB 10.86 KB -0.0%
hits_35.vortex 1.0 vortex-compact 75.11 MB 75.10 MB 16.30 KB -0.0%
hits_31.vortex 1.0 vortex-compact 55.56 MB 55.54 MB 13.93 KB -0.0%
hits_79.vortex 1.0 vortex-compact 85.70 MB 85.68 MB 25.80 KB -0.0%
hits_50.vortex 1.0 vortex-compact 113.12 MB 113.08 MB 35.12 KB -0.0%
hits_52.vortex 1.0 vortex-compact 63.73 MB 63.71 MB 20.70 KB -0.0%
hits_84.vortex 1.0 vortex-compact 73.14 MB 73.11 MB 24.63 KB -0.0%
hits_39.vortex 1.0 vortex-compact 49.82 MB 49.80 MB 17.38 KB -0.0%
hits_83.vortex 1.0 vortex-compact 52.57 MB 52.56 MB 18.79 KB -0.0%
hits_95.vortex 1.0 vortex-compact 57.75 MB 57.73 MB 21.18 KB -0.0%
hits_89.vortex 1.0 vortex-compact 112.82 MB 112.77 MB 44.27 KB -0.0%
hits_76.vortex 1.0 vortex-compact 76.44 MB 76.41 MB 30.84 KB -0.0%
hits_68.vortex 1.0 vortex-compact 75.99 MB 75.96 MB 30.72 KB -0.0%
hits_78.vortex 1.0 vortex-compact 97.87 MB 97.83 MB 42.37 KB -0.0%
hits_64.vortex 1.0 vortex-compact 53.91 MB 53.89 MB 23.56 KB -0.0%
hits_60.vortex 1.0 vortex-compact 64.33 MB 64.30 MB 28.95 KB -0.0%
hits_49.vortex 1.0 vortex-compact 50.53 MB 50.51 MB 23.61 KB -0.0%
hits_59.vortex 1.0 vortex-compact 66.30 MB 66.27 MB 32.66 KB -0.0%
hits_54.vortex 1.0 vortex-compact 117.66 MB 117.60 MB 66.99 KB -0.1%
hits_46.vortex 1.0 vortex-compact 41.92 MB 41.89 MB 28.55 KB -0.1%
hits_21.vortex 1.0 vortex-compact 51.60 MB 51.56 MB 36.25 KB -0.1%
hits_22.vortex 1.0 vortex-compact 44.74 MB 44.71 MB 31.66 KB -0.1%
hits_82.vortex 1.0 vortex-compact 66.89 MB 66.84 MB 47.48 KB -0.1%
hits_0.vortex 1.0 vortex-compact 58.66 MB 58.61 MB 44.34 KB -0.1%
hits_51.vortex 1.0 vortex-compact 167.81 MB 167.67 MB 140.59 KB -0.1%
hits_45.vortex 1.0 vortex-compact 76.07 MB 76.00 MB 73.33 KB -0.1%
hits_20.vortex 1.0 vortex-compact 38.14 MB 38.10 MB 39.04 KB -0.1%
hits_19.vortex 1.0 vortex-compact 44.88 MB 44.81 MB 69.48 KB -0.2%
hits_54.vortex 1.0 vortex-file-compressed 361.83 MB 361.05 MB 795.97 KB -0.2%
hits_78.vortex 1.0 vortex-file-compressed 238.59 MB 237.97 MB 634.10 KB -0.3%
hits_55.vortex 1.0 vortex-file-compressed 251.56 MB 250.85 MB 727.37 KB -0.3%
hits_89.vortex 1.0 vortex-file-compressed 266.01 MB 265.21 MB 820.84 KB -0.3%
hits_1.vortex 1.0 vortex-file-compressed 181.16 MB 180.56 MB 613.62 KB -0.3%
hits_51.vortex 1.0 vortex-file-compressed 428.84 MB 427.27 MB 1.56 MB -0.4%
hits_50.vortex 1.0 vortex-file-compressed 255.24 MB 254.30 MB 960.34 KB -0.4%
hits_18.vortex 1.0 vortex-file-compressed 126.06 MB 125.57 MB 498.24 KB -0.4%
hits_0.vortex 1.0 vortex-file-compressed 112.17 MB 111.74 MB 444.45 KB -0.4%
hits_67.vortex 1.0 vortex-file-compressed 265.94 MB 264.89 MB 1.05 MB -0.4%
hits_68.vortex 1.0 vortex-file-compressed 172.16 MB 171.48 MB 703.89 KB -0.4%
hits_92.vortex 1.0 vortex-file-compressed 196.47 MB 195.68 MB 807.55 KB -0.4%
hits_47.vortex 1.0 vortex-file-compressed 41.86 MB 41.68 MB 177.05 KB -0.4%
hits_60.vortex 1.0 vortex-file-compressed 121.19 MB 120.66 MB 542.58 KB -0.4%
hits_58.vortex 1.0 vortex-file-compressed 113.78 MB 113.27 MB 519.38 KB -0.4%
hits_27.vortex 1.0 vortex-file-compressed 174.61 MB 173.82 MB 809.73 KB -0.5%
hits_96.vortex 1.0 vortex-file-compressed 180.76 MB 179.86 MB 914.75 KB -0.5%
hits_79.vortex 1.0 vortex-file-compressed 204.16 MB 203.13 MB 1.03 MB -0.5%
hits_28.vortex 1.0 vortex-file-compressed 167.55 MB 166.70 MB 874.74 KB -0.5%
hits_98.vortex 1.0 vortex-file-compressed 150.55 MB 149.78 MB 786.17 KB -0.5%
hits_56.vortex 1.0 vortex-file-compressed 163.76 MB 162.90 MB 873.32 KB -0.5%
hits_94.vortex 1.0 vortex-file-compressed 185.12 MB 184.16 MB 989.23 KB -0.5%
hits_3.vortex 1.0 vortex-file-compressed 193.11 MB 192.08 MB 1.03 MB -0.5%
hits_81.vortex 1.0 vortex-file-compressed 126.55 MB 125.87 MB 695.97 KB -0.5%
hits_2.vortex 1.0 vortex-file-compressed 241.46 MB 240.14 MB 1.31 MB -0.5%
hits_91.vortex 1.0 vortex-file-compressed 116.23 MB 115.60 MB 649.37 KB -0.5%
hits_90.vortex 1.0 vortex-file-compressed 204.12 MB 202.99 MB 1.13 MB -0.6%
hits_10.vortex 1.0 vortex-file-compressed 81.76 MB 81.30 MB 466.49 KB -0.6%
hits_99.vortex 1.0 vortex-file-compressed 158.88 MB 157.99 MB 907.18 KB -0.6%
hits_8.vortex 1.0 vortex-file-compressed 122.86 MB 122.17 MB 704.96 KB -0.6%
hits_5.vortex 1.0 vortex-file-compressed 122.64 MB 121.93 MB 731.02 KB -0.6%
hits_36.vortex 1.0 vortex-file-compressed 80.27 MB 79.79 MB 495.09 KB -0.6%
hits_9.vortex 1.0 vortex-file-compressed 124.22 MB 123.45 MB 782.62 KB -0.6%
hits_7.vortex 1.0 vortex-file-compressed 123.82 MB 123.04 MB 792.30 KB -0.6%
hits_4.vortex 1.0 vortex-file-compressed 138.86 MB 137.98 MB 900.84 KB -0.6%
hits_65.vortex 1.0 vortex-file-compressed 238.05 MB 236.53 MB 1.52 MB -0.6%
hits_77.vortex 1.0 vortex-file-compressed 218.96 MB 217.56 MB 1.40 MB -0.6%
hits_86.vortex 1.0 vortex-file-compressed 81.40 MB 80.88 MB 534.07 KB -0.6%
hits_6.vortex 1.0 vortex-file-compressed 122.86 MB 122.07 MB 811.68 KB -0.6%
hits_62.vortex 1.0 vortex-file-compressed 148.36 MB 147.39 MB 994.16 KB -0.7%
hits_35.vortex 1.0 vortex-file-compressed 138.81 MB 137.89 MB 933.59 KB -0.7%
hits_70.vortex 1.0 vortex-file-compressed 115.14 MB 114.38 MB 777.80 KB -0.7%
hits_75.vortex 1.0 vortex-file-compressed 74.18 MB 73.68 MB 514.61 KB -0.7%
hits_14.vortex 1.0 vortex-file-compressed 135.14 MB 134.22 MB 946.91 KB -0.7%
hits_43.vortex 1.0 vortex-file-compressed 305.71 MB 303.58 MB 2.14 MB -0.7%
hits_44.vortex 1.0 vortex-file-compressed 243.64 MB 241.94 MB 1.71 MB -0.7%
hits_71.vortex 1.0 vortex-file-compressed 126.41 MB 125.52 MB 908.05 KB -0.7%
hits_83.vortex 1.0 vortex-file-compressed 103.72 MB 102.99 MB 746.19 KB -0.7%
hits_48.vortex 1.0 vortex-file-compressed 28.53 MB 28.32 MB 206.27 KB -0.7%
hits_87.vortex 1.0 vortex-file-compressed 221.68 MB 220.08 MB 1.60 MB -0.7%
hits_57.vortex 1.0 vortex-file-compressed 158.37 MB 157.23 MB 1.15 MB -0.7%
hits_95.vortex 1.0 vortex-file-compressed 114.33 MB 113.50 MB 851.08 KB -0.7%
hits_59.vortex 1.0 vortex-file-compressed 121.84 MB 120.95 MB 913.71 KB -0.7%
hits_97.vortex 1.0 vortex-file-compressed 130.96 MB 130.00 MB 984.11 KB -0.7%
hits_42.vortex 1.0 vortex-file-compressed 298.79 MB 296.59 MB 2.20 MB -0.7%
hits_17.vortex 1.0 vortex-file-compressed 103.64 MB 102.87 MB 781.46 KB -0.7%
hits_41.vortex 1.0 vortex-file-compressed 300.49 MB 298.28 MB 2.21 MB -0.7%
hits_40.vortex 1.0 vortex-file-compressed 142.99 MB 141.94 MB 1.06 MB -0.7%
hits_49.vortex 1.0 vortex-file-compressed 88.67 MB 88.01 MB 681.11 KB -0.8%
hits_63.vortex 1.0 vortex-file-compressed 80.62 MB 80.01 MB 625.30 KB -0.8%
hits_11.vortex 1.0 vortex-file-compressed 96.07 MB 95.34 MB 747.26 KB -0.8%
hits_74.vortex 1.0 vortex-file-compressed 152.12 MB 150.96 MB 1.16 MB -0.8%
hits_88.vortex 1.0 vortex-file-compressed 137.34 MB 136.27 MB 1.07 MB -0.8%
hits_26.vortex 1.0 vortex-file-compressed 144.05 MB 142.91 MB 1.14 MB -0.8%
hits_19.vortex 1.0 vortex-file-compressed 82.10 MB 81.45 MB 670.86 KB -0.8%
hits_73.vortex 1.0 vortex-file-compressed 131.83 MB 130.76 MB 1.07 MB -0.8%
hits_12.vortex 1.0 vortex-file-compressed 125.34 MB 124.32 MB 1.02 MB -0.8%
hits_25.vortex 1.0 vortex-file-compressed 137.01 MB 135.87 MB 1.13 MB -0.8%
hits_30.vortex 1.0 vortex-file-compressed 104.00 MB 103.13 MB 889.26 KB -0.8%
hits_38.vortex 1.0 vortex-file-compressed 118.43 MB 117.42 MB 1.01 MB -0.8%
hits_31.vortex 1.0 vortex-file-compressed 104.39 MB 103.50 MB 911.80 KB -0.9%
hits_84.vortex 1.0 vortex-file-compressed 145.05 MB 143.80 MB 1.25 MB -0.9%
hits_93.vortex 1.0 vortex-file-compressed 107.66 MB 106.73 MB 952.38 KB -0.9%
hits_64.vortex 1.0 vortex-file-compressed 95.27 MB 94.45 MB 845.59 KB -0.9%
hits_69.vortex 1.0 vortex-file-compressed 147.61 MB 146.33 MB 1.28 MB -0.9%
hits_34.vortex 1.0 vortex-file-compressed 111.68 MB 110.70 MB 1009.22 KB -0.9%
hits_29.vortex 1.0 vortex-file-compressed 65.47 MB 64.89 MB 596.88 KB -0.9%
hits_66.vortex 1.0 vortex-file-compressed 105.34 MB 104.39 MB 969.60 KB -0.9%
hits_32.vortex 1.0 vortex-file-compressed 77.12 MB 76.41 MB 720.57 KB -0.9%
hits_80.vortex 1.0 vortex-file-compressed 124.24 MB 123.09 MB 1.15 MB -0.9%
hits_85.vortex 1.0 vortex-file-compressed 106.37 MB 105.37 MB 1020.95 KB -0.9%
hits_37.vortex 1.0 vortex-file-compressed 97.54 MB 96.62 MB 943.88 KB -0.9%
hits_46.vortex 1.0 vortex-file-compressed 80.32 MB 79.56 MB 781.84 KB -1.0%
hits_20.vortex 1.0 vortex-file-compressed 67.53 MB 66.89 MB 662.15 KB -1.0%
hits_13.vortex 1.0 vortex-file-compressed 123.20 MB 121.99 MB 1.22 MB -1.0%
hits_76.vortex 1.0 vortex-file-compressed 140.05 MB 138.65 MB 1.39 MB -1.0%
hits_52.vortex 1.0 vortex-file-compressed 120.78 MB 119.55 MB 1.23 MB -1.0%
hits_16.vortex 1.0 vortex-file-compressed 87.59 MB 86.67 MB 943.01 KB -1.1%
hits_45.vortex 1.0 vortex-file-compressed 145.48 MB 143.94 MB 1.53 MB -1.1%
hits_72.vortex 1.0 vortex-file-compressed 96.27 MB 95.22 MB 1.06 MB -1.1%
hits_39.vortex 1.0 vortex-file-compressed 94.06 MB 93.00 MB 1.05 MB -1.1%
hits_33.vortex 1.0 vortex-file-compressed 62.97 MB 62.23 MB 749.52 KB -1.2%
hits_82.vortex 1.0 vortex-file-compressed 122.77 MB 121.32 MB 1.45 MB -1.2%
hits_61.vortex 1.0 vortex-file-compressed 114.43 MB 113.08 MB 1.35 MB -1.2%
hits_53.vortex 1.0 vortex-file-compressed 98.26 MB 97.08 MB 1.18 MB -1.2%
hits_15.vortex 1.0 vortex-file-compressed 97.01 MB 95.80 MB 1.21 MB -1.2%
hits_21.vortex 1.0 vortex-file-compressed 101.28 MB 99.99 MB 1.29 MB -1.3%
hits_24.vortex 1.0 vortex-file-compressed 79.71 MB 78.32 MB 1.39 MB -1.7%
hits_23.vortex 1.0 vortex-file-compressed 80.37 MB 78.73 MB 1.64 MB -2.0%
hits_22.vortex 1.0 vortex-file-compressed 81.17 MB 79.30 MB 1.87 MB -2.3%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 13.92 GB (-0.7%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -10.0%
Vortex (geomean): 0.927x ➖
Parquet (geomean): 1.029x ➖
Shifts: Parquet (control) +2.9% · Median polish -2.4%


datafusion / vortex-file-compressed (0.828x ➖, 9↑ 4↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 327775965 496940028 0.66
tpch_q02/datafusion:vortex-file-compressed 🚨 677610532 500063845 1.36
tpch_q03/datafusion:vortex-file-compressed 480488050 459744515 1.05
tpch_q04/datafusion:vortex-file-compressed 🚨 371118543 283822855 1.31
tpch_q05/datafusion:vortex-file-compressed 🚀 535521438 785543514 0.68
tpch_q06/datafusion:vortex-file-compressed 375605680 489662099 0.77
tpch_q07/datafusion:vortex-file-compressed 🚀 456289089 689181115 0.66
tpch_q08/datafusion:vortex-file-compressed 801991005 759775741 1.06
tpch_q09/datafusion:vortex-file-compressed 560730568 683751414 0.82
tpch_q10/datafusion:vortex-file-compressed 524373889 620220291 0.85
tpch_q11/datafusion:vortex-file-compressed 🚀 307960647 501019762 0.61
tpch_q12/datafusion:vortex-file-compressed 496603982 501917272 0.99
tpch_q13/datafusion:vortex-file-compressed 🚀 154711866 245089864 0.63
tpch_q14/datafusion:vortex-file-compressed 257317823 308307909 0.83
tpch_q15/datafusion:vortex-file-compressed 🚀 412327147 716159360 0.58
tpch_q16/datafusion:vortex-file-compressed 204988495 221549114 0.93
tpch_q17/datafusion:vortex-file-compressed 🚀 496514396 724623800 0.69
tpch_q18/datafusion:vortex-file-compressed 🚀 366062328 827887278 0.44
tpch_q19/datafusion:vortex-file-compressed 🚀 474372765 752598045 0.63
tpch_q20/datafusion:vortex-file-compressed 408450297 486150303 0.84
tpch_q21/datafusion:vortex-file-compressed 🚨 905930041 682634840 1.33
tpch_q22/datafusion:vortex-file-compressed 🚨 187130895 133788850 1.40
datafusion / vortex-compact (1.016x ➖, 1↑ 3↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 255897034 248357413 1.03
tpch_q02/datafusion:vortex-compact 460164744 450577718 1.02
tpch_q03/datafusion:vortex-compact 386528288 385846283 1.00
tpch_q04/datafusion:vortex-compact 232207590 247873889 0.94
tpch_q05/datafusion:vortex-compact 612645058 481212313 1.27
tpch_q06/datafusion:vortex-compact 🚨 434343871 332793510 1.31
tpch_q07/datafusion:vortex-compact 519298511 490168694 1.06
tpch_q08/datafusion:vortex-compact 745061257 692674790 1.08
tpch_q09/datafusion:vortex-compact 556923125 459175689 1.21
tpch_q10/datafusion:vortex-compact 706522465 612609107 1.15
tpch_q11/datafusion:vortex-compact 324350906 386169793 0.84
tpch_q12/datafusion:vortex-compact 604422879 784684569 0.77
tpch_q13/datafusion:vortex-compact 193898343 256394874 0.76
tpch_q14/datafusion:vortex-compact 333370352 332281659 1.00
tpch_q15/datafusion:vortex-compact 🚨 721942654 446554320 1.62
tpch_q16/datafusion:vortex-compact 268629799 216948200 1.24
tpch_q17/datafusion:vortex-compact 518468975 619940688 0.84
tpch_q18/datafusion:vortex-compact 🚀 331645431 492810046 0.67
tpch_q19/datafusion:vortex-compact 611523272 775493937 0.79
tpch_q20/datafusion:vortex-compact 525098069 570761449 0.92
tpch_q21/datafusion:vortex-compact 671798896 701590988 0.96
tpch_q22/datafusion:vortex-compact 🚨 189091343 134894737 1.40
datafusion / parquet (1.068x ➖, 0↑ 5↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 311524736 230960685 1.35
tpch_q02/datafusion:parquet 403831024 411475430 0.98
tpch_q03/datafusion:parquet 348466417 383115542 0.91
tpch_q04/datafusion:parquet 244144413 238237883 1.02
tpch_q05/datafusion:parquet 551869922 632744613 0.87
tpch_q06/datafusion:parquet 148911746 164746826 0.90
tpch_q07/datafusion:parquet 585007438 456303639 1.28
tpch_q08/datafusion:parquet 632807579 564656632 1.12
tpch_q09/datafusion:parquet 583483871 522003254 1.12
tpch_q10/datafusion:parquet 🚨 683793749 514160150 1.33
tpch_q11/datafusion:parquet 407754181 357021219 1.14
tpch_q12/datafusion:parquet 287307254 258022854 1.11
tpch_q13/datafusion:parquet 443539887 466501870 0.95
tpch_q14/datafusion:parquet 🚨 243881330 167866930 1.45
tpch_q15/datafusion:parquet 🚨 470737563 281547379 1.67
tpch_q16/datafusion:parquet 🚨 266149710 165862565 1.60
tpch_q17/datafusion:parquet 465401525 424768876 1.10
tpch_q18/datafusion:parquet 512418036 667766254 0.77
tpch_q19/datafusion:parquet 334926349 376687663 0.89
tpch_q20/datafusion:parquet 306988306 351586180 0.87
tpch_q21/datafusion:parquet 494138801 580284814 0.85
tpch_q22/datafusion:parquet 139471404 176758527 0.79
duckdb / vortex-file-compressed (0.907x ➖, 0↑ 0↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 274135722 296411683 0.92
tpch_q02/duckdb:vortex-file-compressed 1078322167 1117382007 0.97
tpch_q03/duckdb:vortex-file-compressed 790143621 786628356 1.00
tpch_q04/duckdb:vortex-file-compressed 431361589 490314868 0.88
tpch_q05/duckdb:vortex-file-compressed 916412131 1073567090 0.85
tpch_q06/duckdb:vortex-file-compressed 370144560 409917419 0.90
tpch_q07/duckdb:vortex-file-compressed 963425573 1131933985 0.85
tpch_q08/duckdb:vortex-file-compressed 1104109965 1110598675 0.99
tpch_q09/duckdb:vortex-file-compressed 1036986179 1085720998 0.96
tpch_q10/duckdb:vortex-file-compressed 838952127 956429542 0.88
tpch_q11/duckdb:vortex-file-compressed 520001150 605828726 0.86
tpch_q12/duckdb:vortex-file-compressed 727285368 717871896 1.01
tpch_q13/duckdb:vortex-file-compressed 479048640 571525499 0.84
tpch_q14/duckdb:vortex-file-compressed 419951527 494896310 0.85
tpch_q15/duckdb:vortex-file-compressed 280798172 374623224 0.75
tpch_q16/duckdb:vortex-file-compressed 379679338 380175198 1.00
tpch_q17/duckdb:vortex-file-compressed 888011735 989247865 0.90
tpch_q18/duckdb:vortex-file-compressed 674812233 697231595 0.97
tpch_q19/duckdb:vortex-file-compressed 540809491 596790943 0.91
tpch_q20/duckdb:vortex-file-compressed 923678196 1120452390 0.82
tpch_q21/duckdb:vortex-file-compressed 1102919500 1194244600 0.92
tpch_q22/duckdb:vortex-file-compressed 337956514 342748289 0.99
duckdb / vortex-compact (0.966x ➖, 0↑ 1↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 319595928 426583563 0.75
tpch_q02/duckdb:vortex-compact 928027283 1091834874 0.85
tpch_q03/duckdb:vortex-compact 689541529 793836353 0.87
tpch_q04/duckdb:vortex-compact 446703033 381016198 1.17
tpch_q05/duckdb:vortex-compact 938943382 853054931 1.10
tpch_q06/duckdb:vortex-compact 412385415 382909026 1.08
tpch_q07/duckdb:vortex-compact 979114817 1039495867 0.94
tpch_q08/duckdb:vortex-compact 1054534352 966399652 1.09
tpch_q09/duckdb:vortex-compact 1083761740 1179259868 0.92
tpch_q10/duckdb:vortex-compact 734782363 723161757 1.02
tpch_q11/duckdb:vortex-compact 540584712 548434414 0.99
tpch_q12/duckdb:vortex-compact 653655672 744007460 0.88
tpch_q13/duckdb:vortex-compact 🚨 497600468 372862623 1.33
tpch_q14/duckdb:vortex-compact 465696130 496672490 0.94
tpch_q15/duckdb:vortex-compact 375676783 370249668 1.01
tpch_q16/duckdb:vortex-compact 362609946 351286343 1.03
tpch_q17/duckdb:vortex-compact 776985902 891036000 0.87
tpch_q18/duckdb:vortex-compact 460323638 563739071 0.82
tpch_q19/duckdb:vortex-compact 545359973 539762844 1.01
tpch_q20/duckdb:vortex-compact 899241502 981144699 0.92
tpch_q21/duckdb:vortex-compact 1256621715 1314027153 0.96
tpch_q22/duckdb:vortex-compact 298855010 339426313 0.88
duckdb / parquet (0.991x ➖, 0↑ 0↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 543655174 523195252 1.04
tpch_q02/duckdb:parquet 1278406418 1193410797 1.07
tpch_q03/duckdb:parquet 1097757657 1120476326 0.98
tpch_q04/duckdb:parquet 730660697 773103610 0.95
tpch_q05/duckdb:parquet 1421134572 1463345883 0.97
tpch_q06/duckdb:parquet 488521923 478469871 1.02
tpch_q07/duckdb:parquet 1303853470 1423185077 0.92
tpch_q08/duckdb:parquet 1788008229 1648803028 1.08
tpch_q09/duckdb:parquet 1716343195 1558847557 1.10
tpch_q10/duckdb:parquet 1450968114 1431362507 1.01
tpch_q11/duckdb:parquet 845703501 850688322 0.99
tpch_q12/duckdb:parquet 858137648 763863127 1.12
tpch_q13/duckdb:parquet 953691743 989212078 0.96
tpch_q14/duckdb:parquet 736631315 794814583 0.93
tpch_q15/duckdb:parquet 651614223 786813002 0.83
tpch_q16/duckdb:parquet 820890624 803734638 1.02
tpch_q17/duckdb:parquet 863515913 863745374 1.00
tpch_q18/duckdb:parquet 948497980 1048685613 0.90
tpch_q19/duckdb:parquet 951086035 938742371 1.01
tpch_q20/duckdb:parquet 1320842670 1286644427 1.03
tpch_q21/duckdb:parquet 1226391946 1387028352 0.88
tpch_q22/duckdb:parquet 652115033 627334562 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +3.0% +18.4% -13.0% +102.7% ➖ noise
1 datafusion:vortex-file-compressed -34.0% +18.4% -44.3% +91.8% ➖ noise
1 duckdb:vortex-compact -25.1% +18.4% -36.7% +55.0% ✅ faster
1 duckdb:vortex-file-compressed -7.5% +18.4% -21.9% +69.7% ➖ noise
2 datafusion:vortex-compact +2.1% +2.5% -0.4% +34.0% ➖ noise
2 datafusion:vortex-file-compressed +35.5% +2.5% +32.2% +43.2% ➖ noise
2 duckdb:vortex-compact -15.0% +2.5% -17.1% +34.0% ➖ noise
2 duckdb:vortex-file-compressed -3.5% +2.5% -5.9% +34.0% ➖ noise
3 datafusion:vortex-compact +0.2% -5.6% +6.1% +37.4% ➖ noise
3 datafusion:vortex-file-compressed +4.5% -5.6% +10.7% +55.9% ➖ noise
3 duckdb:vortex-compact -13.1% -5.6% -8.0% +36.3% ➖ noise
3 duckdb:vortex-file-compressed +0.4% -5.6% +6.4% +34.0% ➖ noise
4 datafusion:vortex-compact -6.3% -1.6% -4.8% +46.9% ➖ noise
4 datafusion:vortex-file-compressed +30.8% -1.6% +32.9% +53.9% ➖ noise
4 duckdb:vortex-compact +17.2% -1.6% +19.1% +34.0% ➖ noise
4 duckdb:vortex-file-compressed -12.0% -1.6% -10.6% +34.0% ➖ noise
5 datafusion:vortex-compact +27.3% -8.0% +38.3% +47.0% ➖ noise
5 datafusion:vortex-file-compressed -31.8% -8.0% -25.9% +34.0% ✅ faster
5 duckdb:vortex-compact +10.1% -8.0% +19.6% +34.0% ➖ noise
5 duckdb:vortex-file-compressed -14.6% -8.0% -7.3% +34.0% ➖ noise
6 datafusion:vortex-compact +30.5% -3.9% +35.9% +35.6% 🚨 regression
6 datafusion:vortex-file-compressed -23.3% -3.9% -20.2% +34.0% ➖ noise
6 duckdb:vortex-compact +7.7% -3.9% +12.1% +47.4% ➖ noise
6 duckdb:vortex-file-compressed -9.7% -3.9% -6.0% +34.0% ➖ noise
7 datafusion:vortex-compact +5.9% +8.4% -2.2% +51.3% ➖ noise
7 datafusion:vortex-file-compressed -33.8% +8.4% -38.9% +34.0% ✅ faster
7 duckdb:vortex-compact -5.8% +8.4% -13.1% +34.0% ➖ noise
7 duckdb:vortex-file-compressed -14.9% +8.4% -21.5% +34.0% ➖ noise
8 datafusion:vortex-compact +7.6% +10.2% -2.4% +34.0% ➖ noise
8 datafusion:vortex-file-compressed +5.6% +10.2% -4.2% +34.0% ➖ noise
8 duckdb:vortex-compact +9.1% +10.2% -1.0% +34.0% ➖ noise
8 duckdb:vortex-file-compressed -0.6% +10.2% -9.8% +34.0% ➖ noise
9 datafusion:vortex-compact +21.3% +10.9% +9.3% +34.0% ➖ noise
9 datafusion:vortex-file-compressed -18.0% +10.9% -26.1% +34.0% ✅ faster
9 duckdb:vortex-compact -8.1% +10.9% -17.2% +34.0% ➖ noise
9 duckdb:vortex-file-compressed -4.5% +10.9% -13.9% +34.0% ➖ noise
10 datafusion:vortex-compact +15.3% +16.1% -0.7% +37.2% ➖ noise
10 datafusion:vortex-file-compressed -15.5% +16.1% -27.2% +34.0% ✅ faster
10 duckdb:vortex-compact +1.6% +16.1% -12.5% +34.0% ➖ noise
10 duckdb:vortex-file-compressed -12.3% +16.1% -24.5% +34.0% ➖ noise
11 datafusion:vortex-compact -16.0% +6.6% -21.2% +34.0% ➖ noise
11 datafusion:vortex-file-compressed -38.5% +6.6% -42.3% +56.4% ✅ faster
11 duckdb:vortex-compact -1.4% +6.6% -7.5% +34.0% ➖ noise
11 duckdb:vortex-file-compressed -14.2% +6.6% -19.4% +34.0% ➖ noise
12 datafusion:vortex-compact -23.0% +11.8% -31.1% +35.6% ✅ faster
12 datafusion:vortex-file-compressed -1.1% +11.8% -11.5% +34.0% ➖ noise
12 duckdb:vortex-compact -12.1% +11.8% -21.4% +35.2% ➖ noise
12 duckdb:vortex-file-compressed +1.3% +11.8% -9.4% +34.0% ➖ noise
13 datafusion:vortex-compact -24.4% -4.3% -21.0% +57.4% ➖ noise
13 datafusion:vortex-file-compressed -36.9% -4.3% -34.1% +61.7% ➖ noise
13 duckdb:vortex-compact +33.5% -4.3% +39.4% +47.6% ➖ noise
13 duckdb:vortex-file-compressed -16.2% -4.3% -12.5% +34.0% ➖ noise
14 datafusion:vortex-compact +0.3% +16.0% -13.5% +44.8% ➖ noise
14 datafusion:vortex-file-compressed -16.5% +16.0% -28.1% +45.8% ➖ noise
14 duckdb:vortex-compact -6.2% +16.0% -19.2% +36.7% ➖ noise
14 duckdb:vortex-file-compressed -15.1% +16.0% -26.9% +34.0% ✅ faster
15 datafusion:vortex-compact +61.7% +17.7% +37.4% +34.0% 🚨 regression
15 datafusion:vortex-file-compressed -42.4% +17.7% -51.1% +34.0% ✅ faster
15 duckdb:vortex-compact +1.5% +17.7% -13.8% +36.4% ➖ noise
15 duckdb:vortex-file-compressed -25.0% +17.7% -36.3% +34.0% ✅ faster
16 datafusion:vortex-compact +23.8% +28.0% -3.3% +34.0% ➖ noise
16 datafusion:vortex-file-compressed -7.5% +28.0% -27.7% +34.0% ✅ faster
16 duckdb:vortex-compact +3.2% +28.0% -19.4% +107.8% ➖ noise
16 duckdb:vortex-file-compressed -0.1% +28.0% -22.0% +34.0% ➖ noise
17 datafusion:vortex-compact -16.4% +4.7% -20.1% +34.0% ➖ noise
17 datafusion:vortex-file-compressed -31.5% +4.7% -34.5% +37.1% ✅ faster
17 duckdb:vortex-compact -12.8% +4.7% -16.7% +34.0% ➖ noise
17 duckdb:vortex-file-compressed -10.2% +4.7% -14.2% +34.0% ➖ noise
18 datafusion:vortex-compact -32.7% -16.7% -19.2% +34.0% ➖ noise
18 datafusion:vortex-file-compressed -55.8% -16.7% -46.9% +34.0% ✅ faster
18 duckdb:vortex-compact -18.3% -16.7% -2.0% +34.0% ➖ noise
18 duckdb:vortex-file-compressed -3.2% -16.7% +16.2% +34.0% ➖ noise
19 datafusion:vortex-compact -21.1% -5.1% -16.9% +34.0% ➖ noise
19 datafusion:vortex-file-compressed -37.0% -5.1% -33.6% +34.0% ✅ faster
19 duckdb:vortex-compact +1.0% -5.1% +6.5% +34.0% ➖ noise
19 duckdb:vortex-file-compressed -9.4% -5.1% -4.5% +34.0% ➖ noise
20 datafusion:vortex-compact -8.0% -5.3% -2.8% +35.1% ➖ noise
20 datafusion:vortex-file-compressed -16.0% -5.3% -11.3% +34.0% ➖ noise
20 duckdb:vortex-compact -8.3% -5.3% -3.2% +34.8% ➖ noise
20 duckdb:vortex-file-compressed -17.6% -5.3% -12.9% +34.0% ➖ noise
21 datafusion:vortex-compact -4.2% -13.2% +10.4% +34.0% ➖ noise
21 datafusion:vortex-file-compressed +32.7% -13.2% +52.9% +41.8% 🚨 regression
21 duckdb:vortex-compact -4.4% -13.2% +10.2% +59.7% ➖ noise
21 duckdb:vortex-file-compressed -7.6% -13.2% +6.4% +34.0% ➖ noise
22 datafusion:vortex-compact +40.2% -9.4% +54.8% +42.2% 🚨 regression
22 datafusion:vortex-file-compressed +39.9% -9.4% +54.4% +35.6% 🚨 regression
22 duckdb:vortex-compact -12.0% -9.4% -2.8% +34.0% ➖ noise
22 duckdb:vortex-file-compressed -1.4% -9.4% +8.9% +41.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.9%
Vortex (geomean): 1.307x ❌
Parquet (geomean): 1.207x ❌
Shifts: Parquet (control) +20.7% · Median polish +27.0%


datafusion / vortex-file-compressed (1.335x ❌, 0↑ 22↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 504935339 413668626 1.22
tpch_q02/datafusion:vortex-file-compressed 🚨 147956662 116337808 1.27
tpch_q03/datafusion:vortex-file-compressed 🚨 287346793 222746375 1.29
tpch_q04/datafusion:vortex-file-compressed 🚨 145635895 119848169 1.22
tpch_q05/datafusion:vortex-file-compressed 🚨 522978644 404342274 1.29
tpch_q06/datafusion:vortex-file-compressed 🚨 51295789 38438366 1.33
tpch_q07/datafusion:vortex-file-compressed 🚨 798889269 531880252 1.50
tpch_q08/datafusion:vortex-file-compressed 🚨 549266331 393324570 1.40
tpch_q09/datafusion:vortex-file-compressed 🚨 895514549 668793939 1.34
tpch_q10/datafusion:vortex-file-compressed 🚨 300838729 238990797 1.26
tpch_q11/datafusion:vortex-file-compressed 🚨 115480234 89539353 1.29
tpch_q12/datafusion:vortex-file-compressed 🚨 179451915 121812441 1.47
tpch_q13/datafusion:vortex-file-compressed 🚨 302438044 226963217 1.33
tpch_q14/datafusion:vortex-file-compressed 🚨 69881011 57233652 1.22
tpch_q15/datafusion:vortex-file-compressed 🚨 146667807 105586753 1.39
tpch_q16/datafusion:vortex-file-compressed 🚨 112113408 80575600 1.39
tpch_q17/datafusion:vortex-file-compressed 🚨 953537493 682878665 1.40
tpch_q18/datafusion:vortex-file-compressed 🚨 1183168549 919930514 1.29
tpch_q19/datafusion:vortex-file-compressed 🚨 95606982 77075239 1.24
tpch_q20/datafusion:vortex-file-compressed 🚨 233376161 171927747 1.36
tpch_q21/datafusion:vortex-file-compressed 🚨 1045057339 709930120 1.47
tpch_q22/datafusion:vortex-file-compressed 🚨 99613851 68502663 1.45
datafusion / vortex-compact (1.356x ❌, 0↑ 22↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 584101637 448464716 1.30
tpch_q02/datafusion:vortex-compact 🚨 171857705 119611455 1.44
tpch_q03/datafusion:vortex-compact 🚨 319685055 222660765 1.44
tpch_q04/datafusion:vortex-compact 🚨 174662521 124775221 1.40
tpch_q05/datafusion:vortex-compact 🚨 574158572 402074654 1.43
tpch_q06/datafusion:vortex-compact 🚨 80817405 61488646 1.31
tpch_q07/datafusion:vortex-compact 🚨 778009965 554715838 1.40
tpch_q08/datafusion:vortex-compact 🚨 557767459 392910140 1.42
tpch_q09/datafusion:vortex-compact 🚨 898913036 687031756 1.31
tpch_q10/datafusion:vortex-compact 🚨 320627344 263934667 1.21
tpch_q11/datafusion:vortex-compact 🚨 123483682 92529762 1.33
tpch_q12/datafusion:vortex-compact 🚨 218548939 164848132 1.33
tpch_q13/datafusion:vortex-compact 🚨 361145411 276543675 1.31
tpch_q14/datafusion:vortex-compact 🚨 106145577 73078559 1.45
tpch_q15/datafusion:vortex-compact 🚨 228348017 162157963 1.41
tpch_q16/datafusion:vortex-compact 🚨 123756719 84766449 1.46
tpch_q17/datafusion:vortex-compact 🚨 1008565456 677701587 1.49
tpch_q18/datafusion:vortex-compact 🚨 1201725003 922573198 1.30
tpch_q19/datafusion:vortex-compact 🚨 154466183 126758247 1.22
tpch_q20/datafusion:vortex-compact 🚨 268547545 195984140 1.37
tpch_q21/datafusion:vortex-compact 🚨 981580869 716243698 1.37
tpch_q22/datafusion:vortex-compact 🚨 92073970 77933840 1.18
datafusion / parquet (1.265x ❌, 0↑ 22↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 597170467 469886036 1.27
tpch_q02/datafusion:parquet 🚨 219383653 184102081 1.19
tpch_q03/datafusion:parquet 🚨 400334195 297978045 1.34
tpch_q04/datafusion:parquet 🚨 177922007 134130988 1.33
tpch_q05/datafusion:parquet 🚨 663846423 463055426 1.43
tpch_q06/datafusion:parquet 🚨 161946916 127220607 1.27
tpch_q07/datafusion:parquet 🚨 864572932 645847527 1.34
tpch_q08/datafusion:parquet 🚨 609977909 493255350 1.24
tpch_q09/datafusion:parquet 🚨 1089181260 803951519 1.35
tpch_q10/datafusion:parquet 🚨 655888922 522165964 1.26
tpch_q11/datafusion:parquet 🚨 154089179 124975802 1.23
tpch_q12/datafusion:parquet 🚨 242389747 204875729 1.18
tpch_q13/datafusion:parquet 🚨 401108970 344456884 1.16
tpch_q14/datafusion:parquet 🚨 197800375 167792280 1.18
tpch_q15/datafusion:parquet 🚨 334153755 266619951 1.25
tpch_q16/datafusion:parquet 🚨 152650552 131210008 1.16
tpch_q17/datafusion:parquet 🚨 1072654443 731135340 1.47
tpch_q18/datafusion:parquet 🚨 1316855284 967189283 1.36
tpch_q19/datafusion:parquet 🚨 317055578 266164117 1.19
tpch_q20/datafusion:parquet 🚨 368716657 303212711 1.22
tpch_q21/datafusion:parquet 🚨 994252534 742298716 1.34
tpch_q22/datafusion:parquet 🚨 248300860 221896585 1.12
datafusion / arrow (1.312x ❌, 0↑ 22↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚨 772622624 620928160 1.24
tpch_q02/datafusion:arrow 🚨 243129737 173737565 1.40
tpch_q03/datafusion:arrow 🚨 686604644 503504702 1.36
tpch_q04/datafusion:arrow 🚨 557577756 373676029 1.49
tpch_q05/datafusion:arrow 🚨 1333142766 1019117139 1.31
tpch_q06/datafusion:arrow 🚨 371338322 305331737 1.22
tpch_q07/datafusion:arrow 🚨 1566554541 1249645762 1.25
tpch_q08/datafusion:arrow 🚨 1527555030 1190835634 1.28
tpch_q09/datafusion:arrow 🚨 2032335431 1414706219 1.44
tpch_q10/datafusion:arrow 🚨 805353066 636377565 1.27
tpch_q11/datafusion:arrow 🚨 206577394 146436032 1.41
tpch_q12/datafusion:arrow 🚨 1072136863 841376316 1.27
tpch_q13/datafusion:arrow 🚨 603653586 521361733 1.16
tpch_q14/datafusion:arrow 🚨 431471122 340538437 1.27
tpch_q15/datafusion:arrow 🚨 978990799 765317048 1.28
tpch_q16/datafusion:arrow 🚨 157674600 109607528 1.44
tpch_q17/datafusion:arrow 🚨 1912020677 1428342143 1.34
tpch_q18/datafusion:arrow 🚨 2602646297 2041199867 1.28
tpch_q19/datafusion:arrow 🚨 662484923 524701369 1.26
tpch_q20/datafusion:arrow 🚨 807980619 525184405 1.54
tpch_q21/datafusion:arrow 🚨 3749167666 3134536529 1.20
tpch_q22/datafusion:arrow 🚨 173654580 138954795 1.25
duckdb / vortex-file-compressed (1.282x ❌, 0↑ 22↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 210272329 170409191 1.23
tpch_q02/duckdb:vortex-file-compressed 🚨 72331950 53089878 1.36
tpch_q03/duckdb:vortex-file-compressed 🚨 196928745 125748257 1.57
tpch_q04/duckdb:vortex-file-compressed 🚨 236212001 166243861 1.42
tpch_q05/duckdb:vortex-file-compressed 🚨 195560301 141187460 1.39
tpch_q06/duckdb:vortex-file-compressed 🚨 46736575 37172418 1.26
tpch_q07/duckdb:vortex-file-compressed 🚨 193443118 137782413 1.40
tpch_q08/duckdb:vortex-file-compressed 🚨 246856446 176914359 1.40
tpch_q09/duckdb:vortex-file-compressed 🚨 515908047 403580165 1.28
tpch_q10/duckdb:vortex-file-compressed 🚨 238295459 195393535 1.22
tpch_q11/duckdb:vortex-file-compressed 🚨 40369913 33231614 1.21
tpch_q12/duckdb:vortex-file-compressed 🚨 129705737 103800666 1.25
tpch_q13/duckdb:vortex-file-compressed 🚨 334586952 275611118 1.21
tpch_q14/duckdb:vortex-file-compressed 🚨 65316031 54148626 1.21
tpch_q15/duckdb:vortex-file-compressed 🚨 119112542 92493564 1.29
tpch_q16/duckdb:vortex-file-compressed 🚨 98670362 81116989 1.22
tpch_q17/duckdb:vortex-file-compressed 🚨 131676188 95760643 1.38
tpch_q18/duckdb:vortex-file-compressed 🚨 354495846 291631567 1.22
tpch_q19/duckdb:vortex-file-compressed 🚨 94397755 81062546 1.16
tpch_q20/duckdb:vortex-file-compressed 🚨 177926500 146298856 1.22
tpch_q21/duckdb:vortex-file-compressed 🚨 644790102 521131217 1.24
tpch_q22/duckdb:vortex-file-compressed 🚨 77521383 66219278 1.17
duckdb / vortex-compact (1.259x ❌, 0↑ 22↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 261253910 233019956 1.12
tpch_q02/duckdb:vortex-compact 🚨 67607596 58230891 1.16
tpch_q03/duckdb:vortex-compact 🚨 172487115 143560227 1.20
tpch_q04/duckdb:vortex-compact 🚨 226753124 176059522 1.29
tpch_q05/duckdb:vortex-compact 🚨 218512942 169813753 1.29
tpch_q06/duckdb:vortex-compact 🚨 74823100 57728389 1.30
tpch_q07/duckdb:vortex-compact 🚨 248914500 177594959 1.40
tpch_q08/duckdb:vortex-compact 🚨 253702267 192940032 1.31
tpch_q09/duckdb:vortex-compact 🚨 567438563 439869065 1.29
tpch_q10/duckdb:vortex-compact 🚨 290519359 223653430 1.30
tpch_q11/duckdb:vortex-compact 🚨 49622323 40454898 1.23
tpch_q12/duckdb:vortex-compact 🚨 202702630 166749278 1.22
tpch_q13/duckdb:vortex-compact 🚨 386786016 333137798 1.16
tpch_q14/duckdb:vortex-compact 🚨 85332418 75131438 1.14
tpch_q15/duckdb:vortex-compact 🚨 154391305 117887829 1.31
tpch_q16/duckdb:vortex-compact 🚨 104866466 81121836 1.29
tpch_q17/duckdb:vortex-compact 🚨 148000180 110220787 1.34
tpch_q18/duckdb:vortex-compact 🚨 381824334 295965491 1.29
tpch_q19/duckdb:vortex-compact 🚨 125762280 97627337 1.29
tpch_q20/duckdb:vortex-compact 🚨 247463688 180318109 1.37
tpch_q21/duckdb:vortex-compact 🚨 676076850 539613164 1.25
tpch_q22/duckdb:vortex-compact 🚨 87849426 73971257 1.19
duckdb / parquet (1.153x ❌, 0↑ 18↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 295465565 262418173 1.13
tpch_q02/duckdb:parquet 107841764 103122408 1.05
tpch_q03/duckdb:parquet 🚨 241716796 216395963 1.12
tpch_q04/duckdb:parquet 🚨 166162564 139368448 1.19
tpch_q05/duckdb:parquet 🚨 266803382 229009437 1.17
tpch_q06/duckdb:parquet 🚨 88193329 77169859 1.14
tpch_q07/duckdb:parquet 🚨 223484094 189296958 1.18
tpch_q08/duckdb:parquet 🚨 361872365 272186763 1.33
tpch_q09/duckdb:parquet 🚨 636101263 495290102 1.28
tpch_q10/duckdb:parquet 🚨 736598905 631054399 1.17
tpch_q11/duckdb:parquet 78064361 71580242 1.09
tpch_q12/duckdb:parquet 🚨 147014410 133227668 1.10
tpch_q13/duckdb:parquet 471367410 452854239 1.04
tpch_q14/duckdb:parquet 🚨 205625726 184611756 1.11
tpch_q15/duckdb:parquet 🚨 125049406 105745576 1.18
tpch_q16/duckdb:parquet 🚨 184480398 165905934 1.11
tpch_q17/duckdb:parquet 🚨 210228712 184828265 1.14
tpch_q18/duckdb:parquet 🚨 444894008 364624041 1.22
tpch_q19/duckdb:parquet 🚨 339761455 287686784 1.18
tpch_q20/duckdb:parquet 🚨 272527427 234768935 1.16
tpch_q21/duckdb:parquet 🚨 696865198 572276510 1.22
tpch_q22/duckdb:parquet 324359640 297892765 1.09
duckdb / duckdb (1.272x ❌, 0↑ 22↓)
name PR 9a73899 (ns) base 7bfe690 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 🚨 145797856 120446987 1.21
tpch_q02/duckdb:duckdb 🚨 64370267 49789954 1.29
tpch_q03/duckdb:duckdb 🚨 142236293 106952908 1.33
tpch_q04/duckdb:duckdb 🚨 189739689 145357734 1.31
tpch_q05/duckdb:duckdb 🚨 163125461 121832911 1.34
tpch_q06/duckdb:duckdb 🚨 56239780 45144766 1.25
tpch_q07/duckdb:duckdb 🚨 120677380 92709360 1.30
tpch_q08/duckdb:duckdb 🚨 158630087 120248151 1.32
tpch_q09/duckdb:duckdb 🚨 375977875 284358617 1.32
tpch_q10/duckdb:duckdb 🚨 284604074 219909218 1.29
tpch_q11/duckdb:duckdb 🚨 24174223 19407055 1.25
tpch_q12/duckdb:duckdb 🚨 114880417 92067535 1.25
tpch_q13/duckdb:duckdb 🚨 318892401 238432734 1.34
tpch_q14/duckdb:duckdb 🚨 100795283 78803550 1.28
tpch_q15/duckdb:duckdb 🚨 104929695 82501017 1.27
tpch_q16/duckdb:duckdb 🚨 103002481 78024937 1.32
tpch_q17/duckdb:duckdb 🚨 108220244 88412927 1.22
tpch_q18/duckdb:duckdb 🚨 293611457 240073569 1.22
tpch_q19/duckdb:duckdb 🚨 152395409 124719495 1.22
tpch_q20/duckdb:duckdb 🚨 142984761 119091583 1.20
tpch_q21/duckdb:duckdb 🚨 410632739 310752759 1.32
tpch_q22/duckdb:duckdb 🚨 83410727 72081279 1.16
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +24.4% +19.6% +4.0% +15.5% ➖ noise
1 datafusion:vortex-compact +30.2% +19.6% +8.9% +15.5% ➖ noise
1 datafusion:vortex-file-compressed +22.1% +19.6% +2.0% +15.5% ➖ noise
1 duckdb:duckdb +21.0% +19.6% +1.2% +15.5% ➖ noise
1 duckdb:vortex-compact +12.1% +19.6% -6.3% +15.5% ➖ noise
1 duckdb:vortex-file-compressed +23.4% +19.6% +3.2% +15.5% ➖ noise
2 datafusion:arrow +39.9% +11.6% +25.4% +15.5% 🚨 regression
2 datafusion:vortex-compact +43.7% +11.6% +28.7% +15.5% 🚨 regression
2 datafusion:vortex-file-compressed +27.2% +11.6% +13.9% +15.5% ➖ noise
2 duckdb:duckdb +29.3% +11.6% +15.8% +15.5% 🚨 regression
2 duckdb:vortex-compact +16.1% +11.6% +4.0% +15.5% ➖ noise
2 duckdb:vortex-file-compressed +36.2% +11.6% +22.0% +15.5% 🚨 regression
3 datafusion:arrow +36.4% +22.5% +11.3% +15.5% ➖ noise
3 datafusion:vortex-compact +43.6% +22.5% +17.2% +15.5% 🚨 regression
3 datafusion:vortex-file-compressed +29.0% +22.5% +5.3% +15.5% ➖ noise
3 duckdb:duckdb +33.0% +22.5% +8.6% +15.5% ➖ noise
3 duckdb:vortex-compact +20.1% +22.5% -1.9% +15.5% ➖ noise
3 duckdb:vortex-file-compressed +56.6% +22.5% +27.8% +15.5% 🚨 regression
4 datafusion:arrow +49.2% +25.8% +18.7% +15.5% 🚨 regression
4 datafusion:vortex-compact +40.0% +25.8% +11.3% +15.5% ➖ noise
4 datafusion:vortex-file-compressed +21.5% +25.8% -3.4% +15.5% ➖ noise
4 duckdb:duckdb +30.5% +25.8% +3.8% +15.5% ➖ noise
4 duckdb:vortex-compact +28.8% +25.8% +2.4% +15.5% ➖ noise
4 duckdb:vortex-file-compressed +42.1% +25.8% +13.0% +15.5% ➖ noise
5 datafusion:arrow +30.8% +29.2% +1.2% +15.5% ➖ noise
5 datafusion:vortex-compact +42.8% +29.2% +10.5% +15.5% ➖ noise
5 datafusion:vortex-file-compressed +29.3% +29.2% +0.1% +15.5% ➖ noise
5 duckdb:duckdb +33.9% +29.2% +3.6% +15.5% ➖ noise
5 duckdb:vortex-compact +28.7% +29.2% -0.4% +15.5% ➖ noise
5 duckdb:vortex-file-compressed +38.5% +29.2% +7.2% +15.5% ➖ noise
6 datafusion:arrow +21.6% +20.6% +0.8% +15.5% ➖ noise
6 datafusion:vortex-compact +31.4% +20.6% +9.0% +15.5% ➖ noise
6 datafusion:vortex-file-compressed +33.4% +20.6% +10.6% +15.5% ➖ noise
6 duckdb:duckdb +24.6% +20.6% +3.3% +15.5% ➖ noise
6 duckdb:vortex-compact +29.6% +20.6% +7.5% +15.5% ➖ noise
6 duckdb:vortex-file-compressed +25.7% +20.6% +4.2% +15.5% ➖ noise
7 datafusion:arrow +25.4% +25.7% -0.3% +15.5% ➖ noise
7 datafusion:vortex-compact +40.3% +25.7% +11.6% +15.5% ➖ noise
7 datafusion:vortex-file-compressed +50.2% +25.7% +19.5% +15.5% 🚨 regression
7 duckdb:duckdb +30.2% +25.7% +3.5% +15.5% ➖ noise
7 duckdb:vortex-compact +40.2% +25.7% +11.5% +15.5% ➖ noise
7 duckdb:vortex-file-compressed +40.4% +25.7% +11.7% +15.5% ➖ noise
8 datafusion:arrow +28.3% +28.2% +0.0% +15.5% ➖ noise
8 datafusion:vortex-compact +42.0% +28.2% +10.7% +15.5% ➖ noise
8 datafusion:vortex-file-compressed +39.6% +28.2% +8.9% +15.5% ➖ noise
8 duckdb:duckdb +31.9% +28.2% +2.9% +15.5% ➖ noise
8 duckdb:vortex-compact +31.5% +28.2% +2.6% +15.5% ➖ noise
8 duckdb:vortex-file-compressed +39.5% +28.2% +8.8% +15.5% ➖ noise
9 datafusion:arrow +43.7% +31.9% +8.9% +15.5% ➖ noise
9 datafusion:vortex-compact +30.8% +31.9% -0.8% +15.5% ➖ noise
9 datafusion:vortex-file-compressed +33.9% +31.9% +1.5% +15.5% ➖ noise
9 duckdb:duckdb +32.2% +31.9% +0.2% +15.5% ➖ noise
9 duckdb:vortex-compact +29.0% +31.9% -2.2% +15.5% ➖ noise
9 duckdb:vortex-file-compressed +27.8% +31.9% -3.1% +15.5% ➖ noise
10 datafusion:arrow +26.6% +21.1% +4.5% +15.5% ➖ noise
10 datafusion:vortex-compact +21.5% +21.1% +0.3% +15.5% ➖ noise
10 datafusion:vortex-file-compressed +25.9% +21.1% +4.0% +15.5% ➖ noise
10 duckdb:duckdb +29.4% +21.1% +6.9% +15.5% ➖ noise
10 duckdb:vortex-compact +29.9% +21.1% +7.3% +15.5% ➖ noise
10 duckdb:vortex-file-compressed +22.0% +21.1% +0.7% +15.5% ➖ noise
11 datafusion:arrow +41.1% +16.0% +21.7% +15.5% 🚨 regression
11 datafusion:vortex-compact +33.5% +16.0% +15.1% +15.5% ➖ noise
11 datafusion:vortex-file-compressed +29.0% +16.0% +11.2% +15.5% ➖ noise
11 duckdb:duckdb +24.6% +16.0% +7.4% +15.5% ➖ noise
11 duckdb:vortex-compact +22.7% +16.0% +5.8% +15.5% ➖ noise
11 duckdb:vortex-file-compressed +21.5% +16.0% +4.8% +15.5% ➖ noise
12 datafusion:arrow +27.4% +14.3% +11.5% +35.5% ➖ noise
12 datafusion:vortex-compact +32.6% +14.3% +16.0% +15.5% 🚨 regression
12 datafusion:vortex-file-compressed +47.3% +14.3% +28.9% +15.5% 🚨 regression
12 duckdb:duckdb +24.8% +14.3% +9.2% +15.5% ➖ noise
12 duckdb:vortex-compact +21.6% +14.3% +6.4% +15.5% ➖ noise
12 duckdb:vortex-file-compressed +25.0% +14.3% +9.4% +15.5% ➖ noise
13 datafusion:arrow +15.8% +10.1% +5.2% +15.5% ➖ noise
13 datafusion:vortex-compact +30.6% +10.1% +18.6% +15.5% 🚨 regression
13 datafusion:vortex-file-compressed +33.3% +10.1% +21.0% +15.5% 🚨 regression
13 duckdb:duckdb +33.7% +10.1% +21.5% +15.5% 🚨 regression
13 duckdb:vortex-compact +16.1% +10.1% +5.5% +15.5% ➖ noise
13 duckdb:vortex-file-compressed +21.4% +10.1% +10.3% +15.5% ➖ noise
14 datafusion:arrow +26.7% +14.6% +10.6% +15.5% ➖ noise
14 datafusion:vortex-compact +45.2% +14.6% +26.8% +15.5% 🚨 regression
14 datafusion:vortex-file-compressed +22.1% +14.6% +6.6% +15.5% ➖ noise
14 duckdb:duckdb +27.9% +14.6% +11.6% +15.5% ➖ noise
14 duckdb:vortex-compact +13.6% +14.6% -0.9% +15.5% ➖ noise
14 duckdb:vortex-file-compressed +20.6% +14.6% +5.3% +15.5% ➖ noise
15 datafusion:arrow +27.9% +21.7% +5.1% +15.5% ➖ noise
15 datafusion:vortex-compact +40.8% +21.7% +15.7% +15.5% 🚨 regression
15 datafusion:vortex-file-compressed +38.9% +21.7% +14.1% +15.5% ➖ noise
15 duckdb:duckdb +27.2% +21.7% +4.5% +15.5% ➖ noise
15 duckdb:vortex-compact +31.0% +21.7% +7.6% +15.5% ➖ noise
15 duckdb:vortex-file-compressed +28.8% +21.7% +5.8% +15.5% ➖ noise
16 datafusion:arrow +43.9% +13.7% +26.5% +15.5% 🚨 regression
16 datafusion:vortex-compact +46.0% +13.7% +28.4% +15.5% 🚨 regression
16 datafusion:vortex-file-compressed +39.1% +13.7% +22.3% +15.5% 🚨 regression
16 duckdb:duckdb +32.0% +13.7% +16.1% +15.5% 🚨 regression
16 duckdb:vortex-compact +29.3% +13.7% +13.7% +15.5% ➖ noise
16 duckdb:vortex-file-compressed +21.6% +13.7% +6.9% +15.5% ➖ noise
17 datafusion:arrow +33.9% +29.2% +3.6% +15.5% ➖ noise
17 datafusion:vortex-compact +48.8% +29.2% +15.2% +15.5% ➖ noise
17 datafusion:vortex-file-compressed +39.6% +29.2% +8.1% +15.5% ➖ noise
17 duckdb:duckdb +22.4% +29.2% -5.2% +15.5% ➖ noise
17 duckdb:vortex-compact +34.3% +29.2% +3.9% +15.5% ➖ noise
17 duckdb:vortex-file-compressed +37.5% +29.2% +6.4% +15.5% ➖ noise
18 datafusion:arrow +27.5% +28.9% -1.1% +15.5% ➖ noise
18 datafusion:vortex-compact +30.3% +28.9% +1.1% +15.5% ➖ noise
18 datafusion:vortex-file-compressed +28.6% +28.9% -0.2% +15.5% ➖ noise
18 duckdb:duckdb +22.3% +28.9% -5.1% +15.5% ➖ noise
18 duckdb:vortex-compact +29.0% +28.9% +0.1% +15.5% ➖ noise
18 duckdb:vortex-file-compressed +21.6% +28.9% -5.7% +15.5% ➖ noise
19 datafusion:arrow +26.3% +18.6% +6.4% +15.5% ➖ noise
19 datafusion:vortex-compact +21.9% +18.6% +2.7% +15.5% ➖ noise
19 datafusion:vortex-file-compressed +24.0% +18.6% +4.6% +15.5% ➖ noise
19 duckdb:duckdb +22.2% +18.6% +3.0% +15.5% ➖ noise
19 duckdb:vortex-compact +28.8% +18.6% +8.6% +15.5% ➖ noise
19 duckdb:vortex-file-compressed +16.5% +18.6% -1.8% +15.5% ➖ noise
20 datafusion:arrow +53.8% +18.8% +29.5% +15.5% 🚨 regression
20 datafusion:vortex-compact +37.0% +18.8% +15.3% +15.5% ➖ noise
20 datafusion:vortex-file-compressed +35.7% +18.8% +14.2% +15.5% ➖ noise
20 duckdb:duckdb +20.1% +18.8% +1.1% +15.5% ➖ noise
20 duckdb:vortex-compact +37.2% +18.8% +15.5% +15.5% ➖ noise
20 duckdb:vortex-file-compressed +21.6% +18.8% +2.4% +15.5% ➖ noise
21 datafusion:arrow +19.6% +27.7% -6.3% +15.5% ➖ noise
21 datafusion:vortex-compact +37.0% +27.7% +7.3% +15.5% ➖ noise
21 datafusion:vortex-file-compressed +47.2% +27.7% +15.3% +15.5% ➖ noise
21 duckdb:duckdb +32.1% +27.7% +3.5% +15.5% ➖ noise
21 duckdb:vortex-compact +25.3% +27.7% -1.9% +15.5% ➖ noise
21 duckdb:vortex-file-compressed +23.7% +27.7% -3.1% +15.5% ➖ noise
22 datafusion:arrow +25.0% +10.4% +13.2% +15.5% ➖ noise
22 datafusion:vortex-compact +18.1% +10.4% +7.0% +15.5% ➖ noise
22 datafusion:vortex-file-compressed +45.4% +10.4% +31.7% +15.5% 🚨 regression
22 duckdb:duckdb +15.7% +10.4% +4.8% +15.5% ➖ noise
22 duckdb:vortex-compact +18.8% +10.4% +7.6% +15.5% ➖ noise
22 duckdb:vortex-file-compressed +17.1% +10.4% +6.1% +15.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

File Size Changes (19 files changed, -0.0% overall, 1↑ 18↓)
File Scale Format Base HEAD Change %
orders_2.vortex 10.0 vortex-compact 114.78 MB 114.78 MB +744 B +0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 180.65 MB 180.65 MB 104 B -0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 180.47 MB 180.47 MB 104 B -0.0%
orders_0.vortex 10.0 vortex-file-compressed 163.92 MB 163.88 MB 42.88 KB -0.0%
orders_1.vortex 10.0 vortex-file-compressed 164.15 MB 164.10 MB 47.14 KB -0.0%
orders_2.vortex 10.0 vortex-file-compressed 164.00 MB 163.95 MB 55.59 KB -0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 133.23 MB 133.12 MB 105.69 KB -0.1%
lineitem_3.vortex 10.0 vortex-file-compressed 133.74 MB 133.63 MB 120.46 KB -0.1%
lineitem_5.vortex 10.0 vortex-file-compressed 133.86 MB 133.74 MB 121.22 KB -0.1%
lineitem_7.vortex 10.0 vortex-file-compressed 134.01 MB 133.88 MB 130.26 KB -0.1%
lineitem_8.vortex 10.0 vortex-file-compressed 134.06 MB 133.93 MB 130.34 KB -0.1%
lineitem_1.vortex 10.0 vortex-file-compressed 134.27 MB 134.13 MB 136.54 KB -0.1%
lineitem_10.vortex 10.0 vortex-file-compressed 134.51 MB 134.37 MB 142.78 KB -0.1%
lineitem_2.vortex 10.0 vortex-file-compressed 134.38 MB 134.24 MB 142.95 KB -0.1%
lineitem_9.vortex 10.0 vortex-file-compressed 134.65 MB 134.51 MB 143.27 KB -0.1%
lineitem_4.vortex 10.0 vortex-file-compressed 134.43 MB 134.29 MB 143.73 KB -0.1%
lineitem_0.vortex 10.0 vortex-file-compressed 134.65 MB 134.51 MB 144.06 KB -0.1%
lineitem_12.vortex 10.0 vortex-file-compressed 134.52 MB 134.37 MB 146.27 KB -0.1%
lineitem_11.vortex 10.0 vortex-file-compressed 134.87 MB 134.72 MB 158.87 KB -0.1%

Totals:

  • vortex-compact: 1.97 GB → 1.97 GB (+0.0%)
  • vortex-file-compressed: 2.70 GB → 2.70 GB (-0.1%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants