Benchmark reporting improvements (better engine-specific comparison, better file size comparison)

[AdamGS]

Summary

This PR includes two changes:

1. Merge the file size tracking into the timing stuff we already have, so its included in the same comment and has the same logic to figure out the baseline which is currently buggy.
2. Try and do inter-engine perf comparison, which is relevant when we do engine-specific work.

[github-actions]

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟢 Done	672a27e		2	Explore Profiling Data

Previous Runs (3)

Status	Commit	Job	Attempt	Link
🟢 Done	672a27e		1	Explore Profiling Data
🟢 Done	7bf4923		1	Explore Profiling Data
🟢 Done	e38aa5e		1	Explore Profiling Data

---

Powered by Polar Signals Cloud

[github-actions]

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.999x ➖

How to read Verdict and Engines

• Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
• Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
• Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

---

datafusion / vortex-file-compressed (0.999x ➖, 1↑ 2↓)

name	PR 672a27e (ns)	base 76b0ad8 (ns)	ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 🚀	102946875	116266930	0.89
polarsignals_q01/datafusion:vortex-file-compressed	261535639	266311737	0.98
polarsignals_q02/datafusion:vortex-file-compressed	21302821	23498894	0.91
polarsignals_q03/datafusion:vortex-file-compressed	253959419	268371560	0.95
polarsignals_q04/datafusion:vortex-file-compressed	11345287	10931474	1.04
polarsignals_q05/datafusion:vortex-file-compressed	14896234	14768256	1.01
polarsignals_q06/datafusion:vortex-file-compressed	17774451	17553054	1.01
polarsignals_q07/datafusion:vortex-file-compressed 🚨	13719770	12132667	1.13
polarsignals_q08/datafusion:vortex-file-compressed	393763968	393589368	1.00
polarsignals_q09/datafusion:vortex-file-compressed 🚨	11185542	10109113	1.11

---

No baseline file sizes found for base commit.

[github-actions]

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.4%
Engines: DataFusion No clear signal (+4.3%, environment too noisy confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): 0.986x ➖
Parquet (geomean): 0.963x ➖
Shifts: Parquet (control) -3.7% · Median polish -0.8%

How to read Verdict and Engines

• Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
• Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
• Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

---

datafusion / vortex-file-compressed (0.980x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 76b0ad8 (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed	5398826	5624502	0.96
fineweb_q01/datafusion:vortex-file-compressed	23144859	22521775	1.03
fineweb_q02/datafusion:vortex-file-compressed	22751087	22568602	1.01
fineweb_q03/datafusion:vortex-file-compressed	83443182	89372948	0.93
fineweb_q04/datafusion:vortex-file-compressed	231891150	225944007	1.03
fineweb_q05/datafusion:vortex-file-compressed	213387828	224529905	0.95
fineweb_q06/datafusion:vortex-file-compressed	52624636	52928058	0.99
fineweb_q07/datafusion:vortex-file-compressed	57536582	60148508	0.96
fineweb_q08/datafusion:vortex-file-compressed	20890073	21481615	0.97

datafusion / vortex-compact (0.985x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 76b0ad8 (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-compact	5490519	5729346	0.96
fineweb_q01/datafusion:vortex-compact	97005998	98652748	0.98
fineweb_q02/datafusion:vortex-compact	105488099	105189313	1.00
fineweb_q03/datafusion:vortex-compact	883835019	876238534	1.01
fineweb_q04/datafusion:vortex-compact	918539999	921130224	1.00
fineweb_q05/datafusion:vortex-compact	824221322	828326856	1.00
fineweb_q06/datafusion:vortex-compact	465901785	472635415	0.99
fineweb_q07/datafusion:vortex-compact	489854286	490280992	1.00
fineweb_q08/datafusion:vortex-compact	18226431	19401870	0.94

datafusion / parquet (0.943x ➖, 1↑ 0↓)

name	PR 672a27e (ns)	base 76b0ad8 (ns)	ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀	5925635	7313571	0.81
fineweb_q01/datafusion:parquet	284091006	311511575	0.91
fineweb_q02/datafusion:parquet	292129092	309517711	0.94
fineweb_q03/datafusion:parquet	295336537	295116342	1.00
fineweb_q04/datafusion:parquet	299144706	309622695	0.97
fineweb_q05/datafusion:parquet	300161790	317013823	0.95
fineweb_q06/datafusion:parquet	292559444	300798250	0.97
fineweb_q07/datafusion:parquet	288291250	292892308	0.98
fineweb_q08/datafusion:parquet	278935908	289821121	0.96

duckdb / vortex-file-compressed (0.979x ➖, 1↑ 0↓)

name	PR 672a27e (ns)	base 76b0ad8 (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀	3491455	3956928	0.88
fineweb_q01/duckdb:vortex-file-compressed	22326760	23126728	0.97
fineweb_q02/duckdb:vortex-file-compressed	22223408	23811554	0.93
fineweb_q03/duckdb:vortex-file-compressed	129027472	121096481	1.07
fineweb_q04/duckdb:vortex-file-compressed	220797947	221248679	1.00
fineweb_q05/duckdb:vortex-file-compressed	210797987	209492844	1.01
fineweb_q06/duckdb:vortex-file-compressed	54746118	53658739	1.02
fineweb_q07/duckdb:vortex-file-compressed	56292514	56790538	0.99
fineweb_q08/duckdb:vortex-file-compressed	21976694	22780290	0.96

duckdb / vortex-compact (0.999x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 76b0ad8 (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-compact	4286667	4358190	0.98
fineweb_q01/duckdb:vortex-compact	103418901	101815250	1.02
fineweb_q02/duckdb:vortex-compact	117697399	115929211	1.02
fineweb_q03/duckdb:vortex-compact	868866379	867878760	1.00
fineweb_q04/duckdb:vortex-compact	898877709	913293853	0.98
fineweb_q05/duckdb:vortex-compact	808056632	811439192	1.00
fineweb_q06/duckdb:vortex-compact	468772417	467004634	1.00
fineweb_q07/duckdb:vortex-compact	481565132	479022786	1.01
fineweb_q08/duckdb:vortex-compact	19129038	19465106	0.98

duckdb / parquet (0.983x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 76b0ad8 (ns)	ratio (PR/base)
fineweb_q00/duckdb:parquet	32335047	33072334	0.98
fineweb_q01/duckdb:parquet	90059518	86552609	1.04
fineweb_q02/duckdb:parquet	86413770	88616163	0.98
fineweb_q03/duckdb:parquet	319232875	322657548	0.99
fineweb_q04/duckdb:parquet	451761961	454315270	0.99
fineweb_q05/duckdb:parquet	416383142	420819130	0.99
fineweb_q06/duckdb:parquet	203743197	207430968	0.98
fineweb_q07/duckdb:parquet	215574488	223360462	0.97
fineweb_q08/duckdb:parquet	33888413	36266739	0.93

---

No baseline file sizes found for base commit.

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	datafusion:vortex-compact	-4.2%	-11.0%	+7.7%	+50.2%	➖ noise
0	datafusion:vortex-file-compressed	-4.0%	-11.0%	+7.8%	+52.2%	➖ noise
0	duckdb:vortex-compact	-1.6%	-11.0%	+10.5%	+49.4%	➖ noise
0	duckdb:vortex-file-compressed	-11.8%	-11.0%	-0.9%	+71.5%	➖ noise
1	datafusion:vortex-compact	-1.7%	-2.6%	+0.9%	+11.5%	➖ noise
1	datafusion:vortex-file-compressed	+2.8%	-2.6%	+5.5%	+25.6%	➖ noise
1	duckdb:vortex-compact	+1.6%	-2.6%	+4.3%	+21.5%	➖ noise
1	duckdb:vortex-file-compressed	-3.5%	-2.6%	-0.9%	+65.9%	➖ noise
2	datafusion:vortex-compact	+0.3%	-4.1%	+4.5%	+12.8%	➖ noise
2	datafusion:vortex-file-compressed	+0.8%	-4.1%	+5.1%	+11.9%	➖ noise
2	duckdb:vortex-compact	+1.5%	-4.1%	+5.8%	+10.4%	➖ noise
2	duckdb:vortex-file-compressed	-6.7%	-4.1%	-2.7%	+12.3%	➖ noise
3	datafusion:vortex-compact	+0.9%	-0.5%	+1.4%	+10.0%	➖ noise
3	datafusion:vortex-file-compressed	-6.6%	-0.5%	-6.2%	+18.1%	➖ noise
3	duckdb:vortex-compact	+0.1%	-0.5%	+0.6%	+10.0%	➖ noise
3	duckdb:vortex-file-compressed	+6.5%	-0.5%	+7.1%	+20.2%	➖ noise
4	datafusion:vortex-compact	-0.3%	-2.0%	+1.7%	+10.0%	➖ noise
4	datafusion:vortex-file-compressed	+2.6%	-2.0%	+4.7%	+10.0%	➖ noise
4	duckdb:vortex-compact	-1.6%	-2.0%	+0.4%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	-0.2%	-2.0%	+1.8%	+10.0%	➖ noise
5	datafusion:vortex-compact	-0.5%	-3.2%	+2.8%	+10.0%	➖ noise
5	datafusion:vortex-file-compressed	-5.0%	-3.2%	-1.8%	+10.0%	➖ noise
5	duckdb:vortex-compact	-0.4%	-3.2%	+2.9%	+10.0%	➖ noise
5	duckdb:vortex-file-compressed	+0.6%	-3.2%	+4.0%	+10.0%	➖ noise
6	datafusion:vortex-compact	-1.4%	-2.3%	+0.9%	+10.0%	➖ noise
6	datafusion:vortex-file-compressed	-0.6%	-2.3%	+1.7%	+10.0%	➖ noise
6	duckdb:vortex-compact	+0.4%	-2.3%	+2.7%	+10.0%	➖ noise
6	duckdb:vortex-file-compressed	+2.0%	-2.3%	+4.4%	+10.2%	➖ noise
7	datafusion:vortex-compact	-0.1%	-2.5%	+2.5%	+10.0%	➖ noise
7	datafusion:vortex-file-compressed	-4.3%	-2.5%	-1.9%	+13.7%	➖ noise
7	duckdb:vortex-compact	+0.5%	-2.5%	+3.1%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	-0.9%	-2.5%	+1.7%	+18.0%	➖ noise
8	datafusion:vortex-compact	-6.1%	-5.2%	-0.9%	+24.5%	➖ noise
8	datafusion:vortex-file-compressed	-2.8%	-5.2%	+2.5%	+27.2%	➖ noise
8	duckdb:vortex-compact	-1.7%	-5.2%	+3.6%	+10.0%	➖ noise
8	duckdb:vortex-file-compressed	-3.5%	-5.2%	+1.7%	+12.7%	➖ noise

[github-actions]

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.4%
Engines: DataFusion No clear signal (-0.9%, environment too noisy confidence) · DuckDB No clear signal (-2.0%, environment too noisy confidence)
Vortex (geomean): 0.935x ➖
Parquet (geomean): 0.947x ➖
Shifts: Parquet (control) -5.3% · Median polish -5.8%

How to read Verdict and Engines

• Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
• Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
• Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

---

datafusion / vortex-file-compressed (0.934x ➖, 1↑ 0↓)

name	PR 672a27e (ns)	base 76b0ad8 (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	49610525	53146474	0.93
tpch_q02/datafusion:vortex-file-compressed	22412753	24658164	0.91
tpch_q03/datafusion:vortex-file-compressed	28083325	29810249	0.94
tpch_q04/datafusion:vortex-file-compressed 🚀	20380508	23039953	0.88
tpch_q05/datafusion:vortex-file-compressed	47768449	52138287	0.92
tpch_q06/datafusion:vortex-file-compressed	10872160	11859352	0.92
tpch_q07/datafusion:vortex-file-compressed	54289814	58803243	0.92
tpch_q08/datafusion:vortex-file-compressed	40809375	43906823	0.93
tpch_q09/datafusion:vortex-file-compressed	53051025	54620444	0.97
tpch_q10/datafusion:vortex-file-compressed	39817928	42806602	0.93
tpch_q11/datafusion:vortex-file-compressed	16427050	17529572	0.94
tpch_q12/datafusion:vortex-file-compressed	24188511	25784678	0.94
tpch_q13/datafusion:vortex-file-compressed	25314958	26934115	0.94
tpch_q14/datafusion:vortex-file-compressed	16079929	17863355	0.90
tpch_q15/datafusion:vortex-file-compressed	24929638	26050388	0.96
tpch_q16/datafusion:vortex-file-compressed	20494586	21432963	0.96
tpch_q17/datafusion:vortex-file-compressed	70550289	72806066	0.97
tpch_q18/datafusion:vortex-file-compressed	82955437	87436651	0.95
tpch_q19/datafusion:vortex-file-compressed	20332979	22156668	0.92
tpch_q20/datafusion:vortex-file-compressed	29574385	30317275	0.98
tpch_q21/datafusion:vortex-file-compressed	71677928	78952248	0.91
tpch_q22/datafusion:vortex-file-compressed	12483053	13088071	0.95

datafusion / vortex-compact (0.935x ➖, 1↑ 0↓)

name	PR 672a27e (ns)	base 76b0ad8 (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact	57598853	62724308	0.92
tpch_q02/datafusion:vortex-compact	25748981	27218318	0.95
tpch_q03/datafusion:vortex-compact	28859656	30651489	0.94
tpch_q04/datafusion:vortex-compact	22131998	24050935	0.92
tpch_q05/datafusion:vortex-compact	51089250	55845784	0.91
tpch_q06/datafusion:vortex-compact	12635124	13370837	0.94
tpch_q07/datafusion:vortex-compact	59107776	63573524	0.93
tpch_q08/datafusion:vortex-compact	42837706	46001368	0.93
tpch_q09/datafusion:vortex-compact	56992413	58898191	0.97
tpch_q10/datafusion:vortex-compact	45130381	49734738	0.91
tpch_q11/datafusion:vortex-compact	17374595	18561434	0.94
tpch_q12/datafusion:vortex-compact	30940683	32387923	0.96
tpch_q13/datafusion:vortex-compact	31728107	34328943	0.92
tpch_q14/datafusion:vortex-compact	19084240	20193948	0.95
tpch_q15/datafusion:vortex-compact	30932710	32357161	0.96
tpch_q16/datafusion:vortex-compact	24737894	26155903	0.95
tpch_q17/datafusion:vortex-compact	68957843	74104439	0.93
tpch_q18/datafusion:vortex-compact 🚀	84158090	94121568	0.89
tpch_q19/datafusion:vortex-compact	29415854	31292717	0.94
tpch_q20/datafusion:vortex-compact	34198114	37187574	0.92
tpch_q21/datafusion:vortex-compact	77340938	81061765	0.95
tpch_q22/datafusion:vortex-compact	12601735	13375152	0.94

datafusion / parquet (0.932x ➖, 2↑ 0↓)

name	PR 672a27e (ns)	base 76b0ad8 (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet 🚀	110163573	129037627	0.85
tpch_q02/datafusion:parquet	62723250	65979733	0.95
tpch_q03/datafusion:parquet	70192811	74358328	0.94
tpch_q04/datafusion:parquet	43017023	47324155	0.91
tpch_q05/datafusion:parquet	93878465	99857070	0.94
tpch_q06/datafusion:parquet	42031153	39767469	1.06
tpch_q07/datafusion:parquet	106245968	112450210	0.94
tpch_q08/datafusion:parquet	89650791	98581257	0.91
tpch_q09/datafusion:parquet	125777079	134470101	0.94
tpch_q10/datafusion:parquet	110513257	118807556	0.93
tpch_q11/datafusion:parquet	40994743	43013252	0.95
tpch_q12/datafusion:parquet	77557470	80826407	0.96
tpch_q13/datafusion:parquet	198884354	219739820	0.91
tpch_q14/datafusion:parquet	45551402	49020252	0.93
tpch_q15/datafusion:parquet	63037460	60507092	1.04
tpch_q16/datafusion:parquet	41036327	45398225	0.90
tpch_q17/datafusion:parquet 🚀	132195027	159281025	0.83
tpch_q18/datafusion:parquet	165117551	172940500	0.95
tpch_q19/datafusion:parquet	77854956	83188743	0.94
tpch_q20/datafusion:parquet	68324811	75271354	0.91
tpch_q21/datafusion:parquet	131268554	142915996	0.92
tpch_q22/datafusion:parquet	30638937	33696716	0.91

datafusion / arrow (0.903x ➖, 10↑ 0↓)

name	PR 672a27e (ns)	base 76b0ad8 (ns)	ratio (PR/base)
tpch_q01/datafusion:arrow 🚀	51713397	65789191	0.79
tpch_q02/datafusion:arrow	18732876	19626607	0.95
tpch_q03/datafusion:arrow 🚀	28305446	33590912	0.84
tpch_q04/datafusion:arrow	25805316	27830715	0.93
tpch_q05/datafusion:arrow	83261644	79311710	1.05
tpch_q06/datafusion:arrow	21093836	21073164	1.00
tpch_q07/datafusion:arrow	100327233	107305520	0.93
tpch_q08/datafusion:arrow 🚀	40450897	48437066	0.84
tpch_q09/datafusion:arrow 🚀	63298326	75062336	0.84
tpch_q10/datafusion:arrow 🚀	44925551	51568403	0.87
tpch_q11/datafusion:arrow	8828395	9662385	0.91
tpch_q12/datafusion:arrow	51557916	55917234	0.92
tpch_q13/datafusion:arrow	47173634	48822463	0.97
tpch_q14/datafusion:arrow 🚀	20659704	24305762	0.85
tpch_q15/datafusion:arrow 🚀	41106612	46675984	0.88
tpch_q16/datafusion:arrow	18884903	20463521	0.92
tpch_q17/datafusion:arrow 🚀	66321887	74404543	0.89
tpch_q18/datafusion:arrow	135834730	150251076	0.90
tpch_q19/datafusion:arrow 🚀	34934622	39088919	0.89
tpch_q20/datafusion:arrow 🚀	33580501	39377219	0.85
tpch_q21/datafusion:arrow	150488772	165022449	0.91
tpch_q22/datafusion:arrow	17666935	18776098	0.94

duckdb / vortex-file-compressed (0.930x ➖, 2↑ 0↓)

name	PR 672a27e (ns)	base 76b0ad8 (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	31334722	32527972	0.96
tpch_q02/duckdb:vortex-file-compressed	24389207	25891756	0.94
tpch_q03/duckdb:vortex-file-compressed	32904635	35116088	0.94
tpch_q04/duckdb:vortex-file-compressed	28137425	30194212	0.93
tpch_q05/duckdb:vortex-file-compressed	37213375	40001986	0.93
tpch_q06/duckdb:vortex-file-compressed 🚀	8345433	9466881	0.88
tpch_q07/duckdb:vortex-file-compressed	34441906	37749483	0.91
tpch_q08/duckdb:vortex-file-compressed	36602633	38627035	0.95
tpch_q09/duckdb:vortex-file-compressed	57721741	61242693	0.94
tpch_q10/duckdb:vortex-file-compressed	40775119	43826782	0.93
tpch_q11/duckdb:vortex-file-compressed	14663952	16075448	0.91
tpch_q12/duckdb:vortex-file-compressed	22558595	24351035	0.93
tpch_q13/duckdb:vortex-file-compressed	41426299	43925225	0.94
tpch_q14/duckdb:vortex-file-compressed	22142286	23153813	0.96
tpch_q15/duckdb:vortex-file-compressed	16952731	18291127	0.93
tpch_q16/duckdb:vortex-file-compressed	29318027	30324063	0.97
tpch_q17/duckdb:vortex-file-compressed	23934598	25514233	0.94
tpch_q18/duckdb:vortex-file-compressed	52336282	56105298	0.93
tpch_q19/duckdb:vortex-file-compressed 🚀	28473597	31669434	0.90
tpch_q20/duckdb:vortex-file-compressed	32269726	34831262	0.93
tpch_q21/duckdb:vortex-file-compressed	99360260	109512435	0.91
tpch_q22/duckdb:vortex-file-compressed	17099080	18788167	0.91

duckdb / vortex-compact (0.941x ➖, 1↑ 0↓)

name	PR 672a27e (ns)	base 76b0ad8 (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	38434036	39677329	0.97
tpch_q02/duckdb:vortex-compact	34027996	35023960	0.97
tpch_q03/duckdb:vortex-compact	34246489	37590611	0.91
tpch_q04/duckdb:vortex-compact	31548394	33006360	0.96
tpch_q05/duckdb:vortex-compact	40492587	44242609	0.92
tpch_q06/duckdb:vortex-compact	10801720	11927126	0.91
tpch_q07/duckdb:vortex-compact	41210566	43895652	0.94
tpch_q08/duckdb:vortex-compact	41612963	44072183	0.94
tpch_q09/duckdb:vortex-compact	65179922	68814352	0.95
tpch_q10/duckdb:vortex-compact	45090059	47640471	0.95
tpch_q11/duckdb:vortex-compact	18149881	19299976	0.94
tpch_q12/duckdb:vortex-compact	30543168	30900310	0.99
tpch_q13/duckdb:vortex-compact	46485093	48676721	0.95
tpch_q14/duckdb:vortex-compact	25732496	27490550	0.94
tpch_q15/duckdb:vortex-compact	19793937	21075824	0.94
tpch_q16/duckdb:vortex-compact	32686996	34360894	0.95
tpch_q17/duckdb:vortex-compact	29186724	30043012	0.97
tpch_q18/duckdb:vortex-compact	52981734	55624034	0.95
tpch_q19/duckdb:vortex-compact	32687984	36073182	0.91
tpch_q20/duckdb:vortex-compact	39465724	40833998	0.97
tpch_q21/duckdb:vortex-compact	101355866	111188890	0.91
tpch_q22/duckdb:vortex-compact 🚀	17793068	19951355	0.89

duckdb / parquet (0.962x ➖, 2↑ 0↓)

name	PR 672a27e (ns)	base 76b0ad8 (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	77049928	84051019	0.92
tpch_q02/duckdb:parquet	38829375	40888801	0.95
tpch_q03/duckdb:parquet	70273835	72940766	0.96
tpch_q04/duckdb:parquet	56948052	52241252	1.09
tpch_q05/duckdb:parquet	68832176	70192689	0.98
tpch_q06/duckdb:parquet	22384291	23090899	0.97
tpch_q07/duckdb:parquet	77875443	81634018	0.95
tpch_q08/duckdb:parquet	81945484	84356148	0.97
tpch_q09/duckdb:parquet	135703581	140943870	0.96
tpch_q10/duckdb:parquet	124708346	131193015	0.95
tpch_q11/duckdb:parquet	22205915	23753560	0.93
tpch_q12/duckdb:parquet 🚀	49500417	61106106	0.81
tpch_q13/duckdb:parquet	251804342	272730864	0.92
tpch_q14/duckdb:parquet	51114052	53154529	0.96
tpch_q15/duckdb:parquet	28542240	26834020	1.06
tpch_q16/duckdb:parquet	58204775	60250415	0.97
tpch_q17/duckdb:parquet	56223546	51151995	1.10
tpch_q18/duckdb:parquet	118313550	121386177	0.97
tpch_q19/duckdb:parquet 🚀	68724355	76825015	0.89
tpch_q20/duckdb:parquet	65124980	66919996	0.97
tpch_q21/duckdb:parquet	171906689	184851035	0.93
tpch_q22/duckdb:parquet	53473902	55651268	0.96

duckdb / duckdb (0.957x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 76b0ad8 (ns)	ratio (PR/base)
tpch_q01/duckdb:duckdb	17533928	18153663	0.97
tpch_q02/duckdb:duckdb	14519283	15474410	0.94
tpch_q03/duckdb:duckdb	22377617	23443834	0.95
tpch_q04/duckdb:duckdb	22231888	22538280	0.99
tpch_q05/duckdb:duckdb	23753549	24526102	0.97
tpch_q06/duckdb:duckdb	7092842	7270589	0.98
tpch_q07/duckdb:duckdb	25198074	27277201	0.92
tpch_q08/duckdb:duckdb	24006486	25341251	0.95
tpch_q09/duckdb:duckdb	58433389	60429387	0.97
tpch_q10/duckdb:duckdb	51903824	54264475	0.96
tpch_q11/duckdb:duckdb	7098690	7852899	0.90
tpch_q12/duckdb:duckdb	17647570	18710036	0.94
tpch_q13/duckdb:duckdb	39279830	41009219	0.96
tpch_q14/duckdb:duckdb	21471793	23007226	0.93
tpch_q15/duckdb:duckdb	13704178	14119964	0.97
tpch_q16/duckdb:duckdb	26151769	27631827	0.95
tpch_q17/duckdb:duckdb	16415522	16540006	0.99
tpch_q18/duckdb:duckdb	40835420	41723057	0.98
tpch_q19/duckdb:duckdb	31209578	32812507	0.95
tpch_q20/duckdb:duckdb	25998151	25868453	1.01
tpch_q21/duckdb:duckdb	61692991	65126393	0.95
tpch_q22/duckdb:duckdb	25473366	26761488	0.95

---

No baseline file sizes found for base commit.

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:arrow	-21.4%	-11.5%	-11.1%	+20.6%	➖ noise
1	datafusion:vortex-compact	-8.2%	-11.5%	+3.8%	+20.6%	➖ noise
1	datafusion:vortex-file-compressed	-6.7%	-11.5%	+5.5%	+20.0%	➖ noise
1	duckdb:duckdb	-3.4%	-11.5%	+9.2%	+20.4%	➖ noise
1	duckdb:vortex-compact	-3.1%	-11.5%	+9.5%	+18.3%	➖ noise
1	duckdb:vortex-file-compressed	-3.7%	-11.5%	+8.9%	+20.5%	➖ noise
2	datafusion:arrow	-4.6%	-5.0%	+0.5%	+10.6%	➖ noise
2	datafusion:vortex-compact	-5.4%	-5.0%	-0.4%	+10.6%	➖ noise
2	datafusion:vortex-file-compressed	-9.1%	-5.0%	-4.3%	+12.9%	➖ noise
2	duckdb:duckdb	-6.2%	-5.0%	-1.2%	+10.6%	➖ noise
2	duckdb:vortex-compact	-2.8%	-5.0%	+2.3%	+13.2%	➖ noise
2	duckdb:vortex-file-compressed	-5.8%	-5.0%	-0.9%	+10.6%	➖ noise
3	datafusion:arrow	-15.7%	-4.6%	-11.6%	+10.6%	✅ faster
3	datafusion:vortex-compact	-5.8%	-4.6%	-1.3%	+10.6%	➖ noise
3	datafusion:vortex-file-compressed	-5.8%	-4.6%	-1.2%	+10.6%	➖ noise
3	duckdb:duckdb	-4.5%	-4.6%	+0.1%	+10.6%	➖ noise
3	duckdb:vortex-compact	-8.9%	-4.6%	-4.5%	+10.6%	➖ noise
3	duckdb:vortex-file-compressed	-6.3%	-4.6%	-1.7%	+10.9%	➖ noise
4	datafusion:arrow	-7.3%	-0.5%	-6.9%	+10.6%	➖ noise
4	datafusion:vortex-compact	-8.0%	-0.5%	-7.6%	+12.7%	➖ noise
4	datafusion:vortex-file-compressed	-11.5%	-0.5%	-11.1%	+11.2%	✅ faster
4	duckdb:duckdb	-1.4%	-0.5%	-0.9%	+10.6%	➖ noise
4	duckdb:vortex-compact	-4.4%	-0.5%	-4.0%	+12.2%	➖ noise
4	duckdb:vortex-file-compressed	-6.8%	-0.5%	-6.4%	+10.6%	➖ noise
5	datafusion:arrow	+5.0%	-4.0%	+9.3%	+10.9%	➖ noise
5	datafusion:vortex-compact	-8.5%	-4.0%	-4.7%	+10.6%	➖ noise
5	datafusion:vortex-file-compressed	-8.4%	-4.0%	-4.6%	+10.6%	➖ noise
5	duckdb:duckdb	-3.1%	-4.0%	+0.9%	+10.6%	➖ noise
5	duckdb:vortex-compact	-8.5%	-4.0%	-4.7%	+10.6%	➖ noise
5	duckdb:vortex-file-compressed	-7.0%	-4.0%	-3.1%	+11.4%	➖ noise
6	datafusion:arrow	+0.1%	+1.2%	-1.1%	+13.8%	➖ noise
6	datafusion:vortex-compact	-5.5%	+1.2%	-6.6%	+18.0%	➖ noise
6	datafusion:vortex-file-compressed	-8.3%	+1.2%	-9.4%	+26.0%	➖ noise
6	duckdb:duckdb	-2.4%	+1.2%	-3.6%	+13.6%	➖ noise
6	duckdb:vortex-compact	-9.4%	+1.2%	-10.5%	+23.8%	➖ noise
6	duckdb:vortex-file-compressed	-11.8%	+1.2%	-12.9%	+14.7%	✅ faster
7	datafusion:arrow	-6.5%	-5.1%	-1.5%	+10.6%	➖ noise
7	datafusion:vortex-compact	-7.0%	-5.1%	-2.1%	+10.6%	➖ noise
7	datafusion:vortex-file-compressed	-7.7%	-5.1%	-2.8%	+10.6%	➖ noise
7	duckdb:duckdb	-7.6%	-5.1%	-2.7%	+10.6%	➖ noise
7	duckdb:vortex-compact	-6.1%	-5.1%	-1.1%	+10.6%	➖ noise
7	duckdb:vortex-file-compressed	-8.8%	-5.1%	-3.9%	+10.6%	➖ noise
8	datafusion:arrow	-16.5%	-6.0%	-11.1%	+11.8%	✅ faster
8	datafusion:vortex-compact	-6.9%	-6.0%	-0.9%	+10.6%	➖ noise
8	datafusion:vortex-file-compressed	-7.1%	-6.0%	-1.1%	+10.6%	➖ noise
8	duckdb:duckdb	-5.3%	-6.0%	+0.8%	+10.6%	➖ noise
8	duckdb:vortex-compact	-5.6%	-6.0%	+0.5%	+11.9%	➖ noise
8	duckdb:vortex-file-compressed	-5.2%	-6.0%	+0.8%	+10.6%	➖ noise
9	datafusion:arrow	-15.7%	-5.1%	-11.1%	+10.6%	✅ faster
9	datafusion:vortex-compact	-3.2%	-5.1%	+2.0%	+10.6%	➖ noise
9	datafusion:vortex-file-compressed	-2.9%	-5.1%	+2.3%	+10.6%	➖ noise
9	duckdb:duckdb	-3.3%	-5.1%	+1.9%	+10.6%	➖ noise
9	duckdb:vortex-compact	-5.3%	-5.1%	-0.2%	+10.6%	➖ noise
9	duckdb:vortex-file-compressed	-5.7%	-5.1%	-0.7%	+10.6%	➖ noise
10	datafusion:arrow	-12.9%	-6.0%	-7.4%	+10.6%	➖ noise
10	datafusion:vortex-compact	-9.3%	-6.0%	-3.5%	+10.6%	➖ noise
10	datafusion:vortex-file-compressed	-7.0%	-6.0%	-1.1%	+10.6%	➖ noise
10	duckdb:duckdb	-4.4%	-6.0%	+1.7%	+10.6%	➖ noise
10	duckdb:vortex-compact	-5.4%	-6.0%	+0.7%	+10.6%	➖ noise
10	duckdb:vortex-file-compressed	-7.0%	-6.0%	-1.1%	+10.6%	➖ noise
11	datafusion:arrow	-8.6%	-5.6%	-3.2%	+10.6%	➖ noise
11	datafusion:vortex-compact	-6.4%	-5.6%	-0.8%	+11.7%	➖ noise
11	datafusion:vortex-file-compressed	-6.3%	-5.6%	-0.7%	+10.6%	➖ noise
11	duckdb:duckdb	-9.6%	-5.6%	-4.2%	+10.6%	➖ noise
11	duckdb:vortex-compact	-6.0%	-5.6%	-0.4%	+21.5%	➖ noise
11	duckdb:vortex-file-compressed	-8.8%	-5.6%	-3.4%	+17.6%	➖ noise
12	datafusion:arrow	-7.8%	-11.8%	+4.6%	+19.8%	➖ noise
12	datafusion:vortex-compact	-4.5%	-11.8%	+8.4%	+12.6%	➖ noise
12	datafusion:vortex-file-compressed	-6.2%	-11.8%	+6.4%	+13.8%	➖ noise
12	duckdb:duckdb	-5.7%	-11.8%	+7.0%	+10.6%	➖ noise
12	duckdb:vortex-compact	-1.2%	-11.8%	+12.1%	+10.6%	🚨 regression
12	duckdb:vortex-file-compressed	-7.4%	-11.8%	+5.1%	+13.7%	➖ noise
13	datafusion:arrow	-3.4%	-8.6%	+5.7%	+10.6%	➖ noise
13	datafusion:vortex-compact	-7.6%	-8.6%	+1.1%	+10.6%	➖ noise
13	datafusion:vortex-file-compressed	-6.0%	-8.6%	+2.8%	+10.6%	➖ noise
13	duckdb:duckdb	-4.2%	-8.6%	+4.8%	+12.2%	➖ noise
13	duckdb:vortex-compact	-4.5%	-8.6%	+4.5%	+10.6%	➖ noise
13	duckdb:vortex-file-compressed	-5.7%	-8.6%	+3.2%	+10.6%	➖ noise
14	datafusion:arrow	-15.0%	-5.5%	-10.1%	+14.9%	➖ noise
14	datafusion:vortex-compact	-5.5%	-5.5%	-0.0%	+11.5%	➖ noise
14	datafusion:vortex-file-compressed	-10.0%	-5.5%	-4.8%	+18.1%	➖ noise
14	duckdb:duckdb	-6.7%	-5.5%	-1.3%	+10.6%	➖ noise
14	duckdb:vortex-compact	-6.4%	-5.5%	-1.0%	+10.6%	➖ noise
14	duckdb:vortex-file-compressed	-4.4%	-5.5%	+1.2%	+12.8%	➖ noise
15	datafusion:arrow	-11.9%	+5.3%	-16.3%	+11.7%	✅ faster
15	datafusion:vortex-compact	-4.4%	+5.3%	-9.2%	+13.7%	➖ noise
15	datafusion:vortex-file-compressed	-4.3%	+5.3%	-9.1%	+12.7%	➖ noise
15	duckdb:duckdb	-2.9%	+5.3%	-7.8%	+12.1%	➖ noise
15	duckdb:vortex-compact	-6.1%	+5.3%	-10.8%	+13.2%	➖ noise
15	duckdb:vortex-file-compressed	-7.3%	+5.3%	-12.0%	+16.1%	➖ noise
16	datafusion:arrow	-7.7%	-6.6%	-1.2%	+10.6%	➖ noise
16	datafusion:vortex-compact	-5.4%	-6.6%	+1.2%	+10.6%	➖ noise
16	datafusion:vortex-file-compressed	-4.4%	-6.6%	+2.3%	+10.6%	➖ noise
16	duckdb:duckdb	-5.4%	-6.6%	+1.3%	+10.6%	➖ noise
16	duckdb:vortex-compact	-4.9%	-6.6%	+1.8%	+10.6%	➖ noise
16	duckdb:vortex-file-compressed	-3.3%	-6.6%	+3.5%	+10.6%	➖ noise
17	datafusion:arrow	-10.9%	-4.5%	-6.7%	+13.0%	➖ noise
17	datafusion:vortex-compact	-6.9%	-4.5%	-2.6%	+12.2%	➖ noise
17	datafusion:vortex-file-compressed	-3.1%	-4.5%	+1.5%	+10.6%	➖ noise
17	duckdb:duckdb	-0.8%	-4.5%	+3.9%	+10.6%	➖ noise
17	duckdb:vortex-compact	-2.9%	-4.5%	+1.7%	+10.6%	➖ noise
17	duckdb:vortex-file-compressed	-6.2%	-4.5%	-1.8%	+12.5%	➖ noise
18	datafusion:arrow	-9.6%	-3.5%	-6.3%	+10.6%	➖ noise
18	datafusion:vortex-compact	-10.6%	-3.5%	-7.3%	+10.6%	➖ noise
18	datafusion:vortex-file-compressed	-5.1%	-3.5%	-1.7%	+10.6%	➖ noise
18	duckdb:duckdb	-2.1%	-3.5%	+1.5%	+10.6%	➖ noise
18	duckdb:vortex-compact	-4.8%	-3.5%	-1.3%	+10.6%	➖ noise
18	duckdb:vortex-file-compressed	-6.7%	-3.5%	-3.3%	+10.6%	➖ noise
19	datafusion:arrow	-10.6%	-8.5%	-2.3%	+18.2%	➖ noise
19	datafusion:vortex-compact	-6.0%	-8.5%	+2.7%	+13.0%	➖ noise
19	datafusion:vortex-file-compressed	-8.2%	-8.5%	+0.3%	+17.0%	➖ noise
19	duckdb:duckdb	-4.9%	-8.5%	+4.0%	+12.2%	➖ noise
19	duckdb:vortex-compact	-9.4%	-8.5%	-1.0%	+11.3%	➖ noise
19	duckdb:vortex-file-compressed	-10.1%	-8.5%	-1.7%	+12.3%	➖ noise
20	datafusion:arrow	-14.7%	-6.0%	-9.3%	+11.5%	➖ noise
20	datafusion:vortex-compact	-8.0%	-6.0%	-2.2%	+12.0%	➖ noise
20	datafusion:vortex-file-compressed	-2.5%	-6.0%	+3.8%	+10.6%	➖ noise
20	duckdb:duckdb	+0.5%	-6.0%	+6.9%	+10.6%	➖ noise
20	duckdb:vortex-compact	-3.4%	-6.0%	+2.8%	+10.6%	➖ noise
20	duckdb:vortex-file-compressed	-7.4%	-6.0%	-1.4%	+10.6%	➖ noise
21	datafusion:arrow	-8.8%	-7.6%	-1.3%	+10.6%	➖ noise
21	datafusion:vortex-compact	-4.6%	-7.6%	+3.2%	+10.6%	➖ noise
21	datafusion:vortex-file-compressed	-9.2%	-7.6%	-1.8%	+10.6%	➖ noise
21	duckdb:duckdb	-5.3%	-7.6%	+2.5%	+10.6%	➖ noise
21	duckdb:vortex-compact	-8.8%	-7.6%	-1.4%	+10.6%	➖ noise
21	duckdb:vortex-file-compressed	-9.3%	-7.6%	-1.8%	+10.6%	➖ noise
22	datafusion:arrow	-5.9%	-6.5%	+0.7%	+10.6%	➖ noise
22	datafusion:vortex-compact	-5.8%	-6.5%	+0.8%	+11.5%	➖ noise
22	datafusion:vortex-file-compressed	-4.6%	-6.5%	+2.0%	+13.5%	➖ noise
22	duckdb:duckdb	-4.8%	-6.5%	+1.8%	+10.6%	➖ noise
22	duckdb:vortex-compact	-10.8%	-6.5%	-4.6%	+10.6%	➖ noise
22	duckdb:vortex-file-compressed	-9.0%	-6.5%	-2.6%	+14.3%	➖ noise

[codspeed-hq]

Merging this PR will not alter performance

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

✅ 1261 untouched benchmarks

---

_{Comparing adamg/engine-level-analysis (e38aa5e) with develop (fab01a1)}

[github-actions]

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.0%
Engines: DataFusion No clear signal (+0.2%, environment too noisy confidence) · DuckDB No clear signal (-4.2%, low confidence)
Vortex (geomean): 0.933x ➖
Parquet (geomean): 0.951x ➖
Shifts: Parquet (control) -4.9% · Median polish -6.5%

How to read Verdict and Engines

• Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
• Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
• Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

---

datafusion / vortex-file-compressed (0.919x ➖, 34↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed	26435242	28299227	0.93
tpcds_q02/datafusion:vortex-file-compressed	47536730	51391197	0.92
tpcds_q03/datafusion:vortex-file-compressed	15238066	16697875	0.91
tpcds_q04/datafusion:vortex-file-compressed	263511847	281210116	0.94
tpcds_q05/datafusion:vortex-file-compressed	44873908	45793194	0.98
tpcds_q06/datafusion:vortex-file-compressed	58621555	59861742	0.98
tpcds_q07/datafusion:vortex-file-compressed 🚀	41405320	46549590	0.89
tpcds_q08/datafusion:vortex-file-compressed	28759271	30350397	0.95
tpcds_q09/datafusion:vortex-file-compressed	37852744	40106460	0.94
tpcds_q10/datafusion:vortex-file-compressed	38329976	41789513	0.92
tpcds_q11/datafusion:vortex-file-compressed 🚀	129004706	143684163	0.90
tpcds_q12/datafusion:vortex-file-compressed	20629175	20224278	1.02
tpcds_q13/datafusion:vortex-file-compressed	47696787	49020143	0.97
tpcds_q14/datafusion:vortex-file-compressed	174217708	181330041	0.96
tpcds_q15/datafusion:vortex-file-compressed	28396432	31294412	0.91
tpcds_q16/datafusion:vortex-file-compressed	29082459	32227191	0.90
tpcds_q17/datafusion:vortex-file-compressed 🚀	62247175	69432117	0.90
tpcds_q18/datafusion:vortex-file-compressed	71165979	73415718	0.97
tpcds_q19/datafusion:vortex-file-compressed	22865161	24233287	0.94
tpcds_q20/datafusion:vortex-file-compressed 🚀	20955518	24514068	0.85
tpcds_q21/datafusion:vortex-file-compressed 🚀	34998804	39402166	0.89
tpcds_q22/datafusion:vortex-file-compressed 🚀	113797114	128926807	0.88
tpcds_q23/datafusion:vortex-file-compressed	150773095	165427554	0.91
tpcds_q24/datafusion:vortex-file-compressed	85756146	88323099	0.97
tpcds_q25/datafusion:vortex-file-compressed	66141068	69466128	0.95
tpcds_q26/datafusion:vortex-file-compressed	33943525	36169325	0.94
tpcds_q27/datafusion:vortex-file-compressed 🚀	102738341	117668414	0.87
tpcds_q28/datafusion:vortex-file-compressed	33284558	33666059	0.99
tpcds_q29/datafusion:vortex-file-compressed	61530481	66160321	0.93
tpcds_q30/datafusion:vortex-file-compressed 🚀	22932041	26139120	0.88
tpcds_q31/datafusion:vortex-file-compressed	75821478	78711634	0.96
tpcds_q32/datafusion:vortex-file-compressed	19612432	21348012	0.92
tpcds_q33/datafusion:vortex-file-compressed	29226784	32157341	0.91
tpcds_q34/datafusion:vortex-file-compressed 🚀	24022040	26901818	0.89
tpcds_q35/datafusion:vortex-file-compressed	47758083	48646732	0.98
tpcds_q36/datafusion:vortex-file-compressed	57491889	62507640	0.92
tpcds_q37/datafusion:vortex-file-compressed 🚀	22742568	26051595	0.87
tpcds_q38/datafusion:vortex-file-compressed 🚀	42708919	47927245	0.89
tpcds_q39/datafusion:vortex-file-compressed	106258622	111081205	0.96
tpcds_q40/datafusion:vortex-file-compressed	32745637	35194329	0.93
tpcds_q41/datafusion:vortex-file-compressed 🚀	15215666	16998137	0.90
tpcds_q42/datafusion:vortex-file-compressed 🚀	13601484	15517100	0.88
tpcds_q43/datafusion:vortex-file-compressed 🚀	18292162	20743160	0.88
tpcds_q44/datafusion:vortex-file-compressed	31681069	34920144	0.91
tpcds_q45/datafusion:vortex-file-compressed 🚀	27521259	31460177	0.87
tpcds_q46/datafusion:vortex-file-compressed	35894415	38404351	0.93
tpcds_q47/datafusion:vortex-file-compressed	130735526	141883003	0.92
tpcds_q48/datafusion:vortex-file-compressed	36737082	38084030	0.96
tpcds_q49/datafusion:vortex-file-compressed 🚀	58101026	66312567	0.88
tpcds_q50/datafusion:vortex-file-compressed 🚀	39650543	47233911	0.84
tpcds_q51/datafusion:vortex-file-compressed	92870086	93326900	1.00
tpcds_q52/datafusion:vortex-file-compressed	14603430	14806661	0.99
tpcds_q53/datafusion:vortex-file-compressed	21753048	22249674	0.98
tpcds_q54/datafusion:vortex-file-compressed 🚀	35226171	39410981	0.89
tpcds_q55/datafusion:vortex-file-compressed	14269359	15534983	0.92
tpcds_q56/datafusion:vortex-file-compressed	30238680	32872109	0.92
tpcds_q57/datafusion:vortex-file-compressed	106686558	112172770	0.95
tpcds_q58/datafusion:vortex-file-compressed	53477259	57981908	0.92
tpcds_q59/datafusion:vortex-file-compressed	56355251	58979415	0.96
tpcds_q60/datafusion:vortex-file-compressed	28932235	30854448	0.94
tpcds_q61/datafusion:vortex-file-compressed	41104435	43208064	0.95
tpcds_q62/datafusion:vortex-file-compressed 🚀	24171768	29581137	0.82
tpcds_q63/datafusion:vortex-file-compressed 🚀	21231961	23862692	0.89
tpcds_q64/datafusion:vortex-file-compressed	414659413	449248002	0.92
tpcds_q65/datafusion:vortex-file-compressed	40038220	41737735	0.96
tpcds_q66/datafusion:vortex-file-compressed 🚀	69315619	83614699	0.83
tpcds_q67/datafusion:vortex-file-compressed	149530292	155519148	0.96
tpcds_q68/datafusion:vortex-file-compressed 🚀	33447372	41346369	0.81
tpcds_q69/datafusion:vortex-file-compressed	37693238	39857150	0.95
tpcds_q70/datafusion:vortex-file-compressed	86244922	89292668	0.97
tpcds_q71/datafusion:vortex-file-compressed	23207607	24561214	0.94
tpcds_q72/datafusion:vortex-file-compressed 🚀	2199848671	2497134522	0.88
tpcds_q73/datafusion:vortex-file-compressed	22564936	24261786	0.93
tpcds_q74/datafusion:vortex-file-compressed	80175070	86419925	0.93
tpcds_q75/datafusion:vortex-file-compressed	109399138	116351657	0.94
tpcds_q76/datafusion:vortex-file-compressed	31757683	33235682	0.96
tpcds_q77/datafusion:vortex-file-compressed	40393074	42357697	0.95
tpcds_q78/datafusion:vortex-file-compressed	122487088	131761207	0.93
tpcds_q79/datafusion:vortex-file-compressed	28488437	30562551	0.93
tpcds_q80/datafusion:vortex-file-compressed 🚀	92528842	107377549	0.86
tpcds_q81/datafusion:vortex-file-compressed	24024396	26308315	0.91
tpcds_q82/datafusion:vortex-file-compressed 🚀	25159375	28551809	0.88
tpcds_q83/datafusion:vortex-file-compressed	35185862	37080379	0.95
tpcds_q84/datafusion:vortex-file-compressed 🚀	13055838	15275732	0.85
tpcds_q85/datafusion:vortex-file-compressed	93926273	103317204	0.91
tpcds_q86/datafusion:vortex-file-compressed	17338883	17309961	1.00
tpcds_q87/datafusion:vortex-file-compressed 🚀	42998468	47974247	0.90
tpcds_q88/datafusion:vortex-file-compressed 🚀	55991243	64332599	0.87
tpcds_q89/datafusion:vortex-file-compressed 🚀	24851458	28512581	0.87
tpcds_q90/datafusion:vortex-file-compressed	14505893	16102321	0.90
tpcds_q91/datafusion:vortex-file-compressed 🚀	18478459	20774141	0.89
tpcds_q92/datafusion:vortex-file-compressed 🚀	17635809	20193589	0.87
tpcds_q93/datafusion:vortex-file-compressed	33611969	35725845	0.94
tpcds_q94/datafusion:vortex-file-compressed 🚀	22912789	25687495	0.89
tpcds_q95/datafusion:vortex-file-compressed 🚀	61442883	69145140	0.89
tpcds_q96/datafusion:vortex-file-compressed	14282797	14361027	0.99
tpcds_q97/datafusion:vortex-file-compressed	31664134	34660427	0.91
tpcds_q98/datafusion:vortex-file-compressed	23734578	25517258	0.93
tpcds_q99/datafusion:vortex-file-compressed 🚀	28167391	33324503	0.85

datafusion / vortex-compact (0.939x ➖, 15↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
tpcds_q01/datafusion:vortex-compact	24724227	27205732	0.91
tpcds_q02/datafusion:vortex-compact	53844154	58557173	0.92
tpcds_q03/datafusion:vortex-compact	22133126	21255149	1.04
tpcds_q04/datafusion:vortex-compact	291975440	310107611	0.94
tpcds_q05/datafusion:vortex-compact 🚀	50064507	57062577	0.88
tpcds_q06/datafusion:vortex-compact	63099515	61682697	1.02
tpcds_q07/datafusion:vortex-compact	52671195	55525338	0.95
tpcds_q08/datafusion:vortex-compact	35246035	38087343	0.93
tpcds_q09/datafusion:vortex-compact	52921870	56714712	0.93
tpcds_q10/datafusion:vortex-compact	50260812	50344523	1.00
tpcds_q11/datafusion:vortex-compact	150861216	164856422	0.92
tpcds_q12/datafusion:vortex-compact	22439923	24688651	0.91
tpcds_q13/datafusion:vortex-compact	134109783	124634276	1.08
tpcds_q14/datafusion:vortex-compact	200525653	203333419	0.99
tpcds_q15/datafusion:vortex-compact	30516755	31733152	0.96
tpcds_q16/datafusion:vortex-compact	32464484	33916058	0.96
tpcds_q17/datafusion:vortex-compact	75328783	79147281	0.95
tpcds_q18/datafusion:vortex-compact	78844495	82690973	0.95
tpcds_q19/datafusion:vortex-compact	29710439	31337315	0.95
tpcds_q20/datafusion:vortex-compact	26210583	28101173	0.93
tpcds_q21/datafusion:vortex-compact	39741425	42618708	0.93
tpcds_q22/datafusion:vortex-compact 🚀	117598145	151892140	0.77
tpcds_q23/datafusion:vortex-compact	164494246	179758971	0.92
tpcds_q24/datafusion:vortex-compact	96609764	102912827	0.94
tpcds_q25/datafusion:vortex-compact	78500103	81768257	0.96
tpcds_q26/datafusion:vortex-compact	43550469	45567628	0.96
tpcds_q27/datafusion:vortex-compact	124748166	135099532	0.92
tpcds_q28/datafusion:vortex-compact	97019343	102779285	0.94
tpcds_q29/datafusion:vortex-compact	73503822	79978932	0.92
tpcds_q30/datafusion:vortex-compact	28263487	30304286	0.93
tpcds_q31/datafusion:vortex-compact	98497807	106109252	0.93
tpcds_q32/datafusion:vortex-compact 🚀	24798983	28441264	0.87
tpcds_q33/datafusion:vortex-compact	37043033	38247169	0.97
tpcds_q34/datafusion:vortex-compact	32827357	35420529	0.93
tpcds_q35/datafusion:vortex-compact 🚀	51599344	58246551	0.89
tpcds_q36/datafusion:vortex-compact	76431923	81418230	0.94
tpcds_q37/datafusion:vortex-compact	33153098	36670227	0.90
tpcds_q38/datafusion:vortex-compact	52389507	53690528	0.98
tpcds_q39/datafusion:vortex-compact 🚀	108723105	127394382	0.85
tpcds_q40/datafusion:vortex-compact	36264187	39268169	0.92
tpcds_q41/datafusion:vortex-compact 🚀	17439535	19589663	0.89
tpcds_q42/datafusion:vortex-compact	18683373	20365979	0.92
tpcds_q43/datafusion:vortex-compact 🚀	25273777	28321628	0.89
tpcds_q44/datafusion:vortex-compact	47692511	50549914	0.94
tpcds_q45/datafusion:vortex-compact	32056209	32581374	0.98
tpcds_q46/datafusion:vortex-compact	45463030	46843505	0.97
tpcds_q47/datafusion:vortex-compact	152457833	161192680	0.95
tpcds_q48/datafusion:vortex-compact	98856772	103045548	0.96
tpcds_q49/datafusion:vortex-compact	70337975	72329014	0.97
tpcds_q50/datafusion:vortex-compact	46818151	51051372	0.92
tpcds_q51/datafusion:vortex-compact	99451065	102740154	0.97
tpcds_q52/datafusion:vortex-compact	18704673	19424938	0.96
tpcds_q53/datafusion:vortex-compact	29212303	29823341	0.98
tpcds_q54/datafusion:vortex-compact	42921631	44352872	0.97
tpcds_q55/datafusion:vortex-compact	17984749	19750146	0.91
tpcds_q56/datafusion:vortex-compact 🚀	35591464	40982876	0.87
tpcds_q57/datafusion:vortex-compact	116717850	120386348	0.97
tpcds_q58/datafusion:vortex-compact	61651689	67768937	0.91
tpcds_q59/datafusion:vortex-compact	69442186	72451225	0.96
tpcds_q60/datafusion:vortex-compact	37704520	38900273	0.97
tpcds_q61/datafusion:vortex-compact	55837639	57877419	0.96
tpcds_q62/datafusion:vortex-compact 🚀	30829856	34778153	0.89
tpcds_q63/datafusion:vortex-compact	29081287	31379121	0.93
tpcds_q64/datafusion:vortex-compact	463817315	512979100	0.90
tpcds_q65/datafusion:vortex-compact	53882162	57995271	0.93
tpcds_q66/datafusion:vortex-compact	77462990	77909387	0.99
tpcds_q67/datafusion:vortex-compact	159350705	159588817	1.00
tpcds_q68/datafusion:vortex-compact	44343947	46806670	0.95
tpcds_q69/datafusion:vortex-compact	45611649	48090069	0.95
tpcds_q70/datafusion:vortex-compact	99227389	99760772	0.99
tpcds_q71/datafusion:vortex-compact	30232777	30650120	0.99
tpcds_q72/datafusion:vortex-compact 🚀	2222556038	2504356898	0.89
tpcds_q73/datafusion:vortex-compact	31725576	34050527	0.93
tpcds_q74/datafusion:vortex-compact	95665542	101653244	0.94
tpcds_q75/datafusion:vortex-compact	134358164	136921347	0.98
tpcds_q76/datafusion:vortex-compact	32420327	33063628	0.98
tpcds_q77/datafusion:vortex-compact	53750627	55067230	0.98
tpcds_q78/datafusion:vortex-compact	139148942	146260283	0.95
tpcds_q79/datafusion:vortex-compact	37629402	40070509	0.94
tpcds_q80/datafusion:vortex-compact 🚀	104225252	118603550	0.88
tpcds_q81/datafusion:vortex-compact	30729985	30433388	1.01
tpcds_q82/datafusion:vortex-compact	37160216	38068101	0.98
tpcds_q83/datafusion:vortex-compact 🚀	33514619	41716750	0.80
tpcds_q84/datafusion:vortex-compact	14800835	15837595	0.93
tpcds_q85/datafusion:vortex-compact	164256656	168053049	0.98
tpcds_q86/datafusion:vortex-compact 🚀	19135560	22638203	0.85
tpcds_q87/datafusion:vortex-compact	53384417	56682737	0.94
tpcds_q88/datafusion:vortex-compact	80881810	80302839	1.01
tpcds_q89/datafusion:vortex-compact 🚀	31669065	39264159	0.81
tpcds_q90/datafusion:vortex-compact	15966927	16817624	0.95
tpcds_q91/datafusion:vortex-compact	32672734	34845235	0.94
tpcds_q92/datafusion:vortex-compact	24971842	26266327	0.95
tpcds_q93/datafusion:vortex-compact	38610049	41527094	0.93
tpcds_q94/datafusion:vortex-compact	28116753	27526769	1.02
tpcds_q95/datafusion:vortex-compact	69392779	71311089	0.97
tpcds_q96/datafusion:vortex-compact	18061780	18728807	0.96
tpcds_q97/datafusion:vortex-compact	37067301	39248360	0.94
tpcds_q98/datafusion:vortex-compact	30463992	31432662	0.97
tpcds_q99/datafusion:vortex-compact 🚀	30258394	35506625	0.85

datafusion / parquet (0.927x ➖, 21↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
tpcds_q01/datafusion:parquet 🚀	28668408	32895640	0.87
tpcds_q02/datafusion:parquet	41571006	45347981	0.92
tpcds_q03/datafusion:parquet	13215342	14439945	0.92
tpcds_q04/datafusion:parquet	257227164	277315797	0.93
tpcds_q05/datafusion:parquet	40828823	44486151	0.92
tpcds_q06/datafusion:parquet	58969751	59974691	0.98
tpcds_q07/datafusion:parquet	78633001	81719860	0.96
tpcds_q08/datafusion:parquet	26856383	27001636	0.99
tpcds_q09/datafusion:parquet	46402667	45344265	1.02
tpcds_q10/datafusion:parquet	70984049	69347393	1.02
tpcds_q11/datafusion:parquet	146598022	152489246	0.96
tpcds_q12/datafusion:parquet	17312704	18695064	0.93
tpcds_q13/datafusion:parquet	74601588	79729699	0.94
tpcds_q14/datafusion:parquet	164139813	173156092	0.95
tpcds_q15/datafusion:parquet 🚀	20848128	25186020	0.83
tpcds_q16/datafusion:parquet	23764202	25152142	0.94
tpcds_q17/datafusion:parquet 🚀	61991053	69535731	0.89
tpcds_q18/datafusion:parquet	113454231	124078568	0.91
tpcds_q19/datafusion:parquet	22730213	24182199	0.94
tpcds_q20/datafusion:parquet 🚀	16307187	18275727	0.89
tpcds_q21/datafusion:parquet 🚀	18348560	20769421	0.88
tpcds_q22/datafusion:parquet	151323903	156086663	0.97
tpcds_q23/datafusion:parquet	147626728	159191626	0.93
tpcds_q24/datafusion:parquet	92014004	95514459	0.96
tpcds_q25/datafusion:parquet	66710001	70685186	0.94
tpcds_q26/datafusion:parquet	65441712	67744047	0.97
tpcds_q27/datafusion:parquet	144403986	159550911	0.91
tpcds_q28/datafusion:parquet	44948763	47857869	0.94
tpcds_q29/datafusion:parquet	67250803	66903785	1.01
tpcds_q30/datafusion:parquet 🚀	33405975	39827247	0.84
tpcds_q31/datafusion:parquet	64209516	68802261	0.93
tpcds_q32/datafusion:parquet 🚀	17803058	19907441	0.89
tpcds_q33/datafusion:parquet	27696702	28802067	0.96
tpcds_q34/datafusion:parquet	21375779	22477701	0.95
tpcds_q35/datafusion:parquet 🚀	67585391	80452102	0.84
tpcds_q36/datafusion:parquet	57058275	61447187	0.93
tpcds_q37/datafusion:parquet	18805706	19564539	0.96
tpcds_q38/datafusion:parquet	41700535	42541894	0.98
tpcds_q39/datafusion:parquet 🚀	71963714	89520123	0.80
tpcds_q40/datafusion:parquet	24953272	26147765	0.95
tpcds_q41/datafusion:parquet 🚀	13079669	14700127	0.89
tpcds_q42/datafusion:parquet	11457411	12501268	0.92
tpcds_q43/datafusion:parquet	17236363	18596414	0.93
tpcds_q44/datafusion:parquet	33978602	36086998	0.94
tpcds_q45/datafusion:parquet	28043001	30265157	0.93
tpcds_q46/datafusion:parquet	32559942	34255338	0.95
tpcds_q47/datafusion:parquet	125477151	138657895	0.90
tpcds_q48/datafusion:parquet	68186010	74286236	0.92
tpcds_q49/datafusion:parquet	57162321	58313602	0.98
tpcds_q50/datafusion:parquet	45693786	46469760	0.98
tpcds_q51/datafusion:parquet	84900351	92372845	0.92
tpcds_q52/datafusion:parquet	11719073	12995707	0.90
tpcds_q53/datafusion:parquet	17450380	18121755	0.96
tpcds_q54/datafusion:parquet	34033719	37012790	0.92
tpcds_q55/datafusion:parquet	12171368	12318329	0.99
tpcds_q56/datafusion:parquet	27575911	30304718	0.91
tpcds_q57/datafusion:parquet 🚀	93455297	106261052	0.88
tpcds_q58/datafusion:parquet	51399836	53731342	0.96
tpcds_q59/datafusion:parquet	57709087	61611080	0.94
tpcds_q60/datafusion:parquet	26776434	29129090	0.92
tpcds_q61/datafusion:parquet	43563689	46856060	0.93
tpcds_q62/datafusion:parquet	25047598	23130412	1.08
tpcds_q63/datafusion:parquet	17857330	18559578	0.96
tpcds_q64/datafusion:parquet	511834952	549733938	0.93
tpcds_q65/datafusion:parquet	37607859	39728028	0.95
tpcds_q66/datafusion:parquet 🚀	67163623	78706431	0.85
tpcds_q67/datafusion:parquet	145887424	161936179	0.90
tpcds_q68/datafusion:parquet	31418251	34762922	0.90
tpcds_q69/datafusion:parquet	67105328	68172485	0.98
tpcds_q70/datafusion:parquet 🚀	88635747	100860475	0.88
tpcds_q71/datafusion:parquet 🚀	22313321	25067589	0.89
tpcds_q72/datafusion:parquet	606931849	673455510	0.90
tpcds_q73/datafusion:parquet	21101824	22758073	0.93
tpcds_q74/datafusion:parquet 🚀	83601066	100000935	0.84
tpcds_q75/datafusion:parquet	98985263	103128124	0.96
tpcds_q76/datafusion:parquet	34936204	33075873	1.06
tpcds_q77/datafusion:parquet 🚀	38563958	48141425	0.80
tpcds_q78/datafusion:parquet	111869435	123891614	0.90
tpcds_q79/datafusion:parquet	30882676	28185854	1.10
tpcds_q80/datafusion:parquet	78413047	86460287	0.91
tpcds_q81/datafusion:parquet 🚀	31230399	34750869	0.90
tpcds_q82/datafusion:parquet	18844516	20456463	0.92
tpcds_q83/datafusion:parquet	35984394	38367252	0.94
tpcds_q84/datafusion:parquet	41962236	46261163	0.91
tpcds_q85/datafusion:parquet	145142336	156989548	0.92
tpcds_q86/datafusion:parquet 🚀	15391701	21175707	0.73
tpcds_q87/datafusion:parquet	42296278	46139984	0.92
tpcds_q88/datafusion:parquet	60126339	64232826	0.94
tpcds_q89/datafusion:parquet	21534237	21625007	1.00
tpcds_q90/datafusion:parquet	14264868	15079630	0.95
tpcds_q91/datafusion:parquet 🚀	57291287	63694408	0.90
tpcds_q92/datafusion:parquet 🚀	17792092	20108802	0.88
tpcds_q93/datafusion:parquet	33043009	35919395	0.92
tpcds_q94/datafusion:parquet	19880120	20955374	0.95
tpcds_q95/datafusion:parquet	58711414	62386594	0.94
tpcds_q96/datafusion:parquet 🚀	12051414	13756703	0.88
tpcds_q97/datafusion:parquet	29117178	32297161	0.90
tpcds_q98/datafusion:parquet	22178819	23419090	0.95
tpcds_q99/datafusion:parquet	26019724	26547146	0.98

duckdb / vortex-file-compressed (0.938x ➖, 19↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed	25574699	25883158	0.99
tpcds_q02/duckdb:vortex-file-compressed	34737139	37120349	0.94
tpcds_q03/duckdb:vortex-file-compressed	22368942	23574895	0.95
tpcds_q04/duckdb:vortex-file-compressed	94372234	101036286	0.93
tpcds_q05/duckdb:vortex-file-compressed 🚀	30796529	35249932	0.87
tpcds_q06/duckdb:vortex-file-compressed	32690172	35711398	0.92
tpcds_q07/duckdb:vortex-file-compressed	22450635	22620367	0.99
tpcds_q08/duckdb:vortex-file-compressed	28060142	28543884	0.98
tpcds_q09/duckdb:vortex-file-compressed	17263383	16752797	1.03
tpcds_q10/duckdb:vortex-file-compressed	36970443	38800697	0.95
tpcds_q11/duckdb:vortex-file-compressed 🚀	64517170	72598528	0.89
tpcds_q12/duckdb:vortex-file-compressed	16333839	16642303	0.98
tpcds_q13/duckdb:vortex-file-compressed	32554132	33020950	0.99
tpcds_q14/duckdb:vortex-file-compressed	96520899	100846119	0.96
tpcds_q15/duckdb:vortex-file-compressed	27201440	29844752	0.91
tpcds_q16/duckdb:vortex-file-compressed	27548439	26999622	1.02
tpcds_q17/duckdb:vortex-file-compressed	44742590	46333982	0.97
tpcds_q18/duckdb:vortex-file-compressed 🚀	37339526	41943931	0.89
tpcds_q19/duckdb:vortex-file-compressed 🚀	32580576	36411064	0.89
tpcds_q20/duckdb:vortex-file-compressed 🚀	16876569	18778966	0.90
tpcds_q21/duckdb:vortex-file-compressed 🚀	16245161	18398541	0.88
tpcds_q22/duckdb:vortex-file-compressed	73312302	79643554	0.92
tpcds_q23/duckdb:vortex-file-compressed	96488438	97010676	0.99
tpcds_q24/duckdb:vortex-file-compressed	48336883	53006468	0.91
tpcds_q25/duckdb:vortex-file-compressed	42970516	45516201	0.94
tpcds_q26/duckdb:vortex-file-compressed	19377222	20787192	0.93
tpcds_q27/duckdb:vortex-file-compressed	23884989	25403054	0.94
tpcds_q28/duckdb:vortex-file-compressed 🚀	12717987	14209337	0.90
tpcds_q29/duckdb:vortex-file-compressed	40173262	43177052	0.93
tpcds_q30/duckdb:vortex-file-compressed	27831110	28143690	0.99
tpcds_q31/duckdb:vortex-file-compressed	31012170	29494418	1.05
tpcds_q32/duckdb:vortex-file-compressed	13585858	15022314	0.90
tpcds_q33/duckdb:vortex-file-compressed	23776329	26301060	0.90
tpcds_q34/duckdb:vortex-file-compressed	25369484	27532603	0.92
tpcds_q35/duckdb:vortex-file-compressed	64933408	66901114	0.97
tpcds_q36/duckdb:vortex-file-compressed	24740797	26363897	0.94
tpcds_q37/duckdb:vortex-file-compressed	19583368	20603077	0.95
tpcds_q38/duckdb:vortex-file-compressed	36492317	40091402	0.91
tpcds_q39/duckdb:vortex-file-compressed	35515521	36487564	0.97
tpcds_q40/duckdb:vortex-file-compressed 🚀	19618608	22381639	0.88
tpcds_q41/duckdb:vortex-file-compressed	10221788	11140668	0.92
tpcds_q42/duckdb:vortex-file-compressed	14053947	14477006	0.97
tpcds_q43/duckdb:vortex-file-compressed	21666871	22763742	0.95
tpcds_q44/duckdb:vortex-file-compressed	21379569	21306202	1.00
tpcds_q45/duckdb:vortex-file-compressed	30429900	32562612	0.93
tpcds_q46/duckdb:vortex-file-compressed 🚀	31254480	35694065	0.88
tpcds_q47/duckdb:vortex-file-compressed	52736423	55738038	0.95
tpcds_q48/duckdb:vortex-file-compressed	29121138	31147232	0.93
tpcds_q49/duckdb:vortex-file-compressed	36030688	35134580	1.03
tpcds_q50/duckdb:vortex-file-compressed 🚀	25486868	28600075	0.89
tpcds_q51/duckdb:vortex-file-compressed	107603330	110798487	0.97
tpcds_q52/duckdb:vortex-file-compressed	13940283	14078549	0.99
tpcds_q53/duckdb:vortex-file-compressed	22603063	22920137	0.99
tpcds_q54/duckdb:vortex-file-compressed	28764206	29730220	0.97
tpcds_q55/duckdb:vortex-file-compressed	12941851	13602559	0.95
tpcds_q56/duckdb:vortex-file-compressed	27882267	26161169	1.07
tpcds_q57/duckdb:vortex-file-compressed	41309917	42524981	0.97
tpcds_q58/duckdb:vortex-file-compressed	29218688	30165649	0.97
tpcds_q59/duckdb:vortex-file-compressed	55277959	57633987	0.96
tpcds_q60/duckdb:vortex-file-compressed	26464571	29063416	0.91
tpcds_q61/duckdb:vortex-file-compressed	30623075	32946270	0.93
tpcds_q62/duckdb:vortex-file-compressed	16086137	16712350	0.96
tpcds_q63/duckdb:vortex-file-compressed	20707636	22197939	0.93
tpcds_q64/duckdb:vortex-file-compressed	95574790	103421536	0.92
tpcds_q65/duckdb:vortex-file-compressed	22258927	23769093	0.94
tpcds_q66/duckdb:vortex-file-compressed	29851482	31755856	0.94
tpcds_q67/duckdb:vortex-file-compressed	142973784	154265743	0.93
tpcds_q68/duckdb:vortex-file-compressed 🚀	30111550	34005442	0.89
tpcds_q69/duckdb:vortex-file-compressed	40100119	42641045	0.94
tpcds_q70/duckdb:vortex-file-compressed	38176138	38252822	1.00
tpcds_q71/duckdb:vortex-file-compressed	20216710	22240165	0.91
tpcds_q72/duckdb:vortex-file-compressed	171046036	174013187	0.98
tpcds_q73/duckdb:vortex-file-compressed	24908774	27081079	0.92
tpcds_q74/duckdb:vortex-file-compressed	41582450	43760675	0.95
tpcds_q75/duckdb:vortex-file-compressed	52650994	53078124	0.99
tpcds_q76/duckdb:vortex-file-compressed	21873202	23001202	0.95
tpcds_q77/duckdb:vortex-file-compressed	23847463	25759241	0.93
tpcds_q78/duckdb:vortex-file-compressed	77741899	81121248	0.96
tpcds_q79/duckdb:vortex-file-compressed 🚀	23915808	27520373	0.87
tpcds_q80/duckdb:vortex-file-compressed	49510040	53139250	0.93
tpcds_q81/duckdb:vortex-file-compressed	29697615	31402607	0.95
tpcds_q82/duckdb:vortex-file-compressed	45867427	47258732	0.97
tpcds_q83/duckdb:vortex-file-compressed	26604675	27353439	0.97
tpcds_q84/duckdb:vortex-file-compressed	16041420	17673572	0.91
tpcds_q85/duckdb:vortex-file-compressed	39783619	42858916	0.93
tpcds_q86/duckdb:vortex-file-compressed	17698002	17935839	0.99
tpcds_q87/duckdb:vortex-file-compressed	39939855	44282672	0.90
tpcds_q88/duckdb:vortex-file-compressed	50382671	53471499	0.94
tpcds_q89/duckdb:vortex-file-compressed 🚀	21231337	23638784	0.90
tpcds_q90/duckdb:vortex-file-compressed 🚀	9946943	11442930	0.87
tpcds_q91/duckdb:vortex-file-compressed 🚀	23053781	28683793	0.80
tpcds_q92/duckdb:vortex-file-compressed 🚀	18528143	21206831	0.87
tpcds_q93/duckdb:vortex-file-compressed	29675379	31978856	0.93
tpcds_q94/duckdb:vortex-file-compressed 🚀	21469598	24599497	0.87
tpcds_q95/duckdb:vortex-file-compressed 🚀	146360721	168251601	0.87
tpcds_q96/duckdb:vortex-file-compressed 🚀	11737985	13943494	0.84
tpcds_q97/duckdb:vortex-file-compressed	38381186	41195207	0.93
tpcds_q98/duckdb:vortex-file-compressed	21255393	21480056	0.99
tpcds_q99/duckdb:vortex-file-compressed	22042850	24336909	0.91

duckdb / vortex-compact (0.935x ➖, 19↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚀	25513145	28597876	0.89
tpcds_q02/duckdb:vortex-compact	38445344	41385660	0.93
tpcds_q03/duckdb:vortex-compact	48693806	49987672	0.97
tpcds_q04/duckdb:vortex-compact 🚀	101358872	118896646	0.85
tpcds_q05/duckdb:vortex-compact	42955407	42254379	1.02
tpcds_q06/duckdb:vortex-compact 🚀	38462261	43154374	0.89
tpcds_q07/duckdb:vortex-compact	34548581	38174975	0.91
tpcds_q08/duckdb:vortex-compact	40890929	44295729	0.92
tpcds_q09/duckdb:vortex-compact	19544325	19727137	0.99
tpcds_q10/duckdb:vortex-compact	53009715	55745436	0.95
tpcds_q11/duckdb:vortex-compact	73867043	79023480	0.93
tpcds_q12/duckdb:vortex-compact	21652650	23749001	0.91
tpcds_q13/duckdb:vortex-compact	53426757	55405669	0.96
tpcds_q14/duckdb:vortex-compact	117583583	123062198	0.96
tpcds_q15/duckdb:vortex-compact 🚀	29709064	33537954	0.89
tpcds_q16/duckdb:vortex-compact 🚀	26419641	30616643	0.86
tpcds_q17/duckdb:vortex-compact	53509661	59144447	0.90
tpcds_q18/duckdb:vortex-compact	52702784	56049355	0.94
tpcds_q19/duckdb:vortex-compact	44066980	46171241	0.95
tpcds_q20/duckdb:vortex-compact 🚀	21041536	23537067	0.89
tpcds_q21/duckdb:vortex-compact	18166089	19786125	0.92
tpcds_q22/duckdb:vortex-compact	79643031	87994087	0.91
tpcds_q23/duckdb:vortex-compact	108042912	118801582	0.91
tpcds_q24/duckdb:vortex-compact 🚀	56563061	62953613	0.90
tpcds_q25/duckdb:vortex-compact	54997621	57383084	0.96
tpcds_q26/duckdb:vortex-compact	30883195	33689982	0.92
tpcds_q27/duckdb:vortex-compact	37232659	37651375	0.99
tpcds_q28/duckdb:vortex-compact	33886709	34794896	0.97
tpcds_q29/duckdb:vortex-compact 🚀	51425398	59871122	0.86
tpcds_q30/duckdb:vortex-compact	31704439	34287717	0.92
tpcds_q31/duckdb:vortex-compact	36734835	37601840	0.98
tpcds_q32/duckdb:vortex-compact 🚀	20727176	24816995	0.84
tpcds_q33/duckdb:vortex-compact 🚀	31937162	37958828	0.84
tpcds_q34/duckdb:vortex-compact	30482735	32367528	0.94
tpcds_q35/duckdb:vortex-compact	75136976	81080914	0.93
tpcds_q36/duckdb:vortex-compact	36198114	37736811	0.96
tpcds_q37/duckdb:vortex-compact	24625979	25888071	0.95
tpcds_q38/duckdb:vortex-compact	41911950	45504846	0.92
tpcds_q39/duckdb:vortex-compact	40346821	40761928	0.99
tpcds_q40/duckdb:vortex-compact 🚀	23430597	26248277	0.89
tpcds_q41/duckdb:vortex-compact	11677252	12723232	0.92
tpcds_q42/duckdb:vortex-compact	18812998	20328668	0.93
tpcds_q43/duckdb:vortex-compact	31317218	33724116	0.93
tpcds_q44/duckdb:vortex-compact	28226973	30417039	0.93
tpcds_q45/duckdb:vortex-compact 🚀	34424354	41368384	0.83
tpcds_q46/duckdb:vortex-compact	46306735	49818337	0.93
tpcds_q47/duckdb:vortex-compact	61939181	65350537	0.95
tpcds_q48/duckdb:vortex-compact	44170755	46746640	0.94
tpcds_q49/duckdb:vortex-compact	48201017	50933096	0.95
tpcds_q50/duckdb:vortex-compact	38283139	40052640	0.96
tpcds_q51/duckdb:vortex-compact 🚀	111027858	142616339	0.78
tpcds_q52/duckdb:vortex-compact	19770559	20557985	0.96
tpcds_q53/duckdb:vortex-compact	32252538	34642198	0.93
tpcds_q54/duckdb:vortex-compact 🚀	36237316	41311899	0.88
tpcds_q55/duckdb:vortex-compact	18761909	20270796	0.93
tpcds_q56/duckdb:vortex-compact	33782920	34191835	0.99
tpcds_q57/duckdb:vortex-compact	44675593	47012442	0.95
tpcds_q58/duckdb:vortex-compact	36566505	38909217	0.94
tpcds_q59/duckdb:vortex-compact 🚀	61221493	69680157	0.88
tpcds_q60/duckdb:vortex-compact	36422811	36324914	1.00
tpcds_q61/duckdb:vortex-compact	53077914	56206978	0.94
tpcds_q62/duckdb:vortex-compact	20610742	22705308	0.91
tpcds_q63/duckdb:vortex-compact	32263479	33199975	0.97
tpcds_q64/duckdb:vortex-compact	125662091	127569222	0.99
tpcds_q65/duckdb:vortex-compact	31691639	31250388	1.01
tpcds_q66/duckdb:vortex-compact	36103728	39001045	0.93
tpcds_q67/duckdb:vortex-compact	155022746	161087062	0.96
tpcds_q68/duckdb:vortex-compact	46356995	48525940	0.96
tpcds_q69/duckdb:vortex-compact	53934087	58596871	0.92
tpcds_q70/duckdb:vortex-compact	58535390	60409947	0.97
tpcds_q71/duckdb:vortex-compact	30602974	31529003	0.97
tpcds_q72/duckdb:vortex-compact	186899986	186548780	1.00
tpcds_q73/duckdb:vortex-compact	28127249	30022648	0.94
tpcds_q74/duckdb:vortex-compact	52099234	50464602	1.03
tpcds_q75/duckdb:vortex-compact	62539140	65356467	0.96
tpcds_q76/duckdb:vortex-compact 🚀	29589780	33389479	0.89
tpcds_q77/duckdb:vortex-compact	36732257	38836209	0.95
tpcds_q78/duckdb:vortex-compact	88559355	94601747	0.94
tpcds_q79/duckdb:vortex-compact	42311753	39769331	1.06
tpcds_q80/duckdb:vortex-compact	74253840	76441456	0.97
tpcds_q81/duckdb:vortex-compact 🚀	33266737	37126501	0.90
tpcds_q82/duckdb:vortex-compact	49466073	53535885	0.92
tpcds_q83/duckdb:vortex-compact	35326198	37778460	0.94
tpcds_q84/duckdb:vortex-compact	20733313	22324548	0.93
tpcds_q85/duckdb:vortex-compact	51324207	56105801	0.91
tpcds_q86/duckdb:vortex-compact	20854836	21899567	0.95
tpcds_q87/duckdb:vortex-compact	44937965	49724490	0.90
tpcds_q88/duckdb:vortex-compact	75251727	81742595	0.92
tpcds_q89/duckdb:vortex-compact	32445924	33385149	0.97
tpcds_q90/duckdb:vortex-compact	11330896	12139506	0.93
tpcds_q91/duckdb:vortex-compact 🚀	39832980	44947326	0.89
tpcds_q92/duckdb:vortex-compact	46751088	44617861	1.05
tpcds_q93/duckdb:vortex-compact	33905217	36644931	0.93
tpcds_q94/duckdb:vortex-compact 🚀	27301012	30568449	0.89
tpcds_q95/duckdb:vortex-compact	163722857	171336634	0.96
tpcds_q96/duckdb:vortex-compact	17382119	17555798	0.99
tpcds_q97/duckdb:vortex-compact	41490882	44261366	0.94
tpcds_q98/duckdb:vortex-compact	27240083	29529836	0.92
tpcds_q99/duckdb:vortex-compact	28107229	27479065	1.02

duckdb / parquet (0.976x ➖, 2↑ 2↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
tpcds_q01/duckdb:parquet	30275316	32370002	0.94
tpcds_q02/duckdb:parquet	24105456	24938559	0.97
tpcds_q03/duckdb:parquet	13344591	13031955	1.02
tpcds_q04/duckdb:parquet	171822795	176517516	0.97
tpcds_q05/duckdb:parquet 🚀	30559933	34394120	0.89
tpcds_q06/duckdb:parquet	34023662	34760722	0.98
tpcds_q07/duckdb:parquet	24272069	24711341	0.98
tpcds_q08/duckdb:parquet	30229291	29626368	1.02
tpcds_q09/duckdb:parquet	44980104	44733319	1.01
tpcds_q10/duckdb:parquet	38293768	38629157	0.99
tpcds_q11/duckdb:parquet	94193134	96456132	0.98
tpcds_q12/duckdb:parquet	17176359	17894080	0.96
tpcds_q13/duckdb:parquet	35278539	36009608	0.98
tpcds_q14/duckdb:parquet	106930375	102773646	1.04
tpcds_q15/duckdb:parquet	30863928	31923557	0.97
tpcds_q16/duckdb:parquet	23000451	23851448	0.96
tpcds_q17/duckdb:parquet	39472731	39455364	1.00
tpcds_q18/duckdb:parquet	49189369	50011266	0.98
tpcds_q19/duckdb:parquet	32086125	32362931	0.99
tpcds_q20/duckdb:parquet	18894656	19055347	0.99
tpcds_q21/duckdb:parquet	11887039	12153837	0.98
tpcds_q22/duckdb:parquet	72573171	75182774	0.97
tpcds_q23/duckdb:parquet	82264539	87355939	0.94
tpcds_q24/duckdb:parquet	47055887	50837155	0.93
tpcds_q25/duckdb:parquet	36639644	36793373	1.00
tpcds_q26/duckdb:parquet	40097633	42041839	0.95
tpcds_q27/duckdb:parquet	53124746	56341237	0.94
tpcds_q28/duckdb:parquet	43053908	43949085	0.98
tpcds_q29/duckdb:parquet	39131457	40682108	0.96
tpcds_q30/duckdb:parquet	38877191	40101141	0.97
tpcds_q31/duckdb:parquet	27670256	29154178	0.95
tpcds_q32/duckdb:parquet	13054894	13066316	1.00
tpcds_q33/duckdb:parquet	23971457	24159629	0.99
tpcds_q34/duckdb:parquet	22868508	24093905	0.95
tpcds_q35/duckdb:parquet	62494642	64209844	0.97
tpcds_q36/duckdb:parquet	22725701	23062836	0.99
tpcds_q37/duckdb:parquet	14570238	15020551	0.97
tpcds_q38/duckdb:parquet	37874627	37519627	1.01
tpcds_q39/duckdb:parquet	32332242	32952723	0.98
tpcds_q40/duckdb:parquet	19813419	21776145	0.91
tpcds_q41/duckdb:parquet	9098543	9676152	0.94
tpcds_q42/duckdb:parquet 🚨	14103491	12733365	1.11
tpcds_q43/duckdb:parquet 🚨	20079747	18241029	1.10
tpcds_q44/duckdb:parquet	26095315	26019320	1.00
tpcds_q45/duckdb:parquet	29658331	31288259	0.95
tpcds_q46/duckdb:parquet	48211233	52426908	0.92
tpcds_q47/duckdb:parquet	50854696	55013067	0.92
tpcds_q48/duckdb:parquet	32934031	33616134	0.98
tpcds_q49/duckdb:parquet	30316888	29209304	1.04
tpcds_q50/duckdb:parquet	26290502	27195541	0.97
tpcds_q51/duckdb:parquet	106302745	108949974	0.98
tpcds_q52/duckdb:parquet	13079487	12685060	1.03
tpcds_q53/duckdb:parquet	19437463	19801681	0.98
tpcds_q54/duckdb:parquet	29274744	29439187	0.99
tpcds_q55/duckdb:parquet	13175715	12714603	1.04
tpcds_q56/duckdb:parquet	23803135	24423911	0.97
tpcds_q57/duckdb:parquet	38644196	39820265	0.97
tpcds_q58/duckdb:parquet	26730965	27392884	0.98
tpcds_q59/duckdb:parquet	36791553	36795390	1.00
tpcds_q60/duckdb:parquet	25513735	26806735	0.95
tpcds_q61/duckdb:parquet	34712689	35619065	0.97
tpcds_q62/duckdb:parquet	12662343	13565284	0.93
tpcds_q63/duckdb:parquet	17979475	18330204	0.98
tpcds_q64/duckdb:parquet	76296729	83545862	0.91
tpcds_q65/duckdb:parquet	22850666	23059617	0.99
tpcds_q66/duckdb:parquet	29589409	29922714	0.99
tpcds_q67/duckdb:parquet	140857536	148890989	0.95
tpcds_q68/duckdb:parquet	39092972	40177640	0.97
tpcds_q69/duckdb:parquet	39264669	39162640	1.00
tpcds_q70/duckdb:parquet	23133619	23796944	0.97
tpcds_q71/duckdb:parquet	22921118	23736442	0.97
tpcds_q72/duckdb:parquet	168262419	168030895	1.00
tpcds_q73/duckdb:parquet	20180037	20894861	0.97
tpcds_q74/duckdb:parquet	127349119	132506197	0.96
tpcds_q75/duckdb:parquet	58768633	59815111	0.98
tpcds_q76/duckdb:parquet	22056247	22452794	0.98
tpcds_q77/duckdb:parquet	25239574	26636522	0.95
tpcds_q78/duckdb:parquet	78111924	83593517	0.93
tpcds_q79/duckdb:parquet	30596231	31129144	0.98
tpcds_q80/duckdb:parquet	44772553	45397065	0.99
tpcds_q81/duckdb:parquet	36135184	36019219	1.00
tpcds_q82/duckdb:parquet	17845899	18674451	0.96
tpcds_q83/duckdb:parquet	19543247	19750448	0.99
tpcds_q84/duckdb:parquet	21103713	21713271	0.97
tpcds_q85/duckdb:parquet	43140883	45550102	0.95
tpcds_q86/duckdb:parquet	14008522	14622874	0.96
tpcds_q87/duckdb:parquet	39841516	42010914	0.95
tpcds_q88/duckdb:parquet	53881568	54310018	0.99
tpcds_q89/duckdb:parquet	21524529	22596360	0.95
tpcds_q90/duckdb:parquet 🚀	8668284	9918106	0.87
tpcds_q91/duckdb:parquet	26752019	26316345	1.02
tpcds_q92/duckdb:parquet	14680566	14068059	1.04
tpcds_q93/duckdb:parquet	32018167	34068046	0.94
tpcds_q94/duckdb:parquet	19258457	18680227	1.03
tpcds_q95/duckdb:parquet	150483247	152120193	0.99
tpcds_q96/duckdb:parquet	11086875	11351385	0.98
tpcds_q97/duckdb:parquet	37913142	39135747	0.97
tpcds_q98/duckdb:parquet	25040420	25712262	0.97
tpcds_q99/duckdb:parquet	20764383	21005111	0.99

duckdb / duckdb (0.931x ➖, 18↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚀	21379666	24499727	0.87
tpcds_q02/duckdb:duckdb	20498000	20045002	1.02
tpcds_q03/duckdb:duckdb	10290302	11370863	0.90
tpcds_q04/duckdb:duckdb	181979590	181818211	1.00
tpcds_q05/duckdb:duckdb	23984565	22126580	1.08
tpcds_q06/duckdb:duckdb	27590744	29798085	0.93
tpcds_q07/duckdb:duckdb	40194132	43422966	0.93
tpcds_q08/duckdb:duckdb	120072100	122670832	0.98
tpcds_q09/duckdb:duckdb	20369824	21892317	0.93
tpcds_q10/duckdb:duckdb	27476107	28618958	0.96
tpcds_q11/duckdb:duckdb	94988371	101318100	0.94
tpcds_q12/duckdb:duckdb	13838019	15255559	0.91
tpcds_q13/duckdb:duckdb	26132046	27639289	0.95
tpcds_q14/duckdb:duckdb	92995908	98279488	0.95
tpcds_q15/duckdb:duckdb	24587384	26742408	0.92
tpcds_q16/duckdb:duckdb 🚀	19030459	21914201	0.87
tpcds_q17/duckdb:duckdb	25074557	25215428	0.99
tpcds_q18/duckdb:duckdb	47160439	48819784	0.97
tpcds_q19/duckdb:duckdb	19090482	20405606	0.94
tpcds_q20/duckdb:duckdb	14434295	15335113	0.94
tpcds_q21/duckdb:duckdb	7530443	8244069	0.91
tpcds_q22/duckdb:duckdb 🚀	62928269	72850358	0.86
tpcds_q23/duckdb:duckdb 🚀	75976000	86678076	0.88
tpcds_q24/duckdb:duckdb	25459676	26314431	0.97
tpcds_q25/duckdb:duckdb	18533063	19446145	0.95
tpcds_q26/duckdb:duckdb	28335335	30543253	0.93
tpcds_q27/duckdb:duckdb	41724877	43681573	0.96
tpcds_q28/duckdb:duckdb	24971006	27479251	0.91
tpcds_q29/duckdb:duckdb	23269433	25075612	0.93
tpcds_q30/duckdb:duckdb	31281958	32264090	0.97
tpcds_q31/duckdb:duckdb	51598971	54697522	0.94
tpcds_q32/duckdb:duckdb	8524321	8703262	0.98
tpcds_q33/duckdb:duckdb	15427088	16850201	0.92
tpcds_q34/duckdb:duckdb 🚀	17969066	20332214	0.88
tpcds_q35/duckdb:duckdb	36907881	37448670	0.99
tpcds_q36/duckdb:duckdb	70433390	76873402	0.92
tpcds_q37/duckdb:duckdb	8835709	9502364	0.93
tpcds_q38/duckdb:duckdb	32801133	35260046	0.93
tpcds_q39/duckdb:duckdb	28006534	30308180	0.92
tpcds_q40/duckdb:duckdb 🚀	14650273	16407283	0.89
tpcds_q41/duckdb:duckdb	9438455	10053951	0.94
tpcds_q42/duckdb:duckdb	9445203	9352705	1.01
tpcds_q43/duckdb:duckdb 🚀	13456087	15483574	0.87
tpcds_q44/duckdb:duckdb	14945002	15678389	0.95
tpcds_q45/duckdb:duckdb	18593567	20269717	0.92
tpcds_q46/duckdb:duckdb	38536019	41586146	0.93
tpcds_q47/duckdb:duckdb	45771353	50023667	0.91
tpcds_q48/duckdb:duckdb	25141690	26189863	0.96
tpcds_q49/duckdb:duckdb	20258513	22291781	0.91
tpcds_q50/duckdb:duckdb	16177412	17275547	0.94
tpcds_q51/duckdb:duckdb	100494255	104508909	0.96
tpcds_q52/duckdb:duckdb 🚀	8922213	10174308	0.88
tpcds_q53/duckdb:duckdb	17196984	18583521	0.93
tpcds_q54/duckdb:duckdb	18821365	20204665	0.93
tpcds_q55/duckdb:duckdb	10319840	10193731	1.01
tpcds_q56/duckdb:duckdb	16442774	17658006	0.93
tpcds_q57/duckdb:duckdb	36655451	38746689	0.95
tpcds_q58/duckdb:duckdb 🚀	15869632	18627556	0.85
tpcds_q59/duckdb:duckdb	36408417	39414517	0.92
tpcds_q60/duckdb:duckdb 🚀	17500763	20063408	0.87
tpcds_q61/duckdb:duckdb	16236545	17572440	0.92
tpcds_q62/duckdb:duckdb	9917586	10644304	0.93
tpcds_q63/duckdb:duckdb	15978189	16847272	0.95
tpcds_q64/duckdb:duckdb	56725914	61405789	0.92
tpcds_q65/duckdb:duckdb	36195616	38094877	0.95
tpcds_q66/duckdb:duckdb	26332687	28086811	0.94
tpcds_q67/duckdb:duckdb	137506050	138996948	0.99
tpcds_q68/duckdb:duckdb	26219912	27259292	0.96
tpcds_q69/duckdb:duckdb	26723812	28648367	0.93
tpcds_q70/duckdb:duckdb	16901168	18426881	0.92
tpcds_q71/duckdb:duckdb	16549268	18062818	0.92
tpcds_q72/duckdb:duckdb	45687502	48314822	0.95
tpcds_q73/duckdb:duckdb 🚀	12869801	14954725	0.86
tpcds_q74/duckdb:duckdb	144771900	151114727	0.96
tpcds_q75/duckdb:duckdb	46216001	48320973	0.96
tpcds_q76/duckdb:duckdb	14947282	14915039	1.00
tpcds_q77/duckdb:duckdb 🚀	14924677	16745943	0.89
tpcds_q78/duckdb:duckdb	65263086	70692111	0.92
tpcds_q79/duckdb:duckdb 🚀	20020791	22275443	0.90
tpcds_q80/duckdb:duckdb	32455118	35308307	0.92
tpcds_q81/duckdb:duckdb	39474757	43554047	0.91
tpcds_q82/duckdb:duckdb	11091733	10992960	1.01
tpcds_q83/duckdb:duckdb 🚀	10740656	11990018	0.90
tpcds_q84/duckdb:duckdb	14619688	15841615	0.92
tpcds_q85/duckdb:duckdb 🚀	25645826	28901535	0.89
tpcds_q86/duckdb:duckdb	11961239	13125050	0.91
tpcds_q87/duckdb:duckdb	36480302	37907631	0.96
tpcds_q88/duckdb:duckdb	28502433	31523347	0.90
tpcds_q89/duckdb:duckdb	21855034	23005939	0.95
tpcds_q90/duckdb:duckdb 🚀	6197233	7099051	0.87
tpcds_q91/duckdb:duckdb	15013946	16150413	0.93
tpcds_q92/duckdb:duckdb	9849313	10741591	0.92
tpcds_q93/duckdb:duckdb 🚀	23228234	26560497	0.87
tpcds_q94/duckdb:duckdb	14304815	15378805	0.93
tpcds_q95/duckdb:duckdb	123549889	115815139	1.07
tpcds_q96/duckdb:duckdb 🚀	5771074	8234274	0.70
tpcds_q97/duckdb:duckdb	31735203	34732781	0.91
tpcds_q98/duckdb:duckdb	21358782	21126416	1.01
tpcds_q99/duckdb:duckdb	16394696	18128758	0.90

---

No baseline file sizes found for base commit.

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:vortex-compact	-9.1%	-9.7%	+0.7%	+20.1%	➖ noise
1	datafusion:vortex-file-compressed	-6.6%	-9.7%	+3.5%	+24.1%	➖ noise
1	duckdb:duckdb	-12.7%	-9.7%	-3.3%	+24.8%	➖ noise
1	duckdb:vortex-compact	-10.8%	-9.7%	-1.2%	+20.7%	➖ noise
1	duckdb:vortex-file-compressed	-1.2%	-9.7%	+9.4%	+26.5%	➖ noise
2	datafusion:vortex-compact	-8.0%	-5.9%	-2.3%	+12.5%	➖ noise
2	datafusion:vortex-file-compressed	-7.5%	-5.9%	-1.7%	+10.0%	➖ noise
2	duckdb:duckdb	+2.3%	-5.9%	+8.6%	+10.0%	➖ noise
2	duckdb:vortex-compact	-7.1%	-5.9%	-1.3%	+26.4%	➖ noise
2	duckdb:vortex-file-compressed	-6.4%	-5.9%	-0.6%	+19.7%	➖ noise
3	datafusion:vortex-compact	+4.1%	-3.2%	+7.6%	+29.0%	➖ noise
3	datafusion:vortex-file-compressed	-8.7%	-3.2%	-5.7%	+10.0%	➖ noise
3	duckdb:duckdb	-9.5%	-3.2%	-6.5%	+10.0%	➖ noise
3	duckdb:vortex-compact	-2.6%	-3.2%	+0.6%	+10.0%	➖ noise
3	duckdb:vortex-file-compressed	-5.1%	-3.2%	-2.0%	+10.0%	➖ noise
4	datafusion:vortex-compact	-5.8%	-5.0%	-0.9%	+10.0%	➖ noise
4	datafusion:vortex-file-compressed	-6.3%	-5.0%	-1.4%	+10.4%	➖ noise
4	duckdb:duckdb	+0.1%	-5.0%	+5.3%	+10.0%	➖ noise
4	duckdb:vortex-compact	-14.8%	-5.0%	-10.3%	+12.4%	➖ noise
4	duckdb:vortex-file-compressed	-6.6%	-5.0%	-1.7%	+12.1%	➖ noise
5	datafusion:vortex-compact	-12.3%	-9.7%	-2.8%	+19.2%	➖ noise
5	datafusion:vortex-file-compressed	-2.0%	-9.7%	+8.5%	+18.3%	➖ noise
5	duckdb:duckdb	+8.4%	-9.7%	+20.0%	+12.2%	🚨 regression
5	duckdb:vortex-compact	+1.7%	-9.7%	+12.6%	+15.0%	➖ noise
5	duckdb:vortex-file-compressed	-12.6%	-9.7%	-3.3%	+12.4%	➖ noise
6	datafusion:vortex-compact	+2.3%	-1.9%	+4.3%	+15.0%	➖ noise
6	datafusion:vortex-file-compressed	-2.1%	-1.9%	-0.2%	+10.0%	➖ noise
6	duckdb:duckdb	-7.4%	-1.9%	-5.6%	+10.0%	➖ noise
6	duckdb:vortex-compact	-10.9%	-1.9%	-9.1%	+10.0%	✅ faster
6	duckdb:vortex-file-compressed	-8.5%	-1.9%	-6.7%	+10.0%	➖ noise
7	datafusion:vortex-compact	-5.1%	-2.8%	-2.4%	+10.0%	➖ noise
7	datafusion:vortex-file-compressed	-11.1%	-2.8%	-8.5%	+19.1%	➖ noise
7	duckdb:duckdb	-7.4%	-2.8%	-4.8%	+14.1%	➖ noise
7	duckdb:vortex-compact	-9.5%	-2.8%	-6.9%	+10.1%	➖ noise
7	duckdb:vortex-file-compressed	-0.8%	-2.8%	+2.1%	+10.0%	➖ noise
8	datafusion:vortex-compact	-7.5%	+0.7%	-8.1%	+14.1%	➖ noise
8	datafusion:vortex-file-compressed	-5.2%	+0.7%	-5.9%	+10.0%	➖ noise
8	duckdb:duckdb	-2.1%	+0.7%	-2.8%	+10.0%	➖ noise
8	duckdb:vortex-compact	-7.7%	+0.7%	-8.4%	+10.0%	➖ noise
8	duckdb:vortex-file-compressed	-1.7%	+0.7%	-2.4%	+27.4%	➖ noise
9	datafusion:vortex-compact	-6.7%	+1.4%	-8.0%	+10.4%	➖ noise
9	datafusion:vortex-file-compressed	-5.6%	+1.4%	-7.0%	+10.0%	➖ noise
9	duckdb:duckdb	-7.0%	+1.4%	-8.3%	+10.0%	➖ noise
9	duckdb:vortex-compact	-0.9%	+1.4%	-2.3%	+25.7%	➖ noise
9	duckdb:vortex-file-compressed	+3.0%	+1.4%	+1.6%	+10.1%	➖ noise
10	datafusion:vortex-compact	-0.2%	+0.7%	-0.9%	+11.8%	➖ noise
10	datafusion:vortex-file-compressed	-8.3%	+0.7%	-8.9%	+13.7%	➖ noise
10	duckdb:duckdb	-4.0%	+0.7%	-4.7%	+10.0%	➖ noise
10	duckdb:vortex-compact	-4.9%	+0.7%	-5.6%	+14.2%	➖ noise
10	duckdb:vortex-file-compressed	-4.7%	+0.7%	-5.4%	+10.0%	➖ noise
11	datafusion:vortex-compact	-8.5%	-3.1%	-5.6%	+11.9%	➖ noise
11	datafusion:vortex-file-compressed	-10.2%	-3.1%	-7.3%	+10.0%	➖ noise
11	duckdb:duckdb	-6.2%	-3.1%	-3.2%	+10.0%	➖ noise
11	duckdb:vortex-compact	-6.5%	-3.1%	-3.5%	+10.0%	➖ noise
11	duckdb:vortex-file-compressed	-11.1%	-3.1%	-8.3%	+10.0%	➖ noise
12	datafusion:vortex-compact	-9.1%	-5.7%	-3.6%	+14.2%	➖ noise
12	datafusion:vortex-file-compressed	+2.0%	-5.7%	+8.2%	+15.7%	➖ noise
12	duckdb:duckdb	-9.3%	-5.7%	-3.8%	+10.0%	➖ noise
12	duckdb:vortex-compact	-8.8%	-5.7%	-3.3%	+10.9%	➖ noise
12	duckdb:vortex-file-compressed	-1.9%	-5.7%	+4.1%	+13.4%	➖ noise
13	datafusion:vortex-compact	+7.6%	-4.3%	+12.4%	+23.5%	➖ noise
13	datafusion:vortex-file-compressed	-2.7%	-4.3%	+1.6%	+14.5%	➖ noise
13	duckdb:duckdb	-5.5%	-4.3%	-1.3%	+10.0%	➖ noise
13	duckdb:vortex-compact	-3.6%	-4.3%	+0.7%	+14.8%	➖ noise
13	duckdb:vortex-file-compressed	-1.4%	-4.3%	+3.0%	+12.1%	➖ noise
14	datafusion:vortex-compact	-1.4%	-0.7%	-0.7%	+12.1%	➖ noise
14	datafusion:vortex-file-compressed	-3.9%	-0.7%	-3.3%	+10.0%	➖ noise
14	duckdb:duckdb	-5.4%	-0.7%	-4.7%	+10.3%	➖ noise
14	duckdb:vortex-compact	-4.5%	-0.7%	-3.8%	+12.5%	➖ noise
14	duckdb:vortex-file-compressed	-4.3%	-0.7%	-3.6%	+10.0%	➖ noise
15	datafusion:vortex-compact	-3.8%	-10.5%	+7.5%	+10.0%	➖ noise
15	datafusion:vortex-file-compressed	-9.3%	-10.5%	+1.4%	+16.1%	➖ noise
15	duckdb:duckdb	-8.1%	-10.5%	+2.8%	+10.0%	➖ noise
15	duckdb:vortex-compact	-11.4%	-10.5%	-1.0%	+11.7%	➖ noise
15	duckdb:vortex-file-compressed	-8.9%	-10.5%	+1.9%	+12.3%	➖ noise
16	datafusion:vortex-compact	-4.3%	-4.5%	+0.3%	+25.8%	➖ noise
16	datafusion:vortex-file-compressed	-9.8%	-4.5%	-5.5%	+21.3%	➖ noise
16	duckdb:duckdb	-13.2%	-4.5%	-9.0%	+10.0%	➖ noise
16	duckdb:vortex-compact	-13.7%	-4.5%	-9.6%	+10.0%	✅ faster
16	duckdb:vortex-file-compressed	+2.0%	-4.5%	+6.9%	+10.0%	➖ noise
17	datafusion:vortex-compact	-4.8%	-5.6%	+0.8%	+12.5%	➖ noise
17	datafusion:vortex-file-compressed	-10.3%	-5.6%	-5.1%	+10.0%	➖ noise
17	duckdb:duckdb	-0.6%	-5.6%	+5.3%	+10.0%	➖ noise
17	duckdb:vortex-compact	-9.5%	-5.6%	-4.2%	+10.0%	➖ noise
17	duckdb:vortex-file-compressed	-3.4%	-5.6%	+2.3%	+10.0%	➖ noise
18	datafusion:vortex-compact	-4.7%	-5.2%	+0.5%	+10.0%	➖ noise
18	datafusion:vortex-file-compressed	-3.1%	-5.2%	+2.2%	+10.0%	➖ noise
18	duckdb:duckdb	-3.4%	-5.2%	+1.9%	+10.0%	➖ noise
18	duckdb:vortex-compact	-6.0%	-5.2%	-0.8%	+10.0%	➖ noise
18	duckdb:vortex-file-compressed	-11.0%	-5.2%	-6.1%	+10.5%	➖ noise
19	datafusion:vortex-compact	-5.2%	-3.5%	-1.8%	+13.2%	➖ noise
19	datafusion:vortex-file-compressed	-5.6%	-3.5%	-2.3%	+34.7%	➖ noise
19	duckdb:duckdb	-6.4%	-3.5%	-3.1%	+10.0%	➖ noise
19	duckdb:vortex-compact	-4.6%	-3.5%	-1.1%	+10.0%	➖ noise
19	duckdb:vortex-file-compressed	-10.5%	-3.5%	-7.3%	+10.2%	➖ noise
20	datafusion:vortex-compact	-6.7%	-5.9%	-0.8%	+10.0%	➖ noise
20	datafusion:vortex-file-compressed	-14.5%	-5.9%	-9.1%	+10.0%	✅ faster
20	duckdb:duckdb	-5.9%	-5.9%	+0.1%	+10.0%	➖ noise
20	duckdb:vortex-compact	-10.6%	-5.9%	-5.0%	+10.0%	➖ noise
20	duckdb:vortex-file-compressed	-10.1%	-5.9%	-4.5%	+10.0%	➖ noise
21	datafusion:vortex-compact	-6.8%	-7.0%	+0.3%	+14.2%	➖ noise
21	datafusion:vortex-file-compressed	-11.2%	-7.0%	-4.4%	+10.0%	➖ noise
21	duckdb:duckdb	-8.7%	-7.0%	-1.7%	+16.7%	➖ noise
21	duckdb:vortex-compact	-8.2%	-7.0%	-1.2%	+10.8%	➖ noise
21	duckdb:vortex-file-compressed	-11.7%	-7.0%	-5.0%	+11.7%	➖ noise
22	datafusion:vortex-compact	-22.6%	-3.3%	-20.0%	+20.6%	✅ faster
22	datafusion:vortex-file-compressed	-11.7%	-3.3%	-8.8%	+26.4%	➖ noise
22	duckdb:duckdb	-13.6%	-3.3%	-10.7%	+15.3%	➖ noise
22	duckdb:vortex-compact	-9.5%	-3.3%	-6.4%	+23.7%	➖ noise
22	duckdb:vortex-file-compressed	-7.9%	-3.3%	-4.8%	+15.3%	➖ noise
23	datafusion:vortex-compact	-8.5%	-6.5%	-2.1%	+12.2%	➖ noise
23	datafusion:vortex-file-compressed	-8.9%	-6.5%	-2.5%	+10.0%	➖ noise
23	duckdb:duckdb	-12.3%	-6.5%	-6.2%	+13.2%	➖ noise
23	duckdb:vortex-compact	-9.1%	-6.5%	-2.7%	+10.6%	➖ noise
23	duckdb:vortex-file-compressed	-0.5%	-6.5%	+6.4%	+12.7%	➖ noise
24	datafusion:vortex-compact	-6.1%	-5.6%	-0.6%	+21.3%	➖ noise
24	datafusion:vortex-file-compressed	-2.9%	-5.6%	+2.8%	+18.0%	➖ noise
24	duckdb:duckdb	-3.2%	-5.6%	+2.5%	+10.0%	➖ noise
24	duckdb:vortex-compact	-10.2%	-5.6%	-4.9%	+10.0%	➖ noise
24	duckdb:vortex-file-compressed	-8.8%	-5.6%	-3.4%	+11.8%	➖ noise
25	datafusion:vortex-compact	-4.0%	-3.1%	-1.0%	+10.0%	➖ noise
25	datafusion:vortex-file-compressed	-4.8%	-3.1%	-1.8%	+10.0%	➖ noise
25	duckdb:duckdb	-4.7%	-3.1%	-1.7%	+10.0%	➖ noise
25	duckdb:vortex-compact	-4.2%	-3.1%	-1.1%	+21.3%	➖ noise
25	duckdb:vortex-file-compressed	-5.6%	-3.1%	-2.6%	+16.7%	➖ noise
26	datafusion:vortex-compact	-4.4%	-4.0%	-0.4%	+10.0%	➖ noise
26	datafusion:vortex-file-compressed	-6.2%	-4.0%	-2.2%	+14.0%	➖ noise
26	duckdb:duckdb	-7.2%	-4.0%	-3.3%	+10.0%	➖ noise
26	duckdb:vortex-compact	-8.3%	-4.0%	-4.5%	+34.6%	➖ noise
26	duckdb:vortex-file-compressed	-6.8%	-4.0%	-2.9%	+10.0%	➖ noise
27	datafusion:vortex-compact	-7.7%	-7.6%	-0.0%	+13.0%	➖ noise
27	datafusion:vortex-file-compressed	-12.7%	-7.6%	-5.5%	+12.9%	➖ noise
27	duckdb:duckdb	-4.5%	-7.6%	+3.4%	+10.0%	➖ noise
27	duckdb:vortex-compact	-1.1%	-7.6%	+7.0%	+15.0%	➖ noise
27	duckdb:vortex-file-compressed	-6.0%	-7.6%	+1.8%	+10.0%	➖ noise
28	datafusion:vortex-compact	-5.6%	-4.1%	-1.6%	+15.8%	➖ noise
28	datafusion:vortex-file-compressed	-1.1%	-4.1%	+3.1%	+10.0%	➖ noise
28	duckdb:duckdb	-9.1%	-4.1%	-5.3%	+10.0%	➖ noise
28	duckdb:vortex-compact	-2.6%	-4.1%	+1.5%	+31.7%	➖ noise
28	duckdb:vortex-file-compressed	-10.5%	-4.1%	-6.7%	+31.0%	➖ noise
29	datafusion:vortex-compact	-8.1%	-1.7%	-6.5%	+10.7%	➖ noise
29	datafusion:vortex-file-compressed	-7.0%	-1.7%	-5.4%	+22.3%	➖ noise
29	duckdb:duckdb	-7.2%	-1.7%	-5.6%	+10.0%	➖ noise
29	duckdb:vortex-compact	-14.1%	-1.7%	-12.6%	+17.1%	➖ noise
29	duckdb:vortex-file-compressed	-7.0%	-1.7%	-5.4%	+10.4%	➖ noise
30	datafusion:vortex-compact	-6.7%	-9.8%	+3.4%	+10.0%	➖ noise
30	datafusion:vortex-file-compressed	-12.3%	-9.8%	-2.7%	+10.0%	➖ noise
30	duckdb:duckdb	-3.0%	-9.8%	+7.5%	+10.0%	➖ noise
30	duckdb:vortex-compact	-7.5%	-9.8%	+2.5%	+10.0%	➖ noise
30	duckdb:vortex-file-compressed	-1.1%	-9.8%	+9.7%	+18.5%	➖ noise
31	datafusion:vortex-compact	-7.2%	-5.9%	-1.4%	+12.0%	➖ noise
31	datafusion:vortex-file-compressed	-3.7%	-5.9%	+2.4%	+12.9%	➖ noise
31	duckdb:duckdb	-5.7%	-5.9%	+0.2%	+10.0%	➖ noise
31	duckdb:vortex-compact	-2.3%	-5.9%	+3.8%	+10.6%	➖ noise
31	duckdb:vortex-file-compressed	+5.1%	-5.9%	+11.7%	+11.4%	🚨 regression
32	datafusion:vortex-compact	-12.8%	-5.5%	-7.8%	+11.1%	➖ noise
32	datafusion:vortex-file-compressed	-8.1%	-5.5%	-2.8%	+10.0%	➖ noise
32	duckdb:duckdb	-2.1%	-5.5%	+3.6%	+10.0%	➖ noise
32	duckdb:vortex-compact	-16.5%	-5.5%	-11.6%	+21.7%	➖ noise
32	duckdb:vortex-file-compressed	-9.6%	-5.5%	-4.3%	+11.5%	➖ noise
33	datafusion:vortex-compact	-3.1%	-2.3%	-0.8%	+14.7%	➖ noise
33	datafusion:vortex-file-compressed	-9.1%	-2.3%	-7.0%	+10.0%	➖ noise
33	duckdb:duckdb	-8.4%	-2.3%	-6.3%	+10.0%	➖ noise
33	duckdb:vortex-compact	-15.9%	-2.3%	-13.9%	+10.0%	✅ faster
33	duckdb:vortex-file-compressed	-9.6%	-2.3%	-7.5%	+10.0%	➖ noise
34	datafusion:vortex-compact	-7.3%	-5.0%	-2.4%	+10.0%	➖ noise
34	datafusion:vortex-file-compressed	-10.7%	-5.0%	-6.0%	+30.3%	➖ noise
34	duckdb:duckdb	-11.6%	-5.0%	-7.0%	+10.0%	➖ noise
34	duckdb:vortex-compact	-5.8%	-5.0%	-0.9%	+15.0%	➖ noise
34	duckdb:vortex-file-compressed	-7.9%	-5.0%	-3.0%	+10.0%	➖ noise
35	datafusion:vortex-compact	-11.4%	-9.6%	-2.0%	+12.3%	➖ noise
35	datafusion:vortex-file-compressed	-1.8%	-9.6%	+8.6%	+13.8%	➖ noise
35	duckdb:duckdb	-1.4%	-9.6%	+9.0%	+10.0%	➖ noise
35	duckdb:vortex-compact	-7.3%	-9.6%	+2.5%	+10.3%	➖ noise
35	duckdb:vortex-file-compressed	-2.9%	-9.6%	+7.3%	+10.0%	➖ noise
36	datafusion:vortex-compact	-6.1%	-4.3%	-1.9%	+14.0%	➖ noise
36	datafusion:vortex-file-compressed	-8.0%	-4.3%	-3.8%	+10.0%	➖ noise
36	duckdb:duckdb	-8.4%	-4.3%	-4.2%	+10.0%	➖ noise
36	duckdb:vortex-compact	-4.1%	-4.3%	+0.3%	+10.0%	➖ noise
36	duckdb:vortex-file-compressed	-6.2%	-4.3%	-1.9%	+17.2%	➖ noise
37	datafusion:vortex-compact	-9.6%	-3.4%	-6.4%	+10.0%	➖ noise
37	datafusion:vortex-file-compressed	-12.7%	-3.4%	-9.6%	+10.0%	✅ faster
37	duckdb:duckdb	-7.0%	-3.4%	-3.7%	+10.0%	➖ noise
37	duckdb:vortex-compact	-4.9%	-3.4%	-1.5%	+15.2%	➖ noise
37	duckdb:vortex-file-compressed	-4.9%	-3.4%	-1.6%	+10.0%	➖ noise
38	datafusion:vortex-compact	-2.4%	-0.5%	-1.9%	+10.0%	➖ noise
38	datafusion:vortex-file-compressed	-10.9%	-0.5%	-10.4%	+17.7%	➖ noise
38	duckdb:duckdb	-7.0%	-0.5%	-6.5%	+14.5%	➖ noise
38	duckdb:vortex-compact	-7.9%	-0.5%	-7.4%	+15.2%	➖ noise
38	duckdb:vortex-file-compressed	-9.0%	-0.5%	-8.5%	+10.0%	➖ noise
39	datafusion:vortex-compact	-14.7%	-11.2%	-3.9%	+16.8%	➖ noise
39	datafusion:vortex-file-compressed	-4.3%	-11.2%	+7.7%	+17.4%	➖ noise
39	duckdb:duckdb	-7.6%	-11.2%	+4.0%	+21.8%	➖ noise
39	duckdb:vortex-compact	-1.0%	-11.2%	+11.5%	+19.6%	➖ noise
39	duckdb:vortex-file-compressed	-2.7%	-11.2%	+9.6%	+19.0%	➖ noise
40	datafusion:vortex-compact	-7.6%	-6.8%	-0.9%	+10.0%	➖ noise
40	datafusion:vortex-file-compressed	-7.0%	-6.8%	-0.2%	+10.0%	➖ noise
40	duckdb:duckdb	-10.7%	-6.8%	-4.2%	+10.0%	➖ noise
40	duckdb:vortex-compact	-10.7%	-6.8%	-4.2%	+10.0%	➖ noise
40	duckdb:vortex-file-compressed	-12.3%	-6.8%	-5.9%	+12.3%	➖ noise
41	datafusion:vortex-compact	-11.0%	-8.5%	-2.7%	+10.0%	➖ noise
41	datafusion:vortex-file-compressed	-10.5%	-8.5%	-2.1%	+10.3%	➖ noise
41	duckdb:duckdb	-6.1%	-8.5%	+2.6%	+10.0%	➖ noise
41	duckdb:vortex-compact	-8.2%	-8.5%	+0.3%	+10.0%	➖ noise
41	duckdb:vortex-file-compressed	-8.2%	-8.5%	+0.3%	+10.0%	➖ noise
42	datafusion:vortex-compact	-8.3%	+0.8%	-8.9%	+23.6%	➖ noise
42	datafusion:vortex-file-compressed	-12.3%	+0.8%	-13.0%	+18.6%	➖ noise
42	duckdb:duckdb	+1.0%	+0.8%	+0.2%	+44.6%	➖ noise
42	duckdb:vortex-compact	-7.5%	+0.8%	-8.1%	+22.7%	➖ noise
42	duckdb:vortex-file-compressed	-2.9%	+0.8%	-3.6%	+17.3%	➖ noise
43	datafusion:vortex-compact	-10.8%	+1.0%	-11.7%	+29.2%	➖ noise
43	datafusion:vortex-file-compressed	-11.8%	+1.0%	-12.7%	+22.0%	➖ noise
43	duckdb:duckdb	-13.1%	+1.0%	-14.0%	+10.0%	✅ faster
43	duckdb:vortex-compact	-7.1%	+1.0%	-8.1%	+24.2%	➖ noise
43	duckdb:vortex-file-compressed	-4.8%	+1.0%	-5.8%	+11.0%	➖ noise
44	datafusion:vortex-compact	-5.7%	-2.8%	-2.9%	+19.3%	➖ noise
44	datafusion:vortex-file-compressed	-9.3%	-2.8%	-6.6%	+10.0%	➖ noise
44	duckdb:duckdb	-4.7%	-2.8%	-1.9%	+11.2%	➖ noise
44	duckdb:vortex-compact	-7.2%	-2.8%	-4.5%	+10.0%	➖ noise
44	duckdb:vortex-file-compressed	+0.3%	-2.8%	+3.3%	+13.7%	➖ noise
45	datafusion:vortex-compact	-1.6%	-6.3%	+5.0%	+10.0%	➖ noise
45	datafusion:vortex-file-compressed	-12.5%	-6.3%	-6.7%	+10.0%	➖ noise
45	duckdb:duckdb	-8.3%	-6.3%	-2.1%	+10.0%	➖ noise
45	duckdb:vortex-compact	-16.8%	-6.3%	-11.2%	+10.5%	✅ faster
45	duckdb:vortex-file-compressed	-6.5%	-6.3%	-0.3%	+17.6%	➖ noise
46	datafusion:vortex-compact	-2.9%	-6.5%	+3.8%	+10.0%	➖ noise
46	datafusion:vortex-file-compressed	-6.5%	-6.5%	-0.0%	+19.0%	➖ noise
46	duckdb:duckdb	-7.3%	-6.5%	-0.9%	+10.0%	➖ noise
46	duckdb:vortex-compact	-7.0%	-6.5%	-0.6%	+10.9%	➖ noise
46	duckdb:vortex-file-compressed	-12.4%	-6.5%	-6.3%	+10.0%	➖ noise
47	datafusion:vortex-compact	-5.4%	-8.5%	+3.4%	+10.0%	➖ noise
47	datafusion:vortex-file-compressed	-7.9%	-8.5%	+0.7%	+10.0%	➖ noise
47	duckdb:duckdb	-8.5%	-8.5%	+0.0%	+10.0%	➖ noise
47	duckdb:vortex-compact	-5.2%	-8.5%	+3.6%	+10.0%	➖ noise
47	duckdb:vortex-file-compressed	-5.4%	-8.5%	+3.4%	+10.0%	➖ noise
48	datafusion:vortex-compact	-4.1%	-5.2%	+1.2%	+19.1%	➖ noise
48	datafusion:vortex-file-compressed	-3.5%	-5.2%	+1.7%	+10.0%	➖ noise
48	duckdb:duckdb	-4.0%	-5.2%	+1.2%	+10.0%	➖ noise
48	duckdb:vortex-compact	-5.5%	-5.2%	-0.4%	+10.0%	➖ noise
48	duckdb:vortex-file-compressed	-6.5%	-5.2%	-1.4%	+29.1%	➖ noise
49	datafusion:vortex-compact	-2.8%	+0.9%	-3.6%	+10.1%	➖ noise
49	datafusion:vortex-file-compressed	-12.4%	+0.9%	-13.1%	+11.0%	✅ faster
49	duckdb:duckdb	-9.1%	+0.9%	-9.9%	+11.5%	➖ noise
49	duckdb:vortex-compact	-5.4%	+0.9%	-6.2%	+17.5%	➖ noise
49	duckdb:vortex-file-compressed	+2.6%	+0.9%	+1.7%	+17.8%	➖ noise
50	datafusion:vortex-compact	-8.3%	-2.5%	-5.9%	+10.0%	➖ noise
50	datafusion:vortex-file-compressed	-16.1%	-2.5%	-13.9%	+18.4%	➖ noise
50	duckdb:duckdb	-6.4%	-2.5%	-4.0%	+10.0%	➖ noise
50	duckdb:vortex-compact	-4.4%	-2.5%	-2.0%	+14.0%	➖ noise
50	duckdb:vortex-file-compressed	-10.9%	-2.5%	-8.6%	+11.8%	➖ noise
51	datafusion:vortex-compact	-3.2%	-5.3%	+2.2%	+15.6%	➖ noise
51	datafusion:vortex-file-compressed	-0.5%	-5.3%	+5.1%	+12.0%	➖ noise
51	duckdb:duckdb	-3.8%	-5.3%	+1.5%	+17.7%	➖ noise
51	duckdb:vortex-compact	-22.1%	-5.3%	-17.8%	+16.2%	✅ faster
51	duckdb:vortex-file-compressed	-2.9%	-5.3%	+2.6%	+16.4%	➖ noise
52	datafusion:vortex-compact	-3.7%	-3.6%	-0.1%	+16.2%	➖ noise
52	datafusion:vortex-file-compressed	-1.4%	-3.6%	+2.3%	+17.6%	➖ noise
52	duckdb:duckdb	-12.3%	-3.6%	-9.1%	+15.1%	➖ noise
52	duckdb:vortex-compact	-3.8%	-3.6%	-0.3%	+10.0%	➖ noise
52	duckdb:vortex-file-compressed	-1.0%	-3.6%	+2.7%	+10.0%	➖ noise
53	datafusion:vortex-compact	-2.0%	-2.8%	+0.7%	+24.1%	➖ noise
53	datafusion:vortex-file-compressed	-2.2%	-2.8%	+0.6%	+10.0%	➖ noise
53	duckdb:duckdb	-7.5%	-2.8%	-4.8%	+10.0%	➖ noise
53	duckdb:vortex-compact	-6.9%	-2.8%	-4.2%	+10.0%	➖ noise
53	duckdb:vortex-file-compressed	-1.4%	-2.8%	+1.4%	+10.0%	➖ noise
54	datafusion:vortex-compact	-3.2%	-4.4%	+1.2%	+10.0%	➖ noise
54	datafusion:vortex-file-compressed	-10.6%	-4.4%	-6.5%	+11.3%	➖ noise
54	duckdb:duckdb	-6.8%	-4.4%	-2.6%	+10.0%	➖ noise
54	duckdb:vortex-compact	-12.3%	-4.4%	-8.3%	+17.3%	➖ noise
54	duckdb:vortex-file-compressed	-3.2%	-4.4%	+1.2%	+10.0%	➖ noise
55	datafusion:vortex-compact	-8.9%	+1.2%	-10.0%	+15.4%	➖ noise
55	datafusion:vortex-file-compressed	-8.1%	+1.2%	-9.2%	+25.8%	➖ noise
55	duckdb:duckdb	+1.2%	+1.2%	+0.0%	+19.5%	➖ noise
55	duckdb:vortex-compact	-7.4%	+1.2%	-8.5%	+31.1%	➖ noise
55	duckdb:vortex-file-compressed	-4.9%	+1.2%	-6.0%	+16.1%	➖ noise
56	datafusion:vortex-compact	-13.2%	-5.8%	-7.8%	+17.0%	➖ noise
56	datafusion:vortex-file-compressed	-8.0%	-5.8%	-2.3%	+10.0%	➖ noise
56	duckdb:duckdb	-6.9%	-5.8%	-1.1%	+10.0%	➖ noise
56	duckdb:vortex-compact	-1.2%	-5.8%	+4.9%	+10.0%	➖ noise
56	duckdb:vortex-file-compressed	+6.6%	-5.8%	+13.2%	+36.9%	➖ noise
57	datafusion:vortex-compact	-3.0%	-7.6%	+4.9%	+10.0%	➖ noise
57	datafusion:vortex-file-compressed	-4.9%	-7.6%	+2.9%	+12.8%	➖ noise
57	duckdb:duckdb	-5.4%	-7.6%	+2.4%	+10.0%	➖ noise
57	duckdb:vortex-compact	-5.0%	-7.6%	+2.9%	+10.0%	➖ noise
57	duckdb:vortex-file-compressed	-2.9%	-7.6%	+5.1%	+10.0%	➖ noise
58	datafusion:vortex-compact	-9.0%	-3.4%	-5.8%	+10.8%	➖ noise
58	datafusion:vortex-file-compressed	-7.8%	-3.4%	-4.5%	+10.0%	➖ noise
58	duckdb:duckdb	-14.8%	-3.4%	-11.8%	+10.0%	✅ faster
58	duckdb:vortex-compact	-6.0%	-3.4%	-2.7%	+20.4%	➖ noise
58	duckdb:vortex-file-compressed	-3.1%	-3.4%	+0.3%	+10.0%	➖ noise
59	datafusion:vortex-compact	-4.2%	-3.2%	-1.0%	+10.0%	➖ noise
59	datafusion:vortex-file-compressed	-4.4%	-3.2%	-1.3%	+10.0%	➖ noise
59	duckdb:duckdb	-7.6%	-3.2%	-4.6%	+10.2%	➖ noise
59	duckdb:vortex-compact	-12.1%	-3.2%	-9.2%	+27.8%	➖ noise
59	duckdb:vortex-file-compressed	-4.1%	-3.2%	-0.9%	+36.3%	➖ noise
60	datafusion:vortex-compact	-3.1%	-6.5%	+3.6%	+13.3%	➖ noise
60	datafusion:vortex-file-compressed	-6.2%	-6.5%	+0.3%	+10.6%	➖ noise
60	duckdb:duckdb	-12.8%	-6.5%	-6.7%	+10.0%	➖ noise
60	duckdb:vortex-compact	+0.3%	-6.5%	+7.2%	+10.8%	➖ noise
60	duckdb:vortex-file-compressed	-8.9%	-6.5%	-2.6%	+17.0%	➖ noise
61	datafusion:vortex-compact	-3.5%	-4.8%	+1.4%	+13.6%	➖ noise
61	datafusion:vortex-file-compressed	-4.9%	-4.8%	-0.1%	+15.4%	➖ noise
61	duckdb:duckdb	-7.6%	-4.8%	-2.9%	+10.0%	➖ noise
61	duckdb:vortex-compact	-5.6%	-4.8%	-0.8%	+15.6%	➖ noise
61	duckdb:vortex-file-compressed	-7.1%	-4.8%	-2.4%	+10.0%	➖ noise
62	datafusion:vortex-compact	-11.4%	+0.5%	-11.8%	+33.3%	➖ noise
62	datafusion:vortex-file-compressed	-18.3%	+0.5%	-18.7%	+22.5%	✅ faster
62	duckdb:duckdb	-6.8%	+0.5%	-7.3%	+19.6%	➖ noise
62	duckdb:vortex-compact	-9.2%	+0.5%	-9.7%	+27.5%	➖ noise
62	duckdb:vortex-file-compressed	-3.7%	+0.5%	-4.3%	+12.7%	➖ noise
63	datafusion:vortex-compact	-7.3%	-2.9%	-4.6%	+12.7%	➖ noise
63	datafusion:vortex-file-compressed	-11.0%	-2.9%	-8.4%	+24.4%	➖ noise
63	duckdb:duckdb	-5.2%	-2.9%	-2.4%	+10.0%	➖ noise
63	duckdb:vortex-compact	-2.8%	-2.9%	+0.0%	+10.0%	➖ noise
63	duckdb:vortex-file-compressed	-6.7%	-2.9%	-4.0%	+10.0%	➖ noise
64	datafusion:vortex-compact	-9.6%	-7.8%	-1.9%	+10.0%	➖ noise
64	datafusion:vortex-file-compressed	-7.7%	-7.8%	+0.1%	+10.0%	➖ noise
64	duckdb:duckdb	-7.6%	-7.8%	+0.2%	+10.0%	➖ noise
64	duckdb:vortex-compact	-1.5%	-7.8%	+6.8%	+10.0%	➖ noise
64	duckdb:vortex-file-compressed	-7.6%	-7.8%	+0.2%	+10.0%	➖ noise
65	datafusion:vortex-compact	-7.1%	-3.1%	-4.1%	+35.3%	➖ noise
65	datafusion:vortex-file-compressed	-4.1%	-3.1%	-1.0%	+10.0%	➖ noise
65	duckdb:duckdb	-5.0%	-3.1%	-1.9%	+10.0%	➖ noise
65	duckdb:vortex-compact	+1.4%	-3.1%	+4.7%	+10.0%	➖ noise
65	duckdb:vortex-file-compressed	-6.4%	-3.1%	-3.3%	+10.0%	➖ noise
66	datafusion:vortex-compact	-0.6%	-8.1%	+8.2%	+14.7%	➖ noise
66	datafusion:vortex-file-compressed	-17.1%	-8.1%	-9.8%	+16.2%	➖ noise
66	duckdb:duckdb	-6.2%	-8.1%	+2.1%	+10.3%	➖ noise
66	duckdb:vortex-compact	-7.4%	-8.1%	+0.8%	+26.2%	➖ noise
66	duckdb:vortex-file-compressed	-6.0%	-8.1%	+2.3%	+10.0%	➖ noise
67	datafusion:vortex-compact	-0.1%	-7.7%	+8.2%	+13.6%	➖ noise
67	datafusion:vortex-file-compressed	-3.9%	-7.7%	+4.1%	+12.5%	➖ noise
67	duckdb:duckdb	-1.1%	-7.7%	+7.2%	+10.0%	➖ noise
67	duckdb:vortex-compact	-3.8%	-7.7%	+4.2%	+10.0%	➖ noise
67	duckdb:vortex-file-compressed	-7.3%	-7.7%	+0.4%	+10.0%	➖ noise
68	datafusion:vortex-compact	-5.3%	-6.2%	+1.0%	+10.0%	➖ noise
68	datafusion:vortex-file-compressed	-19.1%	-6.2%	-13.7%	+20.3%	➖ noise
68	duckdb:duckdb	-3.8%	-6.2%	+2.6%	+10.0%	➖ noise
68	duckdb:vortex-compact	-4.5%	-6.2%	+1.9%	+10.0%	➖ noise
68	duckdb:vortex-file-compressed	-11.5%	-6.2%	-5.6%	+21.1%	➖ noise
69	datafusion:vortex-compact	-5.2%	-0.7%	-4.5%	+22.7%	➖ noise
69	datafusion:vortex-file-compressed	-5.4%	-0.7%	-4.8%	+25.6%	➖ noise
69	duckdb:duckdb	-6.7%	-0.7%	-6.1%	+10.0%	➖ noise
69	duckdb:vortex-compact	-8.0%	-0.7%	-7.3%	+11.4%	➖ noise
69	duckdb:vortex-file-compressed	-6.0%	-0.7%	-5.3%	+11.1%	➖ noise
70	datafusion:vortex-compact	-0.5%	-7.6%	+7.6%	+19.8%	➖ noise
70	datafusion:vortex-file-compressed	-3.4%	-7.6%	+4.5%	+10.0%	➖ noise
70	duckdb:duckdb	-8.3%	-7.6%	-0.8%	+10.0%	➖ noise
70	duckdb:vortex-compact	-3.1%	-7.6%	+4.8%	+13.8%	➖ noise
70	duckdb:vortex-file-compressed	-0.2%	-7.6%	+8.0%	+12.3%	➖ noise
71	datafusion:vortex-compact	-1.4%	-7.3%	+6.4%	+10.0%	➖ noise
71	datafusion:vortex-file-compressed	-5.5%	-7.3%	+1.9%	+10.0%	➖ noise
71	duckdb:duckdb	-8.4%	-7.3%	-1.2%	+27.0%	➖ noise
71	duckdb:vortex-compact	-2.9%	-7.3%	+4.7%	+12.7%	➖ noise
71	duckdb:vortex-file-compressed	-9.1%	-7.3%	-2.0%	+10.0%	➖ noise
72	datafusion:vortex-compact	-11.3%	-5.0%	-6.6%	+10.0%	➖ noise
72	datafusion:vortex-file-compressed	-11.9%	-5.0%	-7.3%	+10.0%	➖ noise
72	duckdb:duckdb	-5.4%	-5.0%	-0.5%	+10.0%	➖ noise
72	duckdb:vortex-compact	+0.2%	-5.0%	+5.5%	+10.0%	➖ noise
72	duckdb:vortex-file-compressed	-1.7%	-5.0%	+3.5%	+10.0%	➖ noise
73	datafusion:vortex-compact	-6.8%	-5.4%	-1.5%	+18.3%	➖ noise
73	datafusion:vortex-file-compressed	-7.0%	-5.4%	-1.7%	+10.0%	➖ noise
73	duckdb:duckdb	-13.9%	-5.4%	-9.1%	+10.0%	➖ noise
73	duckdb:vortex-compact	-6.3%	-5.4%	-1.0%	+10.0%	➖ noise
73	duckdb:vortex-file-compressed	-8.0%	-5.4%	-2.8%	+19.4%	➖ noise
74	datafusion:vortex-compact	-5.9%	-10.4%	+5.0%	+20.4%	➖ noise
74	datafusion:vortex-file-compressed	-7.2%	-10.4%	+3.5%	+20.1%	➖ noise
74	duckdb:duckdb	-4.2%	-10.4%	+6.9%	+10.1%	➖ noise
74	duckdb:vortex-compact	+3.2%	-10.4%	+15.2%	+19.0%	➖ noise
74	duckdb:vortex-file-compressed	-5.0%	-10.4%	+6.0%	+11.7%	➖ noise
75	datafusion:vortex-compact	-1.9%	-2.9%	+1.0%	+16.3%	➖ noise
75	datafusion:vortex-file-compressed	-6.0%	-2.9%	-3.2%	+13.8%	➖ noise
75	duckdb:duckdb	-4.4%	-2.9%	-1.5%	+10.0%	➖ noise
75	duckdb:vortex-compact	-4.3%	-2.9%	-1.5%	+10.0%	➖ noise
75	duckdb:vortex-file-compressed	-0.8%	-2.9%	+2.1%	+11.1%	➖ noise
76	datafusion:vortex-compact	-1.9%	+1.9%	-3.7%	+10.0%	➖ noise
76	datafusion:vortex-file-compressed	-4.4%	+1.9%	-6.2%	+10.0%	➖ noise
76	duckdb:duckdb	+0.2%	+1.9%	-1.6%	+10.0%	➖ noise
76	duckdb:vortex-compact	-11.4%	+1.9%	-13.0%	+13.0%	✅ faster
76	duckdb:vortex-file-compressed	-4.9%	+1.9%	-6.6%	+21.4%	➖ noise
77	datafusion:vortex-compact	-2.4%	-12.9%	+12.0%	+10.0%	🚨 regression
77	datafusion:vortex-file-compressed	-4.6%	-12.9%	+9.5%	+23.3%	➖ noise
77	duckdb:duckdb	-10.9%	-12.9%	+2.3%	+10.0%	➖ noise
77	duckdb:vortex-compact	-5.4%	-12.9%	+8.6%	+32.9%	➖ noise
77	duckdb:vortex-file-compressed	-7.4%	-12.9%	+6.3%	+13.7%	➖ noise
78	datafusion:vortex-compact	-4.9%	-8.1%	+3.6%	+12.7%	➖ noise
78	datafusion:vortex-file-compressed	-7.0%	-8.1%	+1.2%	+11.3%	➖ noise
78	duckdb:duckdb	-7.7%	-8.1%	+0.5%	+10.0%	➖ noise
78	duckdb:vortex-compact	-6.4%	-8.1%	+1.9%	+10.0%	➖ noise
78	duckdb:vortex-file-compressed	-4.2%	-8.1%	+4.3%	+10.0%	➖ noise
79	datafusion:vortex-compact	-6.1%	+3.8%	-9.5%	+13.5%	➖ noise
79	datafusion:vortex-file-compressed	-6.8%	+3.8%	-10.2%	+12.5%	➖ noise
79	duckdb:duckdb	-10.1%	+3.8%	-13.4%	+13.3%	✅ faster
79	duckdb:vortex-compact	+6.4%	+3.8%	+2.5%	+10.8%	➖ noise
79	duckdb:vortex-file-compressed	-13.1%	+3.8%	-16.3%	+18.1%	✅ faster
80	datafusion:vortex-compact	-12.1%	-5.4%	-7.1%	+13.6%	➖ noise
80	datafusion:vortex-file-compressed	-13.8%	-5.4%	-8.9%	+17.2%	➖ noise
80	duckdb:duckdb	-8.1%	-5.4%	-2.8%	+10.7%	➖ noise
80	duckdb:vortex-compact	-2.9%	-5.4%	+2.7%	+13.2%	➖ noise
80	duckdb:vortex-file-compressed	-6.8%	-5.4%	-1.5%	+10.0%	➖ noise
81	datafusion:vortex-compact	+1.0%	-5.0%	+6.3%	+10.0%	➖ noise
81	datafusion:vortex-file-compressed	-8.7%	-5.0%	-3.8%	+10.0%	➖ noise
81	duckdb:duckdb	-9.4%	-5.0%	-4.5%	+10.0%	➖ noise
81	duckdb:vortex-compact	-10.4%	-5.0%	-5.6%	+10.0%	➖ noise
81	duckdb:vortex-file-compressed	-5.4%	-5.0%	-0.4%	+10.0%	➖ noise
82	datafusion:vortex-compact	-2.4%	-6.2%	+4.0%	+10.0%	➖ noise
82	datafusion:vortex-file-compressed	-11.9%	-6.2%	-6.1%	+12.5%	➖ noise
82	duckdb:duckdb	+0.9%	-6.2%	+7.5%	+12.8%	➖ noise
82	duckdb:vortex-compact	-7.6%	-6.2%	-1.5%	+14.7%	➖ noise
82	duckdb:vortex-file-compressed	-2.9%	-6.2%	+3.4%	+10.0%	➖ noise
83	datafusion:vortex-compact	-19.7%	-3.7%	-16.6%	+23.8%	➖ noise
83	datafusion:vortex-file-compressed	-5.1%	-3.7%	-1.5%	+10.0%	➖ noise
83	duckdb:duckdb	-10.4%	-3.7%	-7.0%	+10.0%	➖ noise
83	duckdb:vortex-compact	-6.5%	-3.7%	-2.9%	+10.0%	➖ noise
83	duckdb:vortex-file-compressed	-2.7%	-3.7%	+1.0%	+10.0%	➖ noise
84	datafusion:vortex-compact	-6.5%	-6.1%	-0.5%	+11.1%	➖ noise
84	datafusion:vortex-file-compressed	-14.5%	-6.1%	-9.0%	+10.0%	➖ noise
84	duckdb:duckdb	-7.7%	-6.1%	-1.7%	+17.7%	➖ noise
84	duckdb:vortex-compact	-7.1%	-6.1%	-1.1%	+10.1%	➖ noise
84	duckdb:vortex-file-compressed	-9.2%	-6.1%	-3.3%	+10.0%	➖ noise
85	datafusion:vortex-compact	-2.3%	-6.4%	+4.5%	+11.3%	➖ noise
85	datafusion:vortex-file-compressed	-9.1%	-6.4%	-2.8%	+11.8%	➖ noise
85	duckdb:duckdb	-11.3%	-6.4%	-5.2%	+10.0%	➖ noise
85	duckdb:vortex-compact	-8.5%	-6.4%	-2.2%	+10.0%	➖ noise
85	duckdb:vortex-file-compressed	-7.2%	-6.4%	-0.8%	+10.0%	➖ noise
86	datafusion:vortex-compact	-15.5%	-16.6%	+1.3%	+25.4%	➖ noise
86	datafusion:vortex-file-compressed	+0.2%	-16.6%	+20.0%	+17.9%	🚨 regression
86	duckdb:duckdb	-8.9%	-16.6%	+9.2%	+13.4%	➖ noise
86	duckdb:vortex-compact	-4.8%	-16.6%	+14.1%	+27.1%	➖ noise
86	duckdb:vortex-file-compressed	-1.3%	-16.6%	+18.2%	+28.8%	➖ noise
87	datafusion:vortex-compact	-5.8%	-6.8%	+1.0%	+10.0%	➖ noise
87	datafusion:vortex-file-compressed	-10.4%	-6.8%	-3.9%	+10.0%	➖ noise
87	duckdb:duckdb	-3.8%	-6.8%	+3.2%	+11.2%	➖ noise
87	duckdb:vortex-compact	-9.6%	-6.8%	-3.1%	+16.3%	➖ noise
87	duckdb:vortex-file-compressed	-9.8%	-6.8%	-3.3%	+18.2%	➖ noise
88	datafusion:vortex-compact	+0.7%	-3.6%	+4.5%	+10.0%	➖ noise
88	datafusion:vortex-file-compressed	-13.0%	-3.6%	-9.7%	+14.1%	➖ noise
88	duckdb:duckdb	-9.6%	-3.6%	-6.2%	+10.0%	➖ noise
88	duckdb:vortex-compact	-7.9%	-3.6%	-4.5%	+10.0%	➖ noise
88	duckdb:vortex-file-compressed	-5.8%	-3.6%	-2.2%	+10.0%	➖ noise
89	datafusion:vortex-compact	-19.3%	-2.6%	-17.2%	+21.8%	➖ noise
89	datafusion:vortex-file-compressed	-12.8%	-2.6%	-10.5%	+26.0%	➖ noise
89	duckdb:duckdb	-5.0%	-2.6%	-2.5%	+10.0%	➖ noise
89	duckdb:vortex-compact	-2.8%	-2.6%	-0.2%	+10.0%	➖ noise
89	duckdb:vortex-file-compressed	-10.2%	-2.6%	-7.8%	+10.0%	➖ noise
90	datafusion:vortex-compact	-5.1%	-9.1%	+4.4%	+12.1%	➖ noise
90	datafusion:vortex-file-compressed	-9.9%	-9.1%	-0.9%	+10.0%	➖ noise
90	duckdb:duckdb	-12.7%	-9.1%	-4.0%	+10.8%	➖ noise
90	duckdb:vortex-compact	-6.7%	-9.1%	+2.7%	+10.0%	➖ noise
90	duckdb:vortex-file-compressed	-13.1%	-9.1%	-4.4%	+49.8%	➖ noise
91	datafusion:vortex-compact	-6.2%	-4.4%	-1.9%	+10.0%	➖ noise
91	datafusion:vortex-file-compressed	-11.1%	-4.4%	-7.0%	+10.0%	➖ noise
91	duckdb:duckdb	-7.0%	-4.4%	-2.8%	+10.5%	➖ noise
91	duckdb:vortex-compact	-11.4%	-4.4%	-7.3%	+10.0%	➖ noise
91	duckdb:vortex-file-compressed	-19.6%	-4.4%	-15.9%	+11.8%	✅ faster
92	datafusion:vortex-compact	-4.9%	-3.9%	-1.1%	+14.5%	➖ noise
92	datafusion:vortex-file-compressed	-12.7%	-3.9%	-9.1%	+10.0%	✅ faster
92	duckdb:duckdb	-8.3%	-3.9%	-4.6%	+10.0%	➖ noise
92	duckdb:vortex-compact	+4.8%	-3.9%	+9.0%	+20.7%	➖ noise
92	duckdb:vortex-file-compressed	-12.6%	-3.9%	-9.1%	+10.4%	➖ noise
93	datafusion:vortex-compact	-7.0%	-7.0%	-0.0%	+10.0%	➖ noise
93	datafusion:vortex-file-compressed	-5.9%	-7.0%	+1.2%	+10.0%	➖ noise
93	duckdb:duckdb	-12.5%	-7.0%	-5.9%	+10.0%	➖ noise
93	duckdb:vortex-compact	-7.5%	-7.0%	-0.5%	+15.5%	➖ noise
93	duckdb:vortex-file-compressed	-7.2%	-7.0%	-0.2%	+10.0%	➖ noise
94	datafusion:vortex-compact	+2.1%	-1.1%	+3.3%	+25.1%	➖ noise
94	datafusion:vortex-file-compressed	-10.8%	-1.1%	-9.8%	+10.0%	✅ faster
94	duckdb:duckdb	-7.0%	-1.1%	-5.9%	+10.0%	➖ noise
94	duckdb:vortex-compact	-10.7%	-1.1%	-9.7%	+10.0%	✅ faster
94	duckdb:vortex-file-compressed	-12.7%	-1.1%	-11.7%	+10.0%	✅ faster
95	datafusion:vortex-compact	-2.7%	-3.5%	+0.9%	+13.0%	➖ noise
95	datafusion:vortex-file-compressed	-11.1%	-3.5%	-7.9%	+12.3%	➖ noise
95	duckdb:duckdb	+6.7%	-3.5%	+10.6%	+19.2%	➖ noise
95	duckdb:vortex-compact	-4.4%	-3.5%	-1.0%	+18.7%	➖ noise
95	duckdb:vortex-file-compressed	-13.0%	-3.5%	-9.8%	+17.1%	➖ noise
96	datafusion:vortex-compact	-3.6%	-7.5%	+4.3%	+11.0%	➖ noise
96	datafusion:vortex-file-compressed	-0.5%	-7.5%	+7.5%	+25.7%	➖ noise
96	duckdb:duckdb	-29.9%	-7.5%	-24.2%	+27.9%	✅ faster
96	duckdb:vortex-compact	-1.0%	-7.5%	+7.0%	+11.0%	➖ noise
96	duckdb:vortex-file-compressed	-15.8%	-7.5%	-9.0%	+12.6%	➖ noise
97	datafusion:vortex-compact	-5.6%	-6.5%	+1.1%	+10.2%	➖ noise
97	datafusion:vortex-file-compressed	-8.6%	-6.5%	-2.2%	+10.0%	➖ noise
97	duckdb:duckdb	-8.6%	-6.5%	-2.2%	+10.0%	➖ noise
97	duckdb:vortex-compact	-6.3%	-6.5%	+0.3%	+12.5%	➖ noise
97	duckdb:vortex-file-compressed	-6.8%	-6.5%	-0.3%	+10.0%	➖ noise
98	datafusion:vortex-compact	-3.1%	-4.0%	+0.9%	+10.0%	➖ noise
98	datafusion:vortex-file-compressed	-7.0%	-4.0%	-3.1%	+11.2%	➖ noise
98	duckdb:duckdb	+1.1%	-4.0%	+5.3%	+10.7%	➖ noise
98	duckdb:vortex-compact	-7.8%	-4.0%	-3.9%	+10.0%	➖ noise
98	duckdb:vortex-file-compressed	-1.0%	-4.0%	+3.0%	+21.9%	➖ noise
99	datafusion:vortex-compact	-14.8%	-1.6%	-13.4%	+30.0%	➖ noise
99	datafusion:vortex-file-compressed	-15.5%	-1.6%	-14.1%	+19.3%	➖ noise
99	duckdb:duckdb	-9.6%	-1.6%	-8.1%	+24.1%	➖ noise
99	duckdb:vortex-compact	+2.3%	-1.6%	+3.9%	+19.9%	➖ noise
99	duckdb:vortex-file-compressed	-9.4%	-1.6%	-8.0%	+12.2%	➖ noise

[github-actions]

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.9%
Engines: DataFusion No clear signal (+3.0%, environment too noisy confidence) · DuckDB No clear signal (-6.5%, environment too noisy confidence)
Vortex (geomean): 1.068x ➖
Parquet (geomean): 1.088x ➖
Shifts: Parquet (control) +8.8% · Median polish +1.5%

How to read Verdict and Engines

• Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
• Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
• Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

---

datafusion / vortex-file-compressed (1.196x ➖, 0↑ 3↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨	90146784	50925269	1.77
fineweb_q01/datafusion:vortex-file-compressed 🚨	955768619	654518908	1.46
fineweb_q02/datafusion:vortex-file-compressed 🚨	925919746	475039291	1.95
fineweb_q03/datafusion:vortex-file-compressed	1358842173	1449451397	0.94
fineweb_q04/datafusion:vortex-file-compressed	1351739578	1398148023	0.97
fineweb_q05/datafusion:vortex-file-compressed	1329054643	1395597441	0.95
fineweb_q06/datafusion:vortex-file-compressed	1751338439	1814702763	0.97
fineweb_q07/datafusion:vortex-file-compressed	1626912707	1424683403	1.14
fineweb_q08/datafusion:vortex-file-compressed	578196175	552433967	1.05

datafusion / vortex-compact (1.150x ➖, 0↑ 3↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-compact	33063746	38317109	0.86
fineweb_q01/datafusion:vortex-compact 🚨	917565790	626546111	1.46
fineweb_q02/datafusion:vortex-compact 🚨	916707442	614804257	1.49
fineweb_q03/datafusion:vortex-compact	1367644854	1374298005	1.00
fineweb_q04/datafusion:vortex-compact	1562087809	1581555212	0.99
fineweb_q05/datafusion:vortex-compact	1366475544	1375321397	0.99
fineweb_q06/datafusion:vortex-compact 🚨	2006027711	1292144359	1.55
fineweb_q07/datafusion:vortex-compact	1205704172	1181666628	1.02
fineweb_q08/datafusion:vortex-compact	428542229	355493643	1.21

datafusion / parquet (1.139x ➖, 0↑ 2↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
fineweb_q00/datafusion:parquet	1427689346	1612875358	0.89
fineweb_q01/datafusion:parquet	2426865571	2109821711	1.15
fineweb_q02/datafusion:parquet	2414655802	1863591163	1.30
fineweb_q03/datafusion:parquet	2293185051	2096894186	1.09
fineweb_q04/datafusion:parquet	2432900581	2054470980	1.18
fineweb_q05/datafusion:parquet	2406597829	2408106207	1.00
fineweb_q06/datafusion:parquet 🚨	2614807532	2007519862	1.30
fineweb_q07/datafusion:parquet	2527536576	2363617940	1.07
fineweb_q08/datafusion:parquet 🚨	2629323391	1941873554	1.35

duckdb / vortex-file-compressed (0.970x ➖, 1↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed	82841834	96277116	0.86
fineweb_q01/duckdb:vortex-file-compressed 🚀	564484926	857547579	0.66
fineweb_q02/duckdb:vortex-file-compressed	569181599	543357052	1.05
fineweb_q03/duckdb:vortex-file-compressed	1581358481	1493382032	1.06
fineweb_q04/duckdb:vortex-file-compressed	1671853423	1613615735	1.04
fineweb_q05/duckdb:vortex-file-compressed	1648103420	1435470456	1.15
fineweb_q06/duckdb:vortex-file-compressed	1702984412	1677613846	1.02
fineweb_q07/duckdb:vortex-file-compressed	1478550065	1589973224	0.93
fineweb_q08/duckdb:vortex-file-compressed	729075579	676223596	1.08

duckdb / vortex-compact (0.974x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-compact	95976684	76932491	1.25
fineweb_q01/duckdb:vortex-compact	560373845	764985693	0.73
fineweb_q02/duckdb:vortex-compact	679980015	669994736	1.01
fineweb_q03/duckdb:vortex-compact	1676726033	1593229961	1.05
fineweb_q04/duckdb:vortex-compact	1708772315	1824689357	0.94
fineweb_q05/duckdb:vortex-compact	1653330439	1559082418	1.06
fineweb_q06/duckdb:vortex-compact	1596564578	1600643688	1.00
fineweb_q07/duckdb:vortex-compact	1398041796	1534941925	0.91
fineweb_q08/duckdb:vortex-compact	504844160	561471949	0.90

duckdb / parquet (1.040x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
fineweb_q00/duckdb:parquet	1395769832	1233592013	1.13
fineweb_q01/duckdb:parquet	1537638249	1342569288	1.15
fineweb_q02/duckdb:parquet	1490142836	1446420637	1.03
fineweb_q03/duckdb:parquet	4068315770	3947391492	1.03
fineweb_q04/duckdb:parquet	1987917223	2030369198	0.98
fineweb_q05/duckdb:parquet	2205835411	2296912479	0.96
fineweb_q06/duckdb:parquet	4585897418	4520632065	1.01
fineweb_q07/duckdb:parquet	2968862156	2729953297	1.09
fineweb_q08/duckdb:parquet	1180269846	1179819015	1.00

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	datafusion:vortex-compact	-13.7%	+0.1%	-13.8%	+166.8%	➖ noise
0	datafusion:vortex-file-compressed	+77.0%	+0.1%	+76.9%	+136.5%	➖ noise
0	duckdb:vortex-compact	+24.8%	+0.1%	+24.7%	+68.2%	➖ noise
0	duckdb:vortex-file-compressed	-14.0%	+0.1%	-14.0%	+60.1%	➖ noise
1	datafusion:vortex-compact	+46.4%	+14.8%	+27.6%	+63.0%	➖ noise
1	datafusion:vortex-file-compressed	+46.0%	+14.8%	+27.2%	+62.5%	➖ noise
1	duckdb:vortex-compact	-26.7%	+14.8%	-36.2%	+55.4%	✅ faster
1	duckdb:vortex-file-compressed	-34.2%	+14.8%	-42.6%	+30.0%	✅ faster
2	datafusion:vortex-compact	+49.1%	+15.5%	+29.1%	+76.9%	➖ noise
2	datafusion:vortex-file-compressed	+94.9%	+15.5%	+68.7%	+45.0%	🚨 regression
2	duckdb:vortex-compact	+1.5%	+15.5%	-12.2%	+43.8%	➖ noise
2	duckdb:vortex-file-compressed	+4.8%	+15.5%	-9.3%	+53.6%	➖ noise
3	datafusion:vortex-compact	-0.5%	+6.2%	-6.3%	+30.0%	➖ noise
3	datafusion:vortex-file-compressed	-6.3%	+6.2%	-11.7%	+30.0%	➖ noise
3	duckdb:vortex-compact	+5.2%	+6.2%	-0.9%	+30.0%	➖ noise
3	duckdb:vortex-file-compressed	+5.9%	+6.2%	-0.3%	+30.0%	➖ noise
4	datafusion:vortex-compact	-1.2%	+7.7%	-8.3%	+30.0%	➖ noise
4	datafusion:vortex-file-compressed	-3.3%	+7.7%	-10.2%	+30.0%	➖ noise
4	duckdb:vortex-compact	-6.4%	+7.7%	-13.0%	+30.0%	➖ noise
4	duckdb:vortex-file-compressed	+3.6%	+7.7%	-3.8%	+30.0%	➖ noise
5	datafusion:vortex-compact	-0.6%	-2.0%	+1.4%	+30.0%	➖ noise
5	datafusion:vortex-file-compressed	-4.8%	-2.0%	-2.8%	+30.0%	➖ noise
5	duckdb:vortex-compact	+6.0%	-2.0%	+8.2%	+30.0%	➖ noise
5	duckdb:vortex-file-compressed	+14.8%	-2.0%	+17.2%	+30.0%	➖ noise
6	datafusion:vortex-compact	+55.2%	+14.9%	+35.1%	+39.1%	➖ noise
6	datafusion:vortex-file-compressed	-3.5%	+14.9%	-16.0%	+30.0%	➖ noise
6	duckdb:vortex-compact	-0.3%	+14.9%	-13.2%	+31.3%	➖ noise
6	duckdb:vortex-file-compressed	+1.5%	+14.9%	-11.7%	+30.0%	➖ noise
7	datafusion:vortex-compact	+2.0%	+7.8%	-5.4%	+30.0%	➖ noise
7	datafusion:vortex-file-compressed	+14.2%	+7.8%	+5.9%	+30.0%	➖ noise
7	duckdb:vortex-compact	-8.9%	+7.8%	-15.5%	+30.0%	➖ noise
7	duckdb:vortex-file-compressed	-7.0%	+7.8%	-13.8%	+30.0%	➖ noise
8	datafusion:vortex-compact	+20.5%	+16.4%	+3.6%	+30.0%	➖ noise
8	datafusion:vortex-file-compressed	+4.7%	+16.4%	-10.1%	+34.7%	➖ noise
8	duckdb:vortex-compact	-10.1%	+16.4%	-22.7%	+40.0%	➖ noise
8	duckdb:vortex-file-compressed	+7.8%	+16.4%	-7.4%	+71.4%	➖ noise

[github-actions]

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): 1.005x ➖
Parquet (geomean): 1.005x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.2%

How to read Verdict and Engines

• Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
• Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
• Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

---

duckdb / vortex-file-compressed (1.011x ➖, 0↑ 1↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 🚨	12827422	11460423	1.12
statpopgen_q01/duckdb:vortex-file-compressed	26775073	26940677	0.99
statpopgen_q02/duckdb:vortex-file-compressed	533563889	529369897	1.01
statpopgen_q03/duckdb:vortex-file-compressed	1057555438	1038024702	1.02
statpopgen_q04/duckdb:vortex-file-compressed	1063751271	1083273652	0.98
statpopgen_q05/duckdb:vortex-file-compressed	484828107	492258924	0.98
statpopgen_q06/duckdb:vortex-file-compressed	1537271674	1511832959	1.02
statpopgen_q07/duckdb:vortex-file-compressed	201627412	199652061	1.01
statpopgen_q08/duckdb:vortex-file-compressed	228096077	229834683	0.99
statpopgen_q09/duckdb:vortex-file-compressed	838985910	837691256	1.00
statpopgen_q10/duckdb:vortex-file-compressed	2561019055	2561718728	1.00

duckdb / vortex-compact (0.999x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact	11595783	11629438	1.00
statpopgen_q01/duckdb:vortex-compact	216989479	215369367	1.01
statpopgen_q02/duckdb:vortex-compact	551945395	577463311	0.96
statpopgen_q03/duckdb:vortex-compact	1131430205	1129253518	1.00
statpopgen_q04/duckdb:vortex-compact	1157538887	1135176619	1.02
statpopgen_q05/duckdb:vortex-compact	585812387	581679197	1.01
statpopgen_q06/duckdb:vortex-compact	1477621105	1488878427	0.99
statpopgen_q07/duckdb:vortex-compact	881522819	886569816	0.99
statpopgen_q08/duckdb:vortex-compact	921863807	915950694	1.01
statpopgen_q09/duckdb:vortex-compact	922575631	919481551	1.00
statpopgen_q10/duckdb:vortex-compact	2586367862	2588257927	1.00

duckdb / parquet (1.005x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
statpopgen_q00/duckdb:parquet	302122347	301758465	1.00
statpopgen_q01/duckdb:parquet	383897888	378896562	1.01
statpopgen_q02/duckdb:parquet	760190986	759300895	1.00
statpopgen_q03/duckdb:parquet	1184730388	1186764854	1.00
statpopgen_q04/duckdb:parquet	1203294300	1172757589	1.03
statpopgen_q05/duckdb:parquet	799249148	810810600	0.99
statpopgen_q06/duckdb:parquet	1420367800	1418463975	1.00
statpopgen_q07/duckdb:parquet	856088824	832529442	1.03
statpopgen_q08/duckdb:parquet	848217477	842787159	1.01
statpopgen_q09/duckdb:parquet	1013676343	1009788481	1.00
statpopgen_q10/duckdb:parquet	2182425450	2193887676	0.99

---

No baseline file sizes found for base commit.

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	duckdb:vortex-compact	-0.3%	+0.1%	-0.4%	+10.0%	➖ noise
0	duckdb:vortex-file-compressed	+11.9%	+0.1%	+11.8%	+10.8%	🚨 regression
1	duckdb:vortex-compact	+0.8%	+1.3%	-0.6%	+37.4%	➖ noise
1	duckdb:vortex-file-compressed	-0.6%	+1.3%	-1.9%	+218.4%	➖ noise
2	duckdb:vortex-compact	-4.4%	+0.1%	-4.5%	+10.0%	➖ noise
2	duckdb:vortex-file-compressed	+0.8%	+0.1%	+0.7%	+10.0%	➖ noise
3	duckdb:vortex-compact	+0.2%	-0.2%	+0.4%	+10.0%	➖ noise
3	duckdb:vortex-file-compressed	+1.9%	-0.2%	+2.1%	+10.0%	➖ noise
4	duckdb:vortex-compact	+2.0%	+2.6%	-0.6%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	-1.8%	+2.6%	-4.3%	+10.0%	➖ noise
5	duckdb:vortex-compact	+0.7%	-1.4%	+2.2%	+10.0%	➖ noise
5	duckdb:vortex-file-compressed	-1.5%	-1.4%	-0.1%	+10.1%	➖ noise
6	duckdb:vortex-compact	-0.8%	+0.1%	-0.9%	+10.0%	➖ noise
6	duckdb:vortex-file-compressed	+1.7%	+0.1%	+1.5%	+10.0%	➖ noise
7	duckdb:vortex-compact	-0.6%	+2.8%	-3.3%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	+1.0%	+2.8%	-1.8%	+10.0%	➖ noise
8	duckdb:vortex-compact	+0.6%	+0.6%	+0.0%	+10.0%	➖ noise
8	duckdb:vortex-file-compressed	-0.8%	+0.6%	-1.4%	+10.0%	➖ noise
9	duckdb:vortex-compact	+0.3%	+0.4%	-0.0%	+10.0%	➖ noise
9	duckdb:vortex-file-compressed	+0.2%	+0.4%	-0.2%	+10.0%	➖ noise
10	duckdb:vortex-compact	-0.1%	-0.5%	+0.5%	+10.0%	➖ noise
10	duckdb:vortex-file-compressed	-0.0%	-0.5%	+0.5%	+10.0%	➖ noise

[AdamGS]

GH is having a bit of a hard time, but it should work IMO.

[github-actions]

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.7%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): 0.998x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.3%

How to read Verdict and Engines

• Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
• Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
• Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

---

datafusion / vortex-file-compressed (0.992x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	392450891	408399813	0.96
tpch_q02/datafusion:vortex-file-compressed	113364424	111150751	1.02
tpch_q03/datafusion:vortex-file-compressed	213986279	214741604	1.00
tpch_q04/datafusion:vortex-file-compressed	115129390	115490514	1.00
tpch_q05/datafusion:vortex-file-compressed	377707349	379447441	1.00
tpch_q06/datafusion:vortex-file-compressed	37367905	38660134	0.97
tpch_q07/datafusion:vortex-file-compressed	505380922	505498962	1.00
tpch_q08/datafusion:vortex-file-compressed	370328518	374193658	0.99
tpch_q09/datafusion:vortex-file-compressed	648712116	652227385	0.99
tpch_q10/datafusion:vortex-file-compressed	230004819	236544514	0.97
tpch_q11/datafusion:vortex-file-compressed	85816139	85054213	1.01
tpch_q12/datafusion:vortex-file-compressed	117775589	116782148	1.01
tpch_q13/datafusion:vortex-file-compressed	216700568	219977109	0.99
tpch_q14/datafusion:vortex-file-compressed	53001968	53159029	1.00
tpch_q15/datafusion:vortex-file-compressed	98706003	99796814	0.99
tpch_q16/datafusion:vortex-file-compressed	77821747	78233449	0.99
tpch_q17/datafusion:vortex-file-compressed	641675348	642714321	1.00
tpch_q18/datafusion:vortex-file-compressed	869246120	871075495	1.00
tpch_q19/datafusion:vortex-file-compressed	73348980	74886347	0.98
tpch_q20/datafusion:vortex-file-compressed	162511044	161588667	1.01
tpch_q21/datafusion:vortex-file-compressed	668039120	675746792	0.99
tpch_q22/datafusion:vortex-file-compressed	66202193	67674223	0.98

datafusion / vortex-compact (0.997x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact	433411739	447298604	0.97
tpch_q02/datafusion:vortex-compact	115314984	114797104	1.00
tpch_q03/datafusion:vortex-compact	220467276	215732281	1.02
tpch_q04/datafusion:vortex-compact	120323572	123303938	0.98
tpch_q05/datafusion:vortex-compact	382742196	384416575	1.00
tpch_q06/datafusion:vortex-compact	59890872	60390238	0.99
tpch_q07/datafusion:vortex-compact	524293683	527777385	0.99
tpch_q08/datafusion:vortex-compact	375073705	371843102	1.01
tpch_q09/datafusion:vortex-compact	660776703	656549949	1.01
tpch_q10/datafusion:vortex-compact	248413019	247404498	1.00
tpch_q11/datafusion:vortex-compact	89852968	89089802	1.01
tpch_q12/datafusion:vortex-compact	160040437	161536757	0.99
tpch_q13/datafusion:vortex-compact	268421352	266135038	1.01
tpch_q14/datafusion:vortex-compact	70666941	71887348	0.98
tpch_q15/datafusion:vortex-compact	156169535	155898078	1.00
tpch_q16/datafusion:vortex-compact	81204229	81574835	1.00
tpch_q17/datafusion:vortex-compact	642061129	643271233	1.00
tpch_q18/datafusion:vortex-compact	867768405	881513809	0.98
tpch_q19/datafusion:vortex-compact	124581152	125059957	1.00
tpch_q20/datafusion:vortex-compact	189723991	190203586	1.00
tpch_q21/datafusion:vortex-compact	680412799	677130270	1.00
tpch_q22/datafusion:vortex-compact	76332745	76556381	1.00

datafusion / parquet (0.999x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	449730335	439898365	1.02
tpch_q02/datafusion:parquet	176348993	176415007	1.00
tpch_q03/datafusion:parquet	280424455	284271293	0.99
tpch_q04/datafusion:parquet	126645158	129973026	0.97
tpch_q05/datafusion:parquet	439932601	440316781	1.00
tpch_q06/datafusion:parquet	127733344	123208468	1.04
tpch_q07/datafusion:parquet	603563003	610844700	0.99
tpch_q08/datafusion:parquet	467503447	473087645	0.99
tpch_q09/datafusion:parquet	757348805	752849757	1.01
tpch_q10/datafusion:parquet	500714727	510267354	0.98
tpch_q11/datafusion:parquet	120138136	115533453	1.04
tpch_q12/datafusion:parquet	200117618	208915445	0.96
tpch_q13/datafusion:parquet	333222681	329315423	1.01
tpch_q14/datafusion:parquet	158119659	154079219	1.03
tpch_q15/datafusion:parquet	258395631	254056880	1.02
tpch_q16/datafusion:parquet	126313651	127575514	0.99
tpch_q17/datafusion:parquet	684231218	686190972	1.00
tpch_q18/datafusion:parquet	918393454	922444071	1.00
tpch_q19/datafusion:parquet	266295951	254278211	1.05
tpch_q20/datafusion:parquet	288267703	293264221	0.98
tpch_q21/datafusion:parquet	700503131	714254104	0.98
tpch_q22/datafusion:parquet	214955789	222978877	0.96

datafusion / arrow (0.989x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
tpch_q01/datafusion:arrow	583324036	585759027	1.00
tpch_q02/datafusion:arrow	165308637	167300944	0.99
tpch_q03/datafusion:arrow	462400676	460837361	1.00
tpch_q04/datafusion:arrow	340144934	338073549	1.01
tpch_q05/datafusion:arrow	927420359	921065174	1.01
tpch_q06/datafusion:arrow	277793741	277587602	1.00
tpch_q07/datafusion:arrow	1166155036	1167301884	1.00
tpch_q08/datafusion:arrow	1115608487	1146789779	0.97
tpch_q09/datafusion:arrow	1326006333	1334438242	0.99
tpch_q10/datafusion:arrow	584017350	593126716	0.98
tpch_q11/datafusion:arrow	138057484	138696559	1.00
tpch_q12/datafusion:arrow	683407797	732687929	0.93
tpch_q13/datafusion:arrow	499229636	514820701	0.97
tpch_q14/datafusion:arrow	309721707	319038041	0.97
tpch_q15/datafusion:arrow	673301225	679557680	0.99
tpch_q16/datafusion:arrow	104547807	106406276	0.98
tpch_q17/datafusion:arrow	1313436100	1331294407	0.99
tpch_q18/datafusion:arrow	1908013861	1909533597	1.00
tpch_q19/datafusion:arrow	481276677	483198086	1.00
tpch_q20/datafusion:arrow	483853866	478438879	1.01
tpch_q21/datafusion:arrow	2986855302	2998324645	1.00
tpch_q22/datafusion:arrow	131349787	132970753	0.99

duckdb / vortex-file-compressed (1.001x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	169906300	169079612	1.00
tpch_q02/duckdb:vortex-file-compressed	51956153	52286683	0.99
tpch_q03/duckdb:vortex-file-compressed	121429499	121330878	1.00
tpch_q04/duckdb:vortex-file-compressed	158049771	158548855	1.00
tpch_q05/duckdb:vortex-file-compressed	138214199	136713873	1.01
tpch_q06/duckdb:vortex-file-compressed	33345471	32821365	1.02
tpch_q07/duckdb:vortex-file-compressed	132284461	132150173	1.00
tpch_q08/duckdb:vortex-file-compressed	169998802	171285386	0.99
tpch_q09/duckdb:vortex-file-compressed	394811488	396023845	1.00
tpch_q10/duckdb:vortex-file-compressed	188885437	189407433	1.00
tpch_q11/duckdb:vortex-file-compressed	31950586	32528975	0.98
tpch_q12/duckdb:vortex-file-compressed	99715194	101005428	0.99
tpch_q13/duckdb:vortex-file-compressed	268444080	269928034	0.99
tpch_q14/duckdb:vortex-file-compressed	53240376	53579710	0.99
tpch_q15/duckdb:vortex-file-compressed	89354189	88498955	1.01
tpch_q16/duckdb:vortex-file-compressed	80368676	78730145	1.02
tpch_q17/duckdb:vortex-file-compressed	93440885	93306099	1.00
tpch_q18/duckdb:vortex-file-compressed	284251777	282366240	1.01
tpch_q19/duckdb:vortex-file-compressed	78812807	78540726	1.00
tpch_q20/duckdb:vortex-file-compressed	140344023	141490053	0.99
tpch_q21/duckdb:vortex-file-compressed	486633807	485218753	1.00
tpch_q22/duckdb:vortex-file-compressed	64575203	63737398	1.01

duckdb / vortex-compact (1.001x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	229966351	228529768	1.01
tpch_q02/duckdb:vortex-compact	56570602	55924660	1.01
tpch_q03/duckdb:vortex-compact	136174226	136211825	1.00
tpch_q04/duckdb:vortex-compact	169741899	169463194	1.00
tpch_q05/duckdb:vortex-compact	163024733	164057495	0.99
tpch_q06/duckdb:vortex-compact	59582447	56842643	1.05
tpch_q07/duckdb:vortex-compact	172263773	174192414	0.99
tpch_q08/duckdb:vortex-compact	185302340	187445995	0.99
tpch_q09/duckdb:vortex-compact	425141997	424233583	1.00
tpch_q10/duckdb:vortex-compact	218117174	222928900	0.98
tpch_q11/duckdb:vortex-compact	38995521	38228783	1.02
tpch_q12/duckdb:vortex-compact	162429751	163223668	1.00
tpch_q13/duckdb:vortex-compact	324401323	324614788	1.00
tpch_q14/duckdb:vortex-compact	71316023	72349420	0.99
tpch_q15/duckdb:vortex-compact	114040268	115099916	0.99
tpch_q16/duckdb:vortex-compact	80950261	80410211	1.01
tpch_q17/duckdb:vortex-compact	105953512	106028285	1.00
tpch_q18/duckdb:vortex-compact	290193667	288936006	1.00
tpch_q19/duckdb:vortex-compact	96712166	95084906	1.02
tpch_q20/duckdb:vortex-compact	177268926	176132429	1.01
tpch_q21/duckdb:vortex-compact	513322731	518552397	0.99
tpch_q22/duckdb:vortex-compact	71235886	72137312	0.99

duckdb / parquet (0.998x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	263952217	261917606	1.01
tpch_q02/duckdb:parquet	103276655	103340316	1.00
tpch_q03/duckdb:parquet	209008906	210380262	0.99
tpch_q04/duckdb:parquet	126992518	133161846	0.95
tpch_q05/duckdb:parquet	226387184	224534557	1.01
tpch_q06/duckdb:parquet	73524665	74192521	0.99
tpch_q07/duckdb:parquet	188612402	187536723	1.01
tpch_q08/duckdb:parquet	262149912	259618440	1.01
tpch_q09/duckdb:parquet	488695059	472069066	1.04
tpch_q10/duckdb:parquet	619866308	622529265	1.00
tpch_q11/duckdb:parquet	66596529	67794457	0.98
tpch_q12/duckdb:parquet	129714741	130943754	0.99
tpch_q13/duckdb:parquet	440960284	446036170	0.99
tpch_q14/duckdb:parquet	179764288	179325040	1.00
tpch_q15/duckdb:parquet	103942145	104181801	1.00
tpch_q16/duckdb:parquet	161465386	164224511	0.98
tpch_q17/duckdb:parquet	184330914	179645841	1.03
tpch_q18/duckdb:parquet	361390009	366116548	0.99
tpch_q19/duckdb:parquet	285105753	288542861	0.99
tpch_q20/duckdb:parquet	226656425	225944956	1.00
tpch_q21/duckdb:parquet	557865598	551959722	1.01
tpch_q22/duckdb:parquet	294759953	295723918	1.00

duckdb / duckdb (0.995x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
tpch_q01/duckdb:duckdb	120199785	120588583	1.00
tpch_q02/duckdb:duckdb	49758571	48705583	1.02
tpch_q03/duckdb:duckdb	102977328	103672389	0.99
tpch_q04/duckdb:duckdb	137723136	139114287	0.99
tpch_q05/duckdb:duckdb	118882065	119145754	1.00
tpch_q06/duckdb:duckdb	44751568	44841248	1.00
tpch_q07/duckdb:duckdb	90925421	90975289	1.00
tpch_q08/duckdb:duckdb	117425091	118520911	0.99
tpch_q09/duckdb:duckdb	279347131	280567986	1.00
tpch_q10/duckdb:duckdb	209977641	213847445	0.98
tpch_q11/duckdb:duckdb	19306028	19485173	0.99
tpch_q12/duckdb:duckdb	90982363	90205596	1.01
tpch_q13/duckdb:duckdb	228479607	231437745	0.99
tpch_q14/duckdb:duckdb	77841309	77991656	1.00
tpch_q15/duckdb:duckdb	81776435	81909498	1.00
tpch_q16/duckdb:duckdb	75940936	75996827	1.00
tpch_q17/duckdb:duckdb	87181360	88313736	0.99
tpch_q18/duckdb:duckdb	231994026	239701740	0.97
tpch_q19/duckdb:duckdb	123363085	124589251	0.99
tpch_q20/duckdb:duckdb	118331805	117911873	1.00
tpch_q21/duckdb:duckdb	303587757	305744012	0.99
tpch_q22/duckdb:duckdb	67875152	67857499	1.00

---

No baseline file sizes found for base commit.

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:arrow	-0.4%	+1.5%	-1.9%	+10.0%	➖ noise
1	datafusion:vortex-compact	-3.1%	+1.5%	-4.5%	+10.0%	➖ noise
1	datafusion:vortex-file-compressed	-3.9%	+1.5%	-5.3%	+10.0%	➖ noise
1	duckdb:duckdb	-0.3%	+1.5%	-1.8%	+10.0%	➖ noise
1	duckdb:vortex-compact	+0.6%	+1.5%	-0.9%	+10.0%	➖ noise
1	duckdb:vortex-file-compressed	+0.5%	+1.5%	-1.0%	+10.0%	➖ noise
2	datafusion:arrow	-1.2%	-0.0%	-1.1%	+10.0%	➖ noise
2	datafusion:vortex-compact	+0.5%	-0.0%	+0.5%	+10.0%	➖ noise
2	datafusion:vortex-file-compressed	+2.0%	-0.0%	+2.0%	+10.0%	➖ noise
2	duckdb:duckdb	+2.2%	-0.0%	+2.2%	+10.0%	➖ noise
2	duckdb:vortex-compact	+1.2%	-0.0%	+1.2%	+16.5%	➖ noise
2	duckdb:vortex-file-compressed	-0.6%	-0.0%	-0.6%	+13.6%	➖ noise
3	datafusion:arrow	+0.3%	-1.0%	+1.4%	+10.0%	➖ noise
3	datafusion:vortex-compact	+2.2%	-1.0%	+3.2%	+10.0%	➖ noise
3	datafusion:vortex-file-compressed	-0.4%	-1.0%	+0.7%	+10.0%	➖ noise
3	duckdb:duckdb	-0.7%	-1.0%	+0.3%	+10.0%	➖ noise
3	duckdb:vortex-compact	-0.0%	-1.0%	+1.0%	+10.0%	➖ noise
3	duckdb:vortex-file-compressed	+0.1%	-1.0%	+1.1%	+10.0%	➖ noise
4	datafusion:arrow	+0.6%	-3.6%	+4.4%	+10.0%	➖ noise
4	datafusion:vortex-compact	-2.4%	-3.6%	+1.2%	+10.0%	➖ noise
4	datafusion:vortex-file-compressed	-0.3%	-3.6%	+3.4%	+10.0%	➖ noise
4	duckdb:duckdb	-1.0%	-3.6%	+2.7%	+10.0%	➖ noise
4	duckdb:vortex-compact	+0.2%	-3.6%	+3.9%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	-0.3%	-3.6%	+3.4%	+10.0%	➖ noise
5	datafusion:arrow	+0.7%	+0.4%	+0.3%	+10.0%	➖ noise
5	datafusion:vortex-compact	-0.4%	+0.4%	-0.8%	+10.0%	➖ noise
5	datafusion:vortex-file-compressed	-0.5%	+0.4%	-0.8%	+10.0%	➖ noise
5	duckdb:duckdb	-0.2%	+0.4%	-0.6%	+10.0%	➖ noise
5	duckdb:vortex-compact	-0.6%	+0.4%	-1.0%	+10.0%	➖ noise
5	duckdb:vortex-file-compressed	+1.1%	+0.4%	+0.7%	+10.0%	➖ noise
6	datafusion:arrow	+0.1%	+1.4%	-1.3%	+10.0%	➖ noise
6	datafusion:vortex-compact	-0.8%	+1.4%	-2.2%	+10.0%	➖ noise
6	datafusion:vortex-file-compressed	-3.3%	+1.4%	-4.6%	+11.4%	➖ noise
6	duckdb:duckdb	-0.2%	+1.4%	-1.5%	+10.0%	➖ noise
6	duckdb:vortex-compact	+4.8%	+1.4%	+3.4%	+10.5%	➖ noise
6	duckdb:vortex-file-compressed	+1.6%	+1.4%	+0.2%	+10.3%	➖ noise
7	datafusion:arrow	-0.1%	-0.3%	+0.2%	+10.0%	➖ noise
7	datafusion:vortex-compact	-0.7%	-0.3%	-0.3%	+10.0%	➖ noise
7	datafusion:vortex-file-compressed	-0.0%	-0.3%	+0.3%	+10.0%	➖ noise
7	duckdb:duckdb	-0.1%	-0.3%	+0.3%	+10.0%	➖ noise
7	duckdb:vortex-compact	-1.1%	-0.3%	-0.8%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	+0.1%	-0.3%	+0.4%	+10.0%	➖ noise
8	datafusion:arrow	-2.7%	-0.1%	-2.6%	+10.0%	➖ noise
8	datafusion:vortex-compact	+0.9%	-0.1%	+1.0%	+10.0%	➖ noise
8	datafusion:vortex-file-compressed	-1.0%	-0.1%	-0.9%	+10.0%	➖ noise
8	duckdb:duckdb	-0.9%	-0.1%	-0.8%	+10.0%	➖ noise
8	duckdb:vortex-compact	-1.1%	-0.1%	-1.0%	+10.0%	➖ noise
8	duckdb:vortex-file-compressed	-0.8%	-0.1%	-0.6%	+10.0%	➖ noise
9	datafusion:arrow	-0.6%	+2.0%	-2.6%	+10.0%	➖ noise
9	datafusion:vortex-compact	+0.6%	+2.0%	-1.4%	+10.0%	➖ noise
9	datafusion:vortex-file-compressed	-0.5%	+2.0%	-2.5%	+10.0%	➖ noise
9	duckdb:duckdb	-0.4%	+2.0%	-2.4%	+10.0%	➖ noise
9	duckdb:vortex-compact	+0.2%	+2.0%	-1.8%	+10.0%	➖ noise
9	duckdb:vortex-file-compressed	-0.3%	+2.0%	-2.3%	+10.0%	➖ noise
10	datafusion:arrow	-1.5%	-1.2%	-0.4%	+10.0%	➖ noise
10	datafusion:vortex-compact	+0.4%	-1.2%	+1.6%	+10.0%	➖ noise
10	datafusion:vortex-file-compressed	-2.8%	-1.2%	-1.6%	+10.0%	➖ noise
10	duckdb:duckdb	-1.8%	-1.2%	-0.7%	+10.0%	➖ noise
10	duckdb:vortex-compact	-2.2%	-1.2%	-1.0%	+10.0%	➖ noise
10	duckdb:vortex-file-compressed	-0.3%	-1.2%	+0.9%	+10.0%	➖ noise
11	datafusion:arrow	-0.5%	+1.1%	-1.5%	+10.0%	➖ noise
11	datafusion:vortex-compact	+0.9%	+1.1%	-0.2%	+10.0%	➖ noise
11	datafusion:vortex-file-compressed	+0.9%	+1.1%	-0.2%	+10.0%	➖ noise
11	duckdb:duckdb	-0.9%	+1.1%	-2.0%	+10.0%	➖ noise
11	duckdb:vortex-compact	+2.0%	+1.1%	+0.9%	+10.9%	➖ noise
11	duckdb:vortex-file-compressed	-1.8%	+1.1%	-2.8%	+13.4%	➖ noise
12	datafusion:arrow	-6.7%	-2.6%	-4.2%	+39.8%	➖ noise
12	datafusion:vortex-compact	-0.9%	-2.6%	+1.7%	+10.0%	➖ noise
12	datafusion:vortex-file-compressed	+0.9%	-2.6%	+3.5%	+10.0%	➖ noise
12	duckdb:duckdb	+0.9%	-2.6%	+3.5%	+10.0%	➖ noise
12	duckdb:vortex-compact	-0.5%	-2.6%	+2.2%	+10.0%	➖ noise
12	duckdb:vortex-file-compressed	-1.3%	-2.6%	+1.3%	+10.0%	➖ noise
13	datafusion:arrow	-3.0%	+0.0%	-3.0%	+10.0%	➖ noise
13	datafusion:vortex-compact	+0.9%	+0.0%	+0.8%	+10.0%	➖ noise
13	datafusion:vortex-file-compressed	-1.5%	+0.0%	-1.5%	+10.0%	➖ noise
13	duckdb:duckdb	-1.3%	+0.0%	-1.3%	+10.0%	➖ noise
13	duckdb:vortex-compact	-0.1%	+0.0%	-0.1%	+10.0%	➖ noise
13	duckdb:vortex-file-compressed	-0.5%	+0.0%	-0.6%	+10.0%	➖ noise
14	datafusion:arrow	-2.9%	+1.4%	-4.3%	+10.0%	➖ noise
14	datafusion:vortex-compact	-1.7%	+1.4%	-3.1%	+10.0%	➖ noise
14	datafusion:vortex-file-compressed	-0.3%	+1.4%	-1.7%	+10.0%	➖ noise
14	duckdb:duckdb	-0.2%	+1.4%	-1.6%	+10.0%	➖ noise
14	duckdb:vortex-compact	-1.4%	+1.4%	-2.8%	+10.7%	➖ noise
14	duckdb:vortex-file-compressed	-0.6%	+1.4%	-2.0%	+10.0%	➖ noise
15	datafusion:arrow	-0.9%	+0.7%	-1.6%	+10.0%	➖ noise
15	datafusion:vortex-compact	+0.2%	+0.7%	-0.6%	+10.0%	➖ noise
15	datafusion:vortex-file-compressed	-1.1%	+0.7%	-1.8%	+10.0%	➖ noise
15	duckdb:duckdb	-0.2%	+0.7%	-0.9%	+10.0%	➖ noise
15	duckdb:vortex-compact	-0.9%	+0.7%	-1.6%	+10.0%	➖ noise
15	duckdb:vortex-file-compressed	+1.0%	+0.7%	+0.2%	+10.0%	➖ noise
16	datafusion:arrow	-1.7%	-1.3%	-0.4%	+10.0%	➖ noise
16	datafusion:vortex-compact	-0.5%	-1.3%	+0.9%	+10.0%	➖ noise
16	datafusion:vortex-file-compressed	-0.5%	-1.3%	+0.8%	+10.0%	➖ noise
16	duckdb:duckdb	-0.1%	-1.3%	+1.3%	+10.0%	➖ noise
16	duckdb:vortex-compact	+0.7%	-1.3%	+2.0%	+10.0%	➖ noise
16	duckdb:vortex-file-compressed	+2.1%	-1.3%	+3.5%	+10.0%	➖ noise
17	datafusion:arrow	-1.3%	+1.2%	-2.5%	+10.0%	➖ noise
17	datafusion:vortex-compact	-0.2%	+1.2%	-1.3%	+10.0%	➖ noise
17	datafusion:vortex-file-compressed	-0.2%	+1.2%	-1.3%	+10.0%	➖ noise
17	duckdb:duckdb	-1.3%	+1.2%	-2.4%	+10.0%	➖ noise
17	duckdb:vortex-compact	-0.1%	+1.2%	-1.2%	+10.0%	➖ noise
17	duckdb:vortex-file-compressed	+0.1%	+1.2%	-1.0%	+10.0%	➖ noise
18	datafusion:arrow	-0.1%	-0.9%	+0.8%	+10.0%	➖ noise
18	datafusion:vortex-compact	-1.6%	-0.9%	-0.7%	+10.0%	➖ noise
18	datafusion:vortex-file-compressed	-0.2%	-0.9%	+0.7%	+10.0%	➖ noise
18	duckdb:duckdb	-3.2%	-0.9%	-2.4%	+10.0%	➖ noise
18	duckdb:vortex-compact	+0.4%	-0.9%	+1.3%	+10.0%	➖ noise
18	duckdb:vortex-file-compressed	+0.7%	-0.9%	+1.5%	+10.0%	➖ noise
19	datafusion:arrow	-0.4%	+1.7%	-2.1%	+10.0%	➖ noise
19	datafusion:vortex-compact	-0.4%	+1.7%	-2.1%	+10.0%	➖ noise
19	datafusion:vortex-file-compressed	-2.1%	+1.7%	-3.7%	+10.2%	➖ noise
19	duckdb:duckdb	-1.0%	+1.7%	-2.7%	+10.0%	➖ noise
19	duckdb:vortex-compact	+1.7%	+1.7%	-0.0%	+10.0%	➖ noise
19	duckdb:vortex-file-compressed	+0.3%	+1.7%	-1.4%	+10.0%	➖ noise
20	datafusion:arrow	+1.1%	-0.7%	+1.8%	+10.0%	➖ noise
20	datafusion:vortex-compact	-0.3%	-0.7%	+0.5%	+10.0%	➖ noise
20	datafusion:vortex-file-compressed	+0.6%	-0.7%	+1.3%	+10.0%	➖ noise
20	duckdb:duckdb	+0.4%	-0.7%	+1.1%	+10.0%	➖ noise
20	duckdb:vortex-compact	+0.6%	-0.7%	+1.4%	+10.0%	➖ noise
20	duckdb:vortex-file-compressed	-0.8%	-0.7%	-0.1%	+10.0%	➖ noise
21	datafusion:arrow	-0.4%	-0.4%	+0.1%	+10.0%	➖ noise
21	datafusion:vortex-compact	+0.5%	-0.4%	+0.9%	+10.0%	➖ noise
21	datafusion:vortex-file-compressed	-1.1%	-0.4%	-0.7%	+10.0%	➖ noise
21	duckdb:duckdb	-0.7%	-0.4%	-0.3%	+10.0%	➖ noise
21	duckdb:vortex-compact	-1.0%	-0.4%	-0.6%	+10.0%	➖ noise
21	duckdb:vortex-file-compressed	+0.3%	-0.4%	+0.7%	+10.0%	➖ noise
22	datafusion:arrow	-1.2%	-2.0%	+0.8%	+10.0%	➖ noise
22	datafusion:vortex-compact	-0.3%	-2.0%	+1.7%	+10.0%	➖ noise
22	datafusion:vortex-file-compressed	-2.2%	-2.0%	-0.2%	+10.0%	➖ noise
22	duckdb:duckdb	+0.0%	-2.0%	+2.0%	+10.0%	➖ noise
22	duckdb:vortex-compact	-1.2%	-2.0%	+0.7%	+10.0%	➖ noise
22	duckdb:vortex-file-compressed	+1.3%	-2.0%	+3.4%	+10.0%	➖ noise

[github-actions]

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.0%
Engines: DataFusion No clear signal (+4.6%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): 1.029x ➖
Parquet (geomean): 1.005x ➖
Shifts: Parquet (control) +0.5% · Median polish +1.2%

How to read Verdict and Engines

• Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
• Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
• Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

---

datafusion / vortex-file-compressed (1.048x ➖, 0↑ 7↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed	1627663	1686186	0.97
clickbench_q01/datafusion:vortex-file-compressed	19925196	18558322	1.07
clickbench_q02/datafusion:vortex-file-compressed	37966841	37606694	1.01
clickbench_q03/datafusion:vortex-file-compressed	44342719	43571237	1.02
clickbench_q04/datafusion:vortex-file-compressed	295602214	285230549	1.04
clickbench_q05/datafusion:vortex-file-compressed	318343225	316198429	1.01
clickbench_q06/datafusion:vortex-file-compressed 🚨	1963499	1660781	1.18
clickbench_q07/datafusion:vortex-file-compressed	22874433	21538785	1.06
clickbench_q08/datafusion:vortex-file-compressed	364914339	348551574	1.05
clickbench_q09/datafusion:vortex-file-compressed	582051644	547568054	1.06
clickbench_q10/datafusion:vortex-file-compressed	77709359	75532807	1.03
clickbench_q11/datafusion:vortex-file-compressed	87880359	88073664	1.00
clickbench_q12/datafusion:vortex-file-compressed	285215601	271686956	1.05
clickbench_q13/datafusion:vortex-file-compressed	437199934	419038383	1.04
clickbench_q14/datafusion:vortex-file-compressed	264849411	254431777	1.04
clickbench_q15/datafusion:vortex-file-compressed	343411211	330574402	1.04
clickbench_q16/datafusion:vortex-file-compressed	677678026	671237432	1.01
clickbench_q17/datafusion:vortex-file-compressed	672745110	650288267	1.03
clickbench_q18/datafusion:vortex-file-compressed	1410228308	1340256008	1.05
clickbench_q19/datafusion:vortex-file-compressed	30525166	32488324	0.94
clickbench_q20/datafusion:vortex-file-compressed	355057808	350065851	1.01
clickbench_q21/datafusion:vortex-file-compressed	390725263	372121318	1.05
clickbench_q22/datafusion:vortex-file-compressed	469791582	456760369	1.03
clickbench_q23/datafusion:vortex-file-compressed	690587953	647000699	1.07
clickbench_q24/datafusion:vortex-file-compressed 🚨	49905928	44834252	1.11
clickbench_q25/datafusion:vortex-file-compressed	78728711	73102976	1.08
clickbench_q26/datafusion:vortex-file-compressed	49083488	45470085	1.08
clickbench_q27/datafusion:vortex-file-compressed	769365568	733703615	1.05
clickbench_q28/datafusion:vortex-file-compressed	6957061523	6764874196	1.03
clickbench_q29/datafusion:vortex-file-compressed	244283241	236319207	1.03
clickbench_q30/datafusion:vortex-file-compressed 🚨	265983159	222374639	1.20
clickbench_q31/datafusion:vortex-file-compressed 🚨	294685579	260364673	1.13
clickbench_q32/datafusion:vortex-file-compressed 🚨	1288725229	1141201702	1.13
clickbench_q33/datafusion:vortex-file-compressed 🚨	1519180058	1366803245	1.11
clickbench_q34/datafusion:vortex-file-compressed 🚨	1475293480	1339567338	1.10
clickbench_q35/datafusion:vortex-file-compressed	478737835	463316768	1.03
clickbench_q36/datafusion:vortex-file-compressed	74398046	76886909	0.97
clickbench_q37/datafusion:vortex-file-compressed	35747677	34007750	1.05
clickbench_q38/datafusion:vortex-file-compressed	20094398	19108064	1.05
clickbench_q39/datafusion:vortex-file-compressed	144082928	137768508	1.05
clickbench_q40/datafusion:vortex-file-compressed	16477647	15795681	1.04
clickbench_q41/datafusion:vortex-file-compressed	14870004	14645582	1.02
clickbench_q42/datafusion:vortex-file-compressed	16990716	16978246	1.00

datafusion / parquet (1.002x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
clickbench_q00/datafusion:parquet	1532867	1616872	0.95
clickbench_q01/datafusion:parquet	20122846	21263696	0.95
clickbench_q02/datafusion:parquet	45816974	49091416	0.93
clickbench_q03/datafusion:parquet	36812622	39589435	0.93
clickbench_q04/datafusion:parquet	308282755	297443068	1.04
clickbench_q05/datafusion:parquet	353581863	341738567	1.03
clickbench_q06/datafusion:parquet	1576442	1575833	1.00
clickbench_q07/datafusion:parquet	22402339	22273430	1.01
clickbench_q08/datafusion:parquet	374839089	377879908	0.99
clickbench_q09/datafusion:parquet	618853059	618632222	1.00
clickbench_q10/datafusion:parquet	105783405	107202499	0.99
clickbench_q11/datafusion:parquet	130268175	130168087	1.00
clickbench_q12/datafusion:parquet	342291620	347497156	0.99
clickbench_q13/datafusion:parquet	505430809	503219056	1.00
clickbench_q14/datafusion:parquet	343715120	342093454	1.00
clickbench_q15/datafusion:parquet	338987209	344260845	0.98
clickbench_q16/datafusion:parquet	667792553	675159430	0.99
clickbench_q17/datafusion:parquet	663555283	657574670	1.01
clickbench_q18/datafusion:parquet	1430180902	1387146384	1.03
clickbench_q19/datafusion:parquet	29635671	29042507	1.02
clickbench_q20/datafusion:parquet	608316475	618688549	0.98
clickbench_q21/datafusion:parquet	654504837	654636524	1.00
clickbench_q22/datafusion:parquet	960785442	973718871	0.99
clickbench_q23/datafusion:parquet	3714450657	3645430518	1.02
clickbench_q24/datafusion:parquet	82427765	81726874	1.01
clickbench_q25/datafusion:parquet	136087690	136532364	1.00
clickbench_q26/datafusion:parquet	83424514	84235609	0.99
clickbench_q27/datafusion:parquet	1053436263	1054806619	1.00
clickbench_q28/datafusion:parquet	6622247744	6704671396	0.99
clickbench_q29/datafusion:parquet	243511011	255193779	0.95
clickbench_q30/datafusion:parquet	330805602	331781842	1.00
clickbench_q31/datafusion:parquet	370177627	365183520	1.01
clickbench_q32/datafusion:parquet	1305323672	1206560726	1.08
clickbench_q33/datafusion:parquet	1557808055	1486752467	1.05
clickbench_q34/datafusion:parquet	1515624078	1514528785	1.00
clickbench_q35/datafusion:parquet	478311300	481378674	0.99
clickbench_q36/datafusion:parquet	156629143	143508316	1.09
clickbench_q37/datafusion:parquet	58973897	57592237	1.02
clickbench_q38/datafusion:parquet	90725834	86459781	1.05
clickbench_q39/datafusion:parquet	276855999	271643319	1.02
clickbench_q40/datafusion:parquet	32062046	33494202	0.96
clickbench_q41/datafusion:parquet	28248408	26404417	1.07
clickbench_q42/datafusion:parquet	30513963	30111604	1.01

duckdb / vortex-file-compressed (1.010x ➖, 3↑ 3↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed	6715197	7101248	0.95
clickbench_q01/duckdb:vortex-file-compressed	12175148	11893732	1.02
clickbench_q02/duckdb:vortex-file-compressed	26381577	25446443	1.04
clickbench_q03/duckdb:vortex-file-compressed	31551181	30514857	1.03
clickbench_q04/duckdb:vortex-file-compressed	190921950	187879145	1.02
clickbench_q05/duckdb:vortex-file-compressed	181301435	176299716	1.03
clickbench_q06/duckdb:vortex-file-compressed	21460059	21264131	1.01
clickbench_q07/duckdb:vortex-file-compressed	16252991	15117840	1.08
clickbench_q08/duckdb:vortex-file-compressed	267828387	261831631	1.02
clickbench_q09/duckdb:vortex-file-compressed	341520400	335076988	1.02
clickbench_q10/duckdb:vortex-file-compressed	66892362	70144447	0.95
clickbench_q11/duckdb:vortex-file-compressed	77850174	77720955	1.00
clickbench_q12/duckdb:vortex-file-compressed	198902760	194485465	1.02
clickbench_q13/duckdb:vortex-file-compressed	409982011	405700069	1.01
clickbench_q14/duckdb:vortex-file-compressed	234188765	229098090	1.02
clickbench_q15/duckdb:vortex-file-compressed	247994540	245802545	1.01
clickbench_q16/duckdb:vortex-file-compressed	526787454	519231061	1.01
clickbench_q17/duckdb:vortex-file-compressed	430639906	424990334	1.01
clickbench_q18/duckdb:vortex-file-compressed	960617788	946827803	1.01
clickbench_q19/duckdb:vortex-file-compressed	22123941	21601918	1.02
clickbench_q20/duckdb:vortex-file-compressed	344204049	340306352	1.01
clickbench_q21/duckdb:vortex-file-compressed 🚨	421538090	360035570	1.17
clickbench_q22/duckdb:vortex-file-compressed 🚨	729203215	630459469	1.16
clickbench_q23/duckdb:vortex-file-compressed	208485858	207003469	1.01
clickbench_q24/duckdb:vortex-file-compressed	35567204	37147893	0.96
clickbench_q25/duckdb:vortex-file-compressed	81418327	76939236	1.06
clickbench_q26/duckdb:vortex-file-compressed 🚀	41985503	48909233	0.86
clickbench_q27/duckdb:vortex-file-compressed	498380817	489749736	1.02
clickbench_q28/duckdb:vortex-file-compressed	3066511327	3042141532	1.01
clickbench_q29/duckdb:vortex-file-compressed 🚨	40201900	29338191	1.37
clickbench_q30/duckdb:vortex-file-compressed	200884040	188878903	1.06
clickbench_q31/duckdb:vortex-file-compressed	292726152	281501237	1.04
clickbench_q32/duckdb:vortex-file-compressed	1163805593	1131210765	1.03
clickbench_q33/duckdb:vortex-file-compressed	1088210499	1188375773	0.92
clickbench_q34/duckdb:vortex-file-compressed	1211213952	1222350564	0.99
clickbench_q35/duckdb:vortex-file-compressed	386661289	374723284	1.03
clickbench_q36/duckdb:vortex-file-compressed	25813158	27207232	0.95
clickbench_q37/duckdb:vortex-file-compressed	20324713	19616563	1.04
clickbench_q38/duckdb:vortex-file-compressed	19993246	21293149	0.94
clickbench_q39/duckdb:vortex-file-compressed	40327047	42979091	0.94
clickbench_q40/duckdb:vortex-file-compressed 🚀	17580218	20811114	0.84
clickbench_q41/duckdb:vortex-file-compressed 🚀	17903994	20035665	0.89
clickbench_q42/duckdb:vortex-file-compressed	20073394	20846353	0.96

duckdb / parquet (1.008x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
clickbench_q00/duckdb:parquet	22238481	22129096	1.00
clickbench_q01/duckdb:parquet	29167547	29265528	1.00
clickbench_q02/duckdb:parquet	49444381	50171527	0.99
clickbench_q03/duckdb:parquet	39639067	39816969	1.00
clickbench_q04/duckdb:parquet	205855127	201485819	1.02
clickbench_q05/duckdb:parquet	260976800	257875654	1.01
clickbench_q06/duckdb:parquet	47309877	47065505	1.01
clickbench_q07/duckdb:parquet	31189419	31985439	0.98
clickbench_q08/duckdb:parquet	270896827	270107876	1.00
clickbench_q09/duckdb:parquet	399614555	401132653	1.00
clickbench_q10/duckdb:parquet	85006159	82984436	1.02
clickbench_q11/duckdb:parquet	101048936	98871445	1.02
clickbench_q12/duckdb:parquet	278680647	277502428	1.00
clickbench_q13/duckdb:parquet	474160414	466618516	1.02
clickbench_q14/duckdb:parquet	316497940	314953955	1.00
clickbench_q15/duckdb:parquet	256715909	255132719	1.01
clickbench_q16/duckdb:parquet	596045255	595980063	1.00
clickbench_q17/duckdb:parquet	504612821	490388056	1.03
clickbench_q18/duckdb:parquet	1046457718	1033905311	1.01
clickbench_q19/duckdb:parquet	27315452	27729378	0.99
clickbench_q20/duckdb:parquet	419623915	410928722	1.02
clickbench_q21/duckdb:parquet	539958473	534805671	1.01
clickbench_q22/duckdb:parquet	923489226	918564246	1.01
clickbench_q23/duckdb:parquet	272919175	255193313	1.07
clickbench_q24/duckdb:parquet	73268070	71511830	1.02
clickbench_q25/duckdb:parquet	163749736	161021317	1.02
clickbench_q26/duckdb:parquet	54062898	53223670	1.02
clickbench_q27/duckdb:parquet	649188974	644241387	1.01
clickbench_q28/duckdb:parquet	4893763809	4868529690	1.01
clickbench_q29/duckdb:parquet	42333791	42501247	1.00
clickbench_q30/duckdb:parquet	316958719	310058570	1.02
clickbench_q31/duckdb:parquet	380583798	370592626	1.03
clickbench_q32/duckdb:parquet	1112604288	1104345028	1.01
clickbench_q33/duckdb:parquet	1123048548	1103765153	1.02
clickbench_q34/duckdb:parquet	1176329034	1145858944	1.03
clickbench_q35/duckdb:parquet	373658654	368477878	1.01
clickbench_q36/duckdb:parquet	49763762	46970986	1.06
clickbench_q37/duckdb:parquet	34130043	33601081	1.02
clickbench_q38/duckdb:parquet	35066186	35796555	0.98
clickbench_q39/duckdb:parquet	77900367	80905705	0.96
clickbench_q40/duckdb:parquet	20563226	20384121	1.01
clickbench_q41/duckdb:parquet	20846962	20976808	0.99
clickbench_q42/duckdb:parquet	22239481	23424730	0.95

duckdb / duckdb (1.019x ➖, 0↑ 5↓)

name	PR 672a27e (ns)	base 8265aa1 (ns)	ratio (PR/base)
clickbench_q00/duckdb:duckdb	17745564	18116214	0.98
clickbench_q01/duckdb:duckdb	34613316	35487443	0.98
clickbench_q02/duckdb:duckdb	51407606	53146370	0.97
clickbench_q03/duckdb:duckdb	56960271	57731398	0.99
clickbench_q04/duckdb:duckdb	214303390	221584206	0.97
clickbench_q05/duckdb:duckdb	283604881	300119022	0.94
clickbench_q06/duckdb:duckdb	35152040	35940124	0.98
clickbench_q07/duckdb:duckdb	35346716	36808273	0.96
clickbench_q08/duckdb:duckdb	278352758	284503851	0.98
clickbench_q09/duckdb:duckdb	396741672	408464811	0.97
clickbench_q10/duckdb:duckdb	116993037	115590834	1.01
clickbench_q11/duckdb:duckdb	127636569	126167553	1.01
clickbench_q12/duckdb:duckdb	262785072	261339368	1.01
clickbench_q13/duckdb:duckdb	450505781	447193863	1.01
clickbench_q14/duckdb:duckdb	289998362	281891850	1.03
clickbench_q15/duckdb:duckdb	241965409	242317867	1.00
clickbench_q16/duckdb:duckdb	564145558	560350380	1.01
clickbench_q17/duckdb:duckdb	478538945	469355436	1.02
clickbench_q18/duckdb:duckdb	1037651900	986682872	1.05
clickbench_q19/duckdb:duckdb	36104891	34282980	1.05
clickbench_q20/duckdb:duckdb	478703700	461421348	1.04
clickbench_q21/duckdb:duckdb	475159802	476688343	1.00
clickbench_q22/duckdb:duckdb	535801863	550080585	0.97
clickbench_q23/duckdb:duckdb	260238711	253800610	1.03
clickbench_q24/duckdb:duckdb 🚨	70284654	62566438	1.12
clickbench_q25/duckdb:duckdb 🚨	165116578	147858173	1.12
clickbench_q26/duckdb:duckdb 🚨	72089904	62326463	1.16
clickbench_q27/duckdb:duckdb 🚨	644133473	555825645	1.16
clickbench_q28/duckdb:duckdb	4688634801	4515272040	1.04
clickbench_q29/duckdb:duckdb	50402964	50977885	0.99
clickbench_q30/duckdb:duckdb	275367890	279085244	0.99
clickbench_q31/duckdb:duckdb	364126661	366320009	0.99
clickbench_q32/duckdb:duckdb	1108570153	1108114280	1.00
clickbench_q33/duckdb:duckdb	1123764060	1111940311	1.01
clickbench_q34/duckdb:duckdb	1206384030	1194721254	1.01
clickbench_q35/duckdb:duckdb	299838021	301826630	0.99
clickbench_q36/duckdb:duckdb	49665821	49551545	1.00
clickbench_q37/duckdb:duckdb	29294759	28860338	1.02
clickbench_q38/duckdb:duckdb	34835468	33222755	1.05
clickbench_q39/duckdb:duckdb 🚨	97118076	78249764	1.24
clickbench_q40/duckdb:duckdb	28406124	27934242	1.02
clickbench_q41/duckdb:duckdb	28072564	27311088	1.03
clickbench_q42/duckdb:duckdb	30015956	29441681	1.02

---

No baseline file sizes found for base commit.

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
0	datafusion:vortex-file-compressed	-3.5%	-2.4%	-1.1%	+737.2%	➖ noise
0	duckdb:duckdb	-2.0%	-2.4%	+0.4%	+273.6%	➖ noise
0	duckdb:vortex-file-compressed	-5.4%	-2.4%	-3.1%	+452.9%	➖ noise
1	datafusion:vortex-file-compressed	+7.4%	-2.9%	+10.6%	+25.5%	➖ noise
1	duckdb:duckdb	-2.5%	-2.9%	+0.4%	+58.8%	➖ noise
1	duckdb:vortex-file-compressed	+2.4%	-2.9%	+5.4%	+23.9%	➖ noise
2	datafusion:vortex-file-compressed	+1.0%	-4.1%	+5.3%	+19.3%	➖ noise
2	duckdb:duckdb	-3.3%	-4.1%	+0.9%	+33.3%	➖ noise
2	duckdb:vortex-file-compressed	+3.7%	-4.1%	+8.1%	+21.2%	➖ noise
3	datafusion:vortex-file-compressed	+1.8%	-3.8%	+5.8%	+138.4%	➖ noise
3	duckdb:duckdb	-1.3%	-3.8%	+2.5%	+51.8%	➖ noise
3	duckdb:vortex-file-compressed	+3.4%	-3.8%	+7.5%	+99.8%	➖ noise
4	datafusion:vortex-file-compressed	+3.6%	+2.9%	+0.7%	+10.0%	➖ noise
4	duckdb:duckdb	-3.3%	+2.9%	-6.0%	+10.0%	➖ noise
4	duckdb:vortex-file-compressed	+1.6%	+2.9%	-1.2%	+10.0%	➖ noise
5	datafusion:vortex-file-compressed	+0.7%	+2.3%	-1.6%	+10.0%	➖ noise
5	duckdb:duckdb	-5.5%	+2.3%	-7.7%	+10.0%	➖ noise
5	duckdb:vortex-file-compressed	+2.8%	+2.3%	+0.5%	+10.0%	➖ noise
6	datafusion:vortex-file-compressed	+18.2%	+0.3%	+17.9%	+91.0%	➖ noise
6	duckdb:duckdb	-2.2%	+0.3%	-2.5%	+14.5%	➖ noise
6	duckdb:vortex-file-compressed	+0.9%	+0.3%	+0.6%	+23.8%	➖ noise
7	datafusion:vortex-file-compressed	+6.2%	-1.0%	+7.2%	+16.4%	➖ noise
7	duckdb:duckdb	-4.0%	-1.0%	-3.0%	+10.0%	➖ noise
7	duckdb:vortex-file-compressed	+7.5%	-1.0%	+8.6%	+12.5%	➖ noise
8	datafusion:vortex-file-compressed	+4.7%	-0.3%	+5.0%	+10.0%	➖ noise
8	duckdb:duckdb	-2.2%	-0.3%	-1.9%	+10.0%	➖ noise
8	duckdb:vortex-file-compressed	+2.3%	-0.3%	+2.6%	+10.0%	➖ noise
9	datafusion:vortex-file-compressed	+6.3%	-0.2%	+6.5%	+10.0%	➖ noise
9	duckdb:duckdb	-2.9%	-0.2%	-2.7%	+10.0%	➖ noise
9	duckdb:vortex-file-compressed	+1.9%	-0.2%	+2.1%	+10.0%	➖ noise
10	datafusion:vortex-file-compressed	+2.9%	+0.5%	+2.3%	+10.4%	➖ noise
10	duckdb:duckdb	+1.2%	+0.5%	+0.7%	+10.0%	➖ noise
10	duckdb:vortex-file-compressed	-4.6%	+0.5%	-5.1%	+10.6%	➖ noise
11	datafusion:vortex-file-compressed	-0.2%	+1.1%	-1.3%	+10.3%	➖ noise
11	duckdb:duckdb	+1.2%	+1.1%	+0.0%	+10.0%	➖ noise
11	duckdb:vortex-file-compressed	+0.2%	+1.1%	-1.0%	+10.0%	➖ noise
12	datafusion:vortex-file-compressed	+5.0%	-0.5%	+5.6%	+10.0%	➖ noise
12	duckdb:duckdb	+0.6%	-0.5%	+1.1%	+10.0%	➖ noise
12	duckdb:vortex-file-compressed	+2.3%	-0.5%	+2.8%	+10.0%	➖ noise
13	datafusion:vortex-file-compressed	+4.3%	+1.0%	+3.3%	+10.0%	➖ noise
13	duckdb:duckdb	+0.7%	+1.0%	-0.3%	+10.0%	➖ noise
13	duckdb:vortex-file-compressed	+1.1%	+1.0%	+0.0%	+10.0%	➖ noise
14	datafusion:vortex-file-compressed	+4.1%	+0.5%	+3.6%	+10.0%	➖ noise
14	duckdb:duckdb	+2.9%	+0.5%	+2.4%	+10.0%	➖ noise
14	duckdb:vortex-file-compressed	+2.2%	+0.5%	+1.7%	+10.0%	➖ noise
15	datafusion:vortex-file-compressed	+3.9%	-0.5%	+4.4%	+10.0%	➖ noise
15	duckdb:duckdb	-0.1%	-0.5%	+0.3%	+10.0%	➖ noise
15	duckdb:vortex-file-compressed	+0.9%	-0.5%	+1.4%	+10.0%	➖ noise
16	datafusion:vortex-file-compressed	+1.0%	-0.5%	+1.5%	+10.0%	➖ noise
16	duckdb:duckdb	+0.7%	-0.5%	+1.2%	+10.0%	➖ noise
16	duckdb:vortex-file-compressed	+1.5%	-0.5%	+2.0%	+10.0%	➖ noise
17	datafusion:vortex-file-compressed	+3.5%	+1.9%	+1.5%	+10.0%	➖ noise
17	duckdb:duckdb	+2.0%	+1.9%	+0.1%	+10.0%	➖ noise
17	duckdb:vortex-file-compressed	+1.3%	+1.9%	-0.6%	+10.0%	➖ noise
18	datafusion:vortex-file-compressed	+5.2%	+2.2%	+3.0%	+10.0%	➖ noise
18	duckdb:duckdb	+5.2%	+2.2%	+2.9%	+10.0%	➖ noise
18	duckdb:vortex-file-compressed	+1.5%	+2.2%	-0.7%	+10.0%	➖ noise
19	datafusion:vortex-file-compressed	-6.0%	+0.3%	-6.3%	+35.9%	➖ noise
19	duckdb:duckdb	+5.3%	+0.3%	+5.0%	+23.3%	➖ noise
19	duckdb:vortex-file-compressed	+2.4%	+0.3%	+2.2%	+24.2%	➖ noise
20	datafusion:vortex-file-compressed	+1.4%	+0.2%	+1.2%	+198.9%	➖ noise
20	duckdb:duckdb	+3.7%	+0.2%	+3.5%	+99.8%	➖ noise
20	duckdb:vortex-file-compressed	+1.1%	+0.2%	+0.9%	+88.7%	➖ noise
21	datafusion:vortex-file-compressed	+5.0%	+0.5%	+4.5%	+10.0%	➖ noise
21	duckdb:duckdb	-0.3%	+0.5%	-0.8%	+10.0%	➖ noise
21	duckdb:vortex-file-compressed	+17.1%	+0.5%	+16.5%	+10.0%	🚨 regression
22	datafusion:vortex-file-compressed	+2.9%	-0.4%	+3.3%	+12.9%	➖ noise
22	duckdb:duckdb	-2.6%	-0.4%	-2.2%	+46.8%	➖ noise
22	duckdb:vortex-file-compressed	+15.7%	-0.4%	+16.1%	+21.2%	➖ noise
23	datafusion:vortex-file-compressed	+6.7%	+4.4%	+2.2%	+45.2%	➖ noise
23	duckdb:duckdb	+2.5%	+4.4%	-1.8%	+13.8%	➖ noise
23	duckdb:vortex-file-compressed	+0.7%	+4.4%	-3.5%	+10.7%	➖ noise
24	datafusion:vortex-file-compressed	+11.3%	+1.7%	+9.5%	+24.5%	➖ noise
24	duckdb:duckdb	+12.3%	+1.7%	+10.5%	+44.2%	➖ noise
24	duckdb:vortex-file-compressed	-4.3%	+1.7%	-5.8%	+33.1%	➖ noise
25	datafusion:vortex-file-compressed	+7.7%	+0.7%	+7.0%	+17.5%	➖ noise
25	duckdb:duckdb	+11.7%	+0.7%	+10.9%	+10.0%	🚨 regression
25	duckdb:vortex-file-compressed	+5.8%	+0.7%	+5.1%	+10.0%	➖ noise
26	datafusion:vortex-file-compressed	+7.9%	+0.3%	+7.6%	+11.4%	➖ noise
26	duckdb:duckdb	+15.7%	+0.3%	+15.3%	+12.6%	🚨 regression
26	duckdb:vortex-file-compressed	-14.2%	+0.3%	-14.4%	+16.4%	✅ faster
27	datafusion:vortex-file-compressed	+4.9%	+0.3%	+4.5%	+10.0%	➖ noise
27	duckdb:duckdb	+15.9%	+0.3%	+15.5%	+10.0%	🚨 regression
27	duckdb:vortex-file-compressed	+1.8%	+0.3%	+1.4%	+10.0%	➖ noise
28	datafusion:vortex-file-compressed	+2.8%	-0.4%	+3.2%	+10.0%	➖ noise
28	duckdb:duckdb	+3.8%	-0.4%	+4.2%	+10.0%	➖ noise
28	duckdb:vortex-file-compressed	+0.8%	-0.4%	+1.2%	+11.0%	➖ noise
29	datafusion:vortex-file-compressed	+3.4%	-2.5%	+6.0%	+14.5%	➖ noise
29	duckdb:duckdb	-1.1%	-2.5%	+1.4%	+10.5%	➖ noise
29	duckdb:vortex-file-compressed	+37.0%	-2.5%	+40.6%	+49.8%	➖ noise
30	datafusion:vortex-file-compressed	+19.6%	+1.0%	+18.5%	+10.0%	🚨 regression
30	duckdb:duckdb	-1.3%	+1.0%	-2.3%	+10.0%	➖ noise
30	duckdb:vortex-file-compressed	+6.4%	+1.0%	+5.3%	+10.0%	➖ noise
31	datafusion:vortex-file-compressed	+13.2%	+2.0%	+10.9%	+10.0%	🚨 regression
31	duckdb:duckdb	-0.6%	+2.0%	-2.6%	+10.0%	➖ noise
31	duckdb:vortex-file-compressed	+4.0%	+2.0%	+1.9%	+10.0%	➖ noise
32	datafusion:vortex-file-compressed	+12.9%	+4.4%	+8.2%	+10.0%	➖ noise
32	duckdb:duckdb	+0.0%	+4.4%	-4.2%	+10.0%	➖ noise
32	duckdb:vortex-file-compressed	+2.9%	+4.4%	-1.5%	+10.0%	➖ noise
33	datafusion:vortex-file-compressed	+11.1%	+3.3%	+7.6%	+10.0%	➖ noise
33	duckdb:duckdb	+1.1%	+3.3%	-2.1%	+10.0%	➖ noise
33	duckdb:vortex-file-compressed	-8.4%	+3.3%	-11.3%	+25.2%	➖ noise
34	datafusion:vortex-file-compressed	+10.1%	+1.4%	+8.7%	+10.0%	➖ noise
34	duckdb:duckdb	+1.0%	+1.4%	-0.4%	+10.0%	➖ noise
34	duckdb:vortex-file-compressed	-0.9%	+1.4%	-2.2%	+10.0%	➖ noise
35	datafusion:vortex-file-compressed	+3.3%	+0.4%	+2.9%	+10.0%	➖ noise
35	duckdb:duckdb	-0.7%	+0.4%	-1.0%	+10.0%	➖ noise
35	duckdb:vortex-file-compressed	+3.2%	+0.4%	+2.8%	+10.0%	➖ noise
36	datafusion:vortex-file-compressed	-3.2%	+7.5%	-10.0%	+11.9%	➖ noise
36	duckdb:duckdb	+0.2%	+7.5%	-6.8%	+13.7%	➖ noise
36	duckdb:vortex-file-compressed	-5.1%	+7.5%	-11.8%	+10.0%	✅ faster
37	datafusion:vortex-file-compressed	+5.1%	+2.0%	+3.1%	+11.8%	➖ noise
37	duckdb:duckdb	+1.5%	+2.0%	-0.5%	+10.0%	➖ noise
37	duckdb:vortex-file-compressed	+3.6%	+2.0%	+1.6%	+13.8%	➖ noise
38	datafusion:vortex-file-compressed	+5.2%	+1.4%	+3.7%	+17.9%	➖ noise
38	duckdb:duckdb	+4.9%	+1.4%	+3.4%	+10.0%	➖ noise
38	duckdb:vortex-file-compressed	-6.1%	+1.4%	-7.4%	+10.0%	➖ noise
39	datafusion:vortex-file-compressed	+4.6%	-0.9%	+5.6%	+14.1%	➖ noise
39	duckdb:duckdb	+24.1%	-0.9%	+25.3%	+21.4%	🚨 regression
39	duckdb:vortex-file-compressed	-6.2%	-0.9%	-5.3%	+15.2%	➖ noise
40	datafusion:vortex-file-compressed	+4.3%	-1.7%	+6.2%	+24.4%	➖ noise
40	duckdb:duckdb	+1.7%	-1.7%	+3.5%	+10.0%	➖ noise
40	duckdb:vortex-file-compressed	-15.5%	-1.7%	-14.0%	+11.3%	✅ faster
41	datafusion:vortex-file-compressed	+1.5%	+3.1%	-1.5%	+12.3%	➖ noise
41	duckdb:duckdb	+2.8%	+3.1%	-0.3%	+10.0%	➖ noise
41	duckdb:vortex-file-compressed	-10.6%	+3.1%	-13.3%	+12.5%	✅ faster
42	datafusion:vortex-file-compressed	+0.1%	-1.9%	+2.0%	+17.4%	➖ noise
42	duckdb:duckdb	+2.0%	-1.9%	+3.9%	+14.0%	➖ noise
42	duckdb:vortex-file-compressed	-3.7%	-1.9%	-1.8%	+19.3%	➖ noise

[github-actions]

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.2%
Engines: DataFusion No clear signal (+6.6%, environment too noisy confidence) · DuckDB No clear signal (+1.9%, environment too noisy confidence)
Vortex (geomean): 0.960x ➖
Parquet (geomean): 0.921x ➖
Shifts: Parquet (control) -7.9% · Median polish -1.2%

How to read Verdict and Engines

• Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
• Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
• Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

---

datafusion / vortex-file-compressed (0.986x ➖, 3↑ 4↓)

name	PR 672a27e (ns)	base 9e5ed2e (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀	263023509	389460888	0.68
tpch_q02/datafusion:vortex-file-compressed	590698559	546998758	1.08
tpch_q03/datafusion:vortex-file-compressed	470315024	462608481	1.02
tpch_q04/datafusion:vortex-file-compressed	259873080	282757288	0.92
tpch_q05/datafusion:vortex-file-compressed	630342205	787291075	0.80
tpch_q06/datafusion:vortex-file-compressed	556458201	675515791	0.82
tpch_q07/datafusion:vortex-file-compressed	724907495	813455370	0.89
tpch_q08/datafusion:vortex-file-compressed	977184864	926701361	1.05
tpch_q09/datafusion:vortex-file-compressed	787593329	766782275	1.03
tpch_q10/datafusion:vortex-file-compressed 🚨	1009889774	750913677	1.34
tpch_q11/datafusion:vortex-file-compressed	413772641	371342206	1.11
tpch_q12/datafusion:vortex-file-compressed 🚀	542179879	820909574	0.66
tpch_q13/datafusion:vortex-file-compressed	233627851	274056242	0.85
tpch_q14/datafusion:vortex-file-compressed	610849655	840745860	0.73
tpch_q15/datafusion:vortex-file-compressed	842707322	909988305	0.93
tpch_q16/datafusion:vortex-file-compressed	306378899	250668727	1.22
tpch_q17/datafusion:vortex-file-compressed 🚨	853352198	517733105	1.65
tpch_q18/datafusion:vortex-file-compressed 🚨	649985204	400324173	1.62
tpch_q19/datafusion:vortex-file-compressed 🚨	778602846	533730055	1.46
tpch_q20/datafusion:vortex-file-compressed	424253839	413168908	1.03
tpch_q21/datafusion:vortex-file-compressed	649053856	704186745	0.92
tpch_q22/datafusion:vortex-file-compressed 🚀	153640051	233272719	0.66

datafusion / vortex-compact (0.796x ➖, 4↑ 0↓)

name	PR 672a27e (ns)	base 9e5ed2e (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact	262061437	272858096	0.96
tpch_q02/datafusion:vortex-compact	602435818	518115381	1.16
tpch_q03/datafusion:vortex-compact 🚀	381050871	687199701	0.55
tpch_q04/datafusion:vortex-compact	232520710	302580177	0.77
tpch_q05/datafusion:vortex-compact	419765836	596319614	0.70
tpch_q06/datafusion:vortex-compact	334609275	459396393	0.73
tpch_q07/datafusion:vortex-compact	436879142	539742364	0.81
tpch_q08/datafusion:vortex-compact	651477117	723182556	0.90
tpch_q09/datafusion:vortex-compact	542624111	553420228	0.98
tpch_q10/datafusion:vortex-compact	530162705	618644980	0.86
tpch_q11/datafusion:vortex-compact	330621983	340273891	0.97
tpch_q12/datafusion:vortex-compact 🚀	421973685	852907265	0.49
tpch_q13/datafusion:vortex-compact 🚀	145850203	318276151	0.46
tpch_q14/datafusion:vortex-compact 🚀	337218074	642228823	0.53
tpch_q15/datafusion:vortex-compact	642863989	808960495	0.79
tpch_q16/datafusion:vortex-compact	257110501	262810336	0.98
tpch_q17/datafusion:vortex-compact	458402206	546199469	0.84
tpch_q18/datafusion:vortex-compact	372121442	377785731	0.99
tpch_q19/datafusion:vortex-compact	488301977	544429023	0.90
tpch_q20/datafusion:vortex-compact	432841868	510588243	0.85
tpch_q21/datafusion:vortex-compact	693155023	867646721	0.80
tpch_q22/datafusion:vortex-compact	210283915	214871565	0.98

datafusion / parquet (0.831x ➖, 8↑ 2↓)

name	PR 672a27e (ns)	base 9e5ed2e (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	305442433	277703234	1.10
tpch_q02/datafusion:parquet	387376108	459518227	0.84
tpch_q03/datafusion:parquet	362818634	431276647	0.84
tpch_q04/datafusion:parquet 🚀	202188924	316351000	0.64
tpch_q05/datafusion:parquet	442458749	541542664	0.82
tpch_q06/datafusion:parquet 🚀	135173614	252183262	0.54
tpch_q07/datafusion:parquet	469115470	587664587	0.80
tpch_q08/datafusion:parquet	558490620	676812453	0.83
tpch_q09/datafusion:parquet	454115281	475845634	0.95
tpch_q10/datafusion:parquet 🚀	501254799	733498563	0.68
tpch_q11/datafusion:parquet	369435437	427205261	0.86
tpch_q12/datafusion:parquet 🚀	260997288	476636802	0.55
tpch_q13/datafusion:parquet 🚀	434804499	674434593	0.64
tpch_q14/datafusion:parquet 🚀	205967421	387199468	0.53
tpch_q15/datafusion:parquet 🚀	326140785	599844705	0.54
tpch_q16/datafusion:parquet 🚀	169745940	435184850	0.39
tpch_q17/datafusion:parquet 🚨	983253699	476093995	2.07
tpch_q18/datafusion:parquet 🚨	1045853453	531186886	1.97
tpch_q19/datafusion:parquet	497055042	392744301	1.27
tpch_q20/datafusion:parquet	398159834	421827341	0.94
tpch_q21/datafusion:parquet	624916323	526104661	1.19
tpch_q22/datafusion:parquet	123819764	136171029	0.91

duckdb / vortex-file-compressed (1.009x ➖, 0↑ 2↓)

name	PR 672a27e (ns)	base 9e5ed2e (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	307387196	327294847	0.94
tpch_q02/duckdb:vortex-file-compressed	1052326537	1190216486	0.88
tpch_q03/duckdb:vortex-file-compressed	708187629	845296205	0.84
tpch_q04/duckdb:vortex-file-compressed	399133836	452460479	0.88
tpch_q05/duckdb:vortex-file-compressed	999761683	909427514	1.10
tpch_q06/duckdb:vortex-file-compressed 🚨	495715846	347668339	1.43
tpch_q07/duckdb:vortex-file-compressed 🚨	1208057913	923149003	1.31
tpch_q08/duckdb:vortex-file-compressed	1074831315	1207414151	0.89
tpch_q09/duckdb:vortex-file-compressed	1118746543	1012135280	1.11
tpch_q10/duckdb:vortex-file-compressed	1061723435	819775939	1.30
tpch_q11/duckdb:vortex-file-compressed	548228363	558725374	0.98
tpch_q12/duckdb:vortex-file-compressed	809810559	866942640	0.93
tpch_q13/duckdb:vortex-file-compressed	463645141	498304464	0.93
tpch_q14/duckdb:vortex-file-compressed	436808505	438214727	1.00
tpch_q15/duckdb:vortex-file-compressed	357638114	363657644	0.98
tpch_q16/duckdb:vortex-file-compressed	349640732	383678756	0.91
tpch_q17/duckdb:vortex-file-compressed	680793213	752430344	0.90
tpch_q18/duckdb:vortex-file-compressed	721754721	702460740	1.03
tpch_q19/duckdb:vortex-file-compressed	569451700	571719408	1.00
tpch_q20/duckdb:vortex-file-compressed	1000512462	995446998	1.01
tpch_q21/duckdb:vortex-file-compressed	1328337746	1287505153	1.03
tpch_q22/duckdb:vortex-file-compressed	304021853	290494311	1.05

duckdb / vortex-compact (1.070x ➖, 0↑ 2↓)

name	PR 672a27e (ns)	base 9e5ed2e (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨	378156257	278979156	1.36
tpch_q02/duckdb:vortex-compact	960633760	925250775	1.04
tpch_q03/duckdb:vortex-compact	702998917	657737723	1.07
tpch_q04/duckdb:vortex-compact	461562420	429042385	1.08
tpch_q05/duckdb:vortex-compact	866460593	893963784	0.97
tpch_q06/duckdb:vortex-compact	398322356	380393928	1.05
tpch_q07/duckdb:vortex-compact	933572859	1096295416	0.85
tpch_q08/duckdb:vortex-compact 🚨	1280545163	984507661	1.30
tpch_q09/duckdb:vortex-compact	1182290327	1051320539	1.12
tpch_q10/duckdb:vortex-compact	876167029	732647279	1.20
tpch_q11/duckdb:vortex-compact	525175596	524909007	1.00
tpch_q12/duckdb:vortex-compact	772786744	730935669	1.06
tpch_q13/duckdb:vortex-compact	513584770	420451902	1.22
tpch_q14/duckdb:vortex-compact	476624946	395695960	1.20
tpch_q15/duckdb:vortex-compact	282297981	274826308	1.03
tpch_q16/duckdb:vortex-compact	340139017	353909133	0.96
tpch_q17/duckdb:vortex-compact	771551651	758536160	1.02
tpch_q18/duckdb:vortex-compact	603223488	611342117	0.99
tpch_q19/duckdb:vortex-compact	534690756	466912217	1.15
tpch_q20/duckdb:vortex-compact	869407974	765778772	1.14
tpch_q21/duckdb:vortex-compact	1102596048	1167860688	0.94
tpch_q22/duckdb:vortex-compact	285910965	297833576	0.96

duckdb / parquet (1.020x ➖, 0↑ 1↓)

name	PR 672a27e (ns)	base 9e5ed2e (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	443049466	502034368	0.88
tpch_q02/duckdb:parquet	1264659285	1122439262	1.13
tpch_q03/duckdb:parquet	1155476484	1018416175	1.13
tpch_q04/duckdb:parquet	780314208	803095400	0.97
tpch_q05/duckdb:parquet	1444550728	1278616488	1.13
tpch_q06/duckdb:parquet	569687589	513376420	1.11
tpch_q07/duckdb:parquet	1459529734	1291325997	1.13
tpch_q08/duckdb:parquet	1561037796	1551278550	1.01
tpch_q09/duckdb:parquet	1584902681	1399100832	1.13
tpch_q10/duckdb:parquet	1398403213	1412884260	0.99
tpch_q11/duckdb:parquet	829398141	765020577	1.08
tpch_q12/duckdb:parquet	903695033	933190364	0.97
tpch_q13/duckdb:parquet	873711329	928287843	0.94
tpch_q14/duckdb:parquet	762818081	693032658	1.10
tpch_q15/duckdb:parquet	596160189	699044134	0.85
tpch_q16/duckdb:parquet	605512674	681158235	0.89
tpch_q17/duckdb:parquet 🚨	1059678997	814329122	1.30
tpch_q18/duckdb:parquet	955304124	981135410	0.97
tpch_q19/duckdb:parquet	943423720	913128828	1.03
tpch_q20/duckdb:parquet	1183136406	1135706569	1.04
tpch_q21/duckdb:parquet	1208137060	1400664883	0.86
tpch_q22/duckdb:parquet	567584007	624943981	0.91

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:vortex-compact	-4.0%	-1.5%	-2.5%	+78.8%	➖ noise
1	datafusion:vortex-file-compressed	-32.5%	-1.5%	-31.5%	+81.0%	➖ noise
1	duckdb:vortex-compact	+35.6%	-1.5%	+37.6%	+78.8%	➖ noise
1	duckdb:vortex-file-compressed	-6.1%	-1.5%	-4.7%	+78.8%	➖ noise
2	datafusion:vortex-compact	+16.3%	-2.5%	+19.3%	+78.8%	➖ noise
2	datafusion:vortex-file-compressed	+8.0%	-2.5%	+10.8%	+78.8%	➖ noise
2	duckdb:vortex-compact	+3.8%	-2.5%	+6.5%	+78.8%	➖ noise
2	duckdb:vortex-file-compressed	-11.6%	-2.5%	-9.3%	+78.8%	➖ noise
3	datafusion:vortex-compact	-44.6%	-2.3%	-43.2%	+78.8%	➖ noise
3	datafusion:vortex-file-compressed	+1.7%	-2.3%	+4.1%	+78.8%	➖ noise
3	duckdb:vortex-compact	+6.9%	-2.3%	+9.4%	+78.8%	➖ noise
3	duckdb:vortex-file-compressed	-16.2%	-2.3%	-14.2%	+78.8%	➖ noise
4	datafusion:vortex-compact	-23.2%	-21.2%	-2.5%	+78.8%	➖ noise
4	datafusion:vortex-file-compressed	-8.1%	-21.2%	+16.6%	+78.8%	➖ noise
4	duckdb:vortex-compact	+7.6%	-21.2%	+36.5%	+78.8%	➖ noise
4	duckdb:vortex-file-compressed	-11.8%	-21.2%	+11.9%	+78.8%	➖ noise
5	datafusion:vortex-compact	-29.6%	-3.9%	-26.7%	+78.8%	➖ noise
5	datafusion:vortex-file-compressed	-19.9%	-3.9%	-16.7%	+78.8%	➖ noise
5	duckdb:vortex-compact	-3.1%	-3.9%	+0.9%	+78.8%	➖ noise
5	duckdb:vortex-file-compressed	+9.9%	-3.9%	+14.4%	+78.8%	➖ noise
6	datafusion:vortex-compact	-27.2%	-22.9%	-5.6%	+78.8%	➖ noise
6	datafusion:vortex-file-compressed	-17.6%	-22.9%	+6.8%	+78.8%	➖ noise
6	duckdb:vortex-compact	+4.7%	-22.9%	+35.8%	+78.8%	➖ noise
6	duckdb:vortex-file-compressed	+42.6%	-22.9%	+84.9%	+78.8%	🚨 regression
7	datafusion:vortex-compact	-19.1%	-5.0%	-14.8%	+78.8%	➖ noise
7	datafusion:vortex-file-compressed	-10.9%	-5.0%	-6.2%	+78.8%	➖ noise
7	duckdb:vortex-compact	-14.8%	-5.0%	-10.3%	+78.8%	➖ noise
7	duckdb:vortex-file-compressed	+30.9%	-5.0%	+37.8%	+78.8%	➖ noise
8	datafusion:vortex-compact	-9.9%	-8.9%	-1.1%	+78.8%	➖ noise
8	datafusion:vortex-file-compressed	+5.4%	-8.9%	+15.7%	+78.8%	➖ noise
8	duckdb:vortex-compact	+30.1%	-8.9%	+42.7%	+78.8%	➖ noise
8	duckdb:vortex-file-compressed	-11.0%	-8.9%	-2.3%	+78.8%	➖ noise
9	datafusion:vortex-compact	-2.0%	+4.0%	-5.7%	+78.8%	➖ noise
9	datafusion:vortex-file-compressed	+2.7%	+4.0%	-1.2%	+78.8%	➖ noise
9	duckdb:vortex-compact	+12.5%	+4.0%	+8.2%	+78.8%	➖ noise
9	duckdb:vortex-file-compressed	+10.5%	+4.0%	+6.3%	+78.8%	➖ noise
10	datafusion:vortex-compact	-14.3%	-17.8%	+4.2%	+78.8%	➖ noise
10	datafusion:vortex-file-compressed	+34.5%	-17.8%	+63.5%	+78.8%	➖ noise
10	duckdb:vortex-compact	+19.6%	-17.8%	+45.4%	+78.8%	➖ noise
10	duckdb:vortex-file-compressed	+29.5%	-17.8%	+57.5%	+78.8%	➖ noise
11	datafusion:vortex-compact	-2.8%	-3.2%	+0.3%	+78.8%	➖ noise
11	datafusion:vortex-file-compressed	+11.4%	-3.2%	+15.1%	+78.8%	➖ noise
11	duckdb:vortex-compact	+0.1%	-3.2%	+3.3%	+78.8%	➖ noise
11	duckdb:vortex-file-compressed	-1.9%	-3.2%	+1.3%	+78.8%	➖ noise
12	datafusion:vortex-compact	-50.5%	-27.2%	-32.1%	+78.8%	➖ noise
12	datafusion:vortex-file-compressed	-34.0%	-27.2%	-9.3%	+78.8%	➖ noise
12	duckdb:vortex-compact	+5.7%	-27.2%	+45.2%	+78.8%	➖ noise
12	duckdb:vortex-file-compressed	-6.6%	-27.2%	+28.3%	+78.8%	➖ noise
13	datafusion:vortex-compact	-54.2%	-22.1%	-41.2%	+78.8%	➖ noise
13	datafusion:vortex-file-compressed	-14.8%	-22.1%	+9.4%	+84.2%	➖ noise
13	duckdb:vortex-compact	+22.2%	-22.1%	+56.8%	+78.8%	➖ noise
13	duckdb:vortex-file-compressed	-7.0%	-22.1%	+19.4%	+78.8%	➖ noise
14	datafusion:vortex-compact	-47.5%	-23.5%	-31.4%	+78.8%	➖ noise
14	datafusion:vortex-file-compressed	-27.3%	-23.5%	-5.0%	+78.8%	➖ noise
14	duckdb:vortex-compact	+20.5%	-23.5%	+57.4%	+78.8%	➖ noise
14	duckdb:vortex-file-compressed	-0.3%	-23.5%	+30.3%	+78.8%	➖ noise
15	datafusion:vortex-compact	-20.5%	-31.9%	+16.7%	+78.8%	➖ noise
15	datafusion:vortex-file-compressed	-7.4%	-31.9%	+36.0%	+78.8%	➖ noise
15	duckdb:vortex-compact	+2.7%	-31.9%	+50.8%	+78.8%	➖ noise
15	duckdb:vortex-file-compressed	-1.7%	-31.9%	+44.4%	+78.8%	➖ noise
16	datafusion:vortex-compact	-2.2%	-41.1%	+66.1%	+78.8%	➖ noise
16	datafusion:vortex-file-compressed	+22.2%	-41.1%	+107.6%	+91.0%	🚨 regression
16	duckdb:vortex-compact	-3.9%	-41.1%	+63.2%	+78.8%	➖ noise
16	duckdb:vortex-file-compressed	-8.9%	-41.1%	+54.8%	+78.8%	➖ noise
17	datafusion:vortex-compact	-16.1%	+63.9%	-48.8%	+78.8%	✅ faster
17	datafusion:vortex-file-compressed	+64.8%	+63.9%	+0.5%	+78.8%	➖ noise
17	duckdb:vortex-compact	+1.7%	+63.9%	-38.0%	+78.8%	➖ noise
17	duckdb:vortex-file-compressed	-9.5%	+63.9%	-44.8%	+78.8%	✅ faster
18	datafusion:vortex-compact	-1.5%	+38.5%	-28.9%	+78.8%	➖ noise
18	datafusion:vortex-file-compressed	+62.4%	+38.5%	+17.3%	+78.8%	➖ noise
18	duckdb:vortex-compact	-1.3%	+38.5%	-28.7%	+78.8%	➖ noise
18	duckdb:vortex-file-compressed	+2.7%	+38.5%	-25.8%	+78.8%	➖ noise
19	datafusion:vortex-compact	-10.3%	+14.3%	-21.6%	+78.8%	➖ noise
19	datafusion:vortex-file-compressed	+45.9%	+14.3%	+27.6%	+78.8%	➖ noise
19	duckdb:vortex-compact	+14.5%	+14.3%	+0.1%	+78.8%	➖ noise
19	duckdb:vortex-file-compressed	-0.4%	+14.3%	-12.9%	+78.8%	➖ noise
20	datafusion:vortex-compact	-15.2%	-0.8%	-14.5%	+78.8%	➖ noise
20	datafusion:vortex-file-compressed	+2.7%	-0.8%	+3.6%	+78.8%	➖ noise
20	duckdb:vortex-compact	+13.5%	-0.8%	+14.5%	+78.8%	➖ noise
20	duckdb:vortex-file-compressed	+0.5%	-0.8%	+1.4%	+78.8%	➖ noise
21	datafusion:vortex-compact	-20.1%	+1.2%	-21.1%	+78.8%	➖ noise
21	datafusion:vortex-file-compressed	-7.8%	+1.2%	-8.9%	+78.8%	➖ noise
21	duckdb:vortex-compact	-5.6%	+1.2%	-6.7%	+78.8%	➖ noise
21	duckdb:vortex-file-compressed	+3.2%	+1.2%	+1.9%	+78.8%	➖ noise
22	datafusion:vortex-compact	-2.1%	-9.1%	+7.7%	+78.8%	➖ noise
22	datafusion:vortex-file-compressed	-34.1%	-9.1%	-27.5%	+78.8%	➖ noise
22	duckdb:vortex-compact	-4.0%	-9.1%	+5.6%	+78.8%	➖ noise
22	duckdb:vortex-file-compressed	+4.7%	-9.1%	+15.2%	+78.8%	➖ noise

[joseph-isaacs]

Verdict and Within-engine, could we add a helper somewhere in the comment in a hidden section, explaining them

[AdamGS]

btw changed "within-engine" to "engines", just happened after I triggered this run

[github-actions]

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -8.5%
Engines: DataFusion No clear signal (-18.0%, environment too noisy confidence) · DuckDB No clear signal (+2.0%, environment too noisy confidence)
Vortex (geomean): 0.954x ➖
Parquet (geomean): 1.043x ➖
Shifts: Parquet (control) +4.3% · Median polish -3.2%

How to read Verdict and Engines

• Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
• Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
• Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

---

datafusion / vortex-file-compressed (0.945x ➖, 3↑ 3↓)

name	PR 672a27e (ns)	base 9e5ed2e (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	906212883	798403163	1.14
tpch_q02/datafusion:vortex-file-compressed 🚨	1476387944	1028713620	1.44
tpch_q03/datafusion:vortex-file-compressed	1080597203	958757449	1.13
tpch_q04/datafusion:vortex-file-compressed	629291723	623497028	1.01
tpch_q05/datafusion:vortex-file-compressed	1154131131	1182158537	0.98
tpch_q06/datafusion:vortex-file-compressed	616234796	625440083	0.99
tpch_q07/datafusion:vortex-file-compressed	1215429124	1362971572	0.89
tpch_q08/datafusion:vortex-file-compressed 🚨	1697885524	1268740055	1.34
tpch_q09/datafusion:vortex-file-compressed	1790479180	1462470092	1.22
tpch_q10/datafusion:vortex-file-compressed	1270082051	1316910447	0.96
tpch_q11/datafusion:vortex-file-compressed 🚨	962776892	626177368	1.54
tpch_q12/datafusion:vortex-file-compressed	983871626	1107288815	0.89
tpch_q13/datafusion:vortex-file-compressed	519197009	535413616	0.97
tpch_q14/datafusion:vortex-file-compressed	813911713	659187054	1.23
tpch_q15/datafusion:vortex-file-compressed	1787820984	1473237637	1.21
tpch_q16/datafusion:vortex-file-compressed	684179093	848970006	0.81
tpch_q17/datafusion:vortex-file-compressed	1235530091	1531104611	0.81
tpch_q18/datafusion:vortex-file-compressed	1291336141	1769175986	0.73
tpch_q19/datafusion:vortex-file-compressed 🚀	785461676	1254306881	0.63
tpch_q20/datafusion:vortex-file-compressed 🚀	1113225588	1818004996	0.61
tpch_q21/datafusion:vortex-file-compressed	1875259286	2182734495	0.86
tpch_q22/datafusion:vortex-file-compressed 🚀	494795672	1331346323	0.37

datafusion / vortex-compact (0.912x ➖, 2↑ 0↓)

name	PR 672a27e (ns)	base 9e5ed2e (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-compact	712563597	794873247	0.90
tpch_q02/datafusion:vortex-compact 🚀	920549285	1409353677	0.65
tpch_q03/datafusion:vortex-compact	790583383	896679448	0.88
tpch_q04/datafusion:vortex-compact	632820987	685913092	0.92
tpch_q05/datafusion:vortex-compact	980674711	1305577708	0.75
tpch_q06/datafusion:vortex-compact	575261046	627463783	0.92
tpch_q07/datafusion:vortex-compact	1166000767	1273533260	0.92
tpch_q08/datafusion:vortex-compact	1370677351	1514334262	0.91
tpch_q09/datafusion:vortex-compact	1431807655	1514541462	0.95
tpch_q10/datafusion:vortex-compact	1165245613	1327419794	0.88
tpch_q11/datafusion:vortex-compact	706728262	546852341	1.29
tpch_q12/datafusion:vortex-compact	902400650	866286817	1.04
tpch_q13/datafusion:vortex-compact	455836757	409724031	1.11
tpch_q14/datafusion:vortex-compact	579110372	591318149	0.98
tpch_q15/datafusion:vortex-compact	1012781921	1002218005	1.01
tpch_q16/datafusion:vortex-compact	324600667	400014313	0.81
tpch_q17/datafusion:vortex-compact	1494476416	1621436519	0.92
tpch_q18/datafusion:vortex-compact	1162355204	1373615905	0.85
tpch_q19/datafusion:vortex-compact	1005403407	1109989947	0.91
tpch_q20/datafusion:vortex-compact	1285190844	1273809445	1.01
tpch_q21/datafusion:vortex-compact	1686229797	1721037485	0.98
tpch_q22/datafusion:vortex-compact 🚀	470458189	672467134	0.70

datafusion / parquet (1.132x ➖, 1↑ 7↓)

name	PR 672a27e (ns)	base 9e5ed2e (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	883498694	822582695	1.07
tpch_q02/datafusion:parquet 🚨	1159073336	814300909	1.42
tpch_q03/datafusion:parquet 🚀	1005521616	1736937414	0.58
tpch_q04/datafusion:parquet	663769587	806202715	0.82
tpch_q05/datafusion:parquet	1431636214	1716105081	0.83
tpch_q06/datafusion:parquet 🚨	959227760	676714159	1.42
tpch_q07/datafusion:parquet	2101710467	1863612680	1.13
tpch_q08/datafusion:parquet	2188328863	1968518065	1.11
tpch_q09/datafusion:parquet	1953805672	1715244604	1.14
tpch_q10/datafusion:parquet 🚨	2635951249	1932197847	1.36
tpch_q11/datafusion:parquet 🚨	877958558	533695636	1.65
tpch_q12/datafusion:parquet	785011149	872627442	0.90
tpch_q13/datafusion:parquet	871606746	876739579	0.99
tpch_q14/datafusion:parquet	1087675035	839988533	1.29
tpch_q15/datafusion:parquet	1624953822	1407195357	1.15
tpch_q16/datafusion:parquet 🚨	839421499	451953736	1.86
tpch_q17/datafusion:parquet	1940063333	1539921107	1.26
tpch_q18/datafusion:parquet 🚨	2705983256	1844884459	1.47
tpch_q19/datafusion:parquet	1057370966	992586281	1.07
tpch_q20/datafusion:parquet 🚨	1968204319	1435089066	1.37
tpch_q21/datafusion:parquet	1821022066	2212387349	0.82
tpch_q22/datafusion:parquet	849044862	837879797	1.01

duckdb / vortex-file-compressed (0.998x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 9e5ed2e (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	613205004	652511582	0.94
tpch_q02/duckdb:vortex-file-compressed	1232213937	1198696973	1.03
tpch_q03/duckdb:vortex-file-compressed	1036368244	958842130	1.08
tpch_q04/duckdb:vortex-file-compressed	747107351	727002920	1.03
tpch_q05/duckdb:vortex-file-compressed	1294574432	1263480538	1.02
tpch_q06/duckdb:vortex-file-compressed	625825318	608255176	1.03
tpch_q07/duckdb:vortex-file-compressed	1294804072	1400675991	0.92
tpch_q08/duckdb:vortex-file-compressed	1386176273	1404916178	0.99
tpch_q09/duckdb:vortex-file-compressed	1767946861	1726352203	1.02
tpch_q10/duckdb:vortex-file-compressed	1146751687	1233774894	0.93
tpch_q11/duckdb:vortex-file-compressed	670438590	663380625	1.01
tpch_q12/duckdb:vortex-file-compressed	1248443140	1231298308	1.01
tpch_q13/duckdb:vortex-file-compressed	977356407	906324911	1.08
tpch_q14/duckdb:vortex-file-compressed	629790875	627635652	1.00
tpch_q15/duckdb:vortex-file-compressed	588977244	560240946	1.05
tpch_q16/duckdb:vortex-file-compressed	531486163	543096722	0.98
tpch_q17/duckdb:vortex-file-compressed	1076608564	1049417318	1.03
tpch_q18/duckdb:vortex-file-compressed	1079522066	1062023964	1.02
tpch_q19/duckdb:vortex-file-compressed	789804926	913534437	0.86
tpch_q20/duckdb:vortex-file-compressed	1428980792	1242548568	1.15
tpch_q21/duckdb:vortex-file-compressed	1931184937	2391710773	0.81
tpch_q22/duckdb:vortex-file-compressed	433809327	424809524	1.02

duckdb / vortex-compact (0.963x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 9e5ed2e (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-compact	581087507	612337472	0.95
tpch_q02/duckdb:vortex-compact	1120358864	1073145992	1.04
tpch_q03/duckdb:vortex-compact	828053030	974711852	0.85
tpch_q04/duckdb:vortex-compact	631382530	692410226	0.91
tpch_q05/duckdb:vortex-compact	1172940612	1112329430	1.05
tpch_q06/duckdb:vortex-compact	603469802	566662445	1.06
tpch_q07/duckdb:vortex-compact	1197507044	1324367143	0.90
tpch_q08/duckdb:vortex-compact	1333486494	1602895895	0.83
tpch_q09/duckdb:vortex-compact	1621025804	1619859008	1.00
tpch_q10/duckdb:vortex-compact	1102494675	1128299910	0.98
tpch_q11/duckdb:vortex-compact	636533803	720352560	0.88
tpch_q12/duckdb:vortex-compact	1051219836	1075750863	0.98
tpch_q13/duckdb:vortex-compact	799101944	847701908	0.94
tpch_q14/duckdb:vortex-compact	601646338	653069227	0.92
tpch_q15/duckdb:vortex-compact	534259030	619512632	0.86
tpch_q16/duckdb:vortex-compact	399972101	428188511	0.93
tpch_q17/duckdb:vortex-compact	872425296	891575348	0.98
tpch_q18/duckdb:vortex-compact	842859336	829700593	1.02
tpch_q19/duckdb:vortex-compact	788060520	713884888	1.10
tpch_q20/duckdb:vortex-compact	1178500339	1288119817	0.91
tpch_q21/duckdb:vortex-compact	1722810113	1655209995	1.04
tpch_q22/duckdb:vortex-compact	449507123	409124710	1.10

duckdb / parquet (0.961x ➖, 0↑ 0↓)

name	PR 672a27e (ns)	base 9e5ed2e (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	800564863	963007472	0.83
tpch_q02/duckdb:parquet	1257396180	1470150483	0.86
tpch_q03/duckdb:parquet	1906646927	2158944547	0.88
tpch_q04/duckdb:parquet	1285851882	1548138151	0.83
tpch_q05/duckdb:parquet	2210502127	2196663091	1.01
tpch_q06/duckdb:parquet	1091824628	874759319	1.25
tpch_q07/duckdb:parquet	1843712798	2387488388	0.77
tpch_q08/duckdb:parquet	2434096077	2960693099	0.82
tpch_q09/duckdb:parquet	2763079115	2844491081	0.97
tpch_q10/duckdb:parquet	3125478386	3289722108	0.95
tpch_q11/duckdb:parquet	962210767	977544063	0.98
tpch_q12/duckdb:parquet	1398422675	1263816202	1.11
tpch_q13/duckdb:parquet	1448421812	1318971215	1.10
tpch_q14/duckdb:parquet	1354977133	1382091234	0.98
tpch_q15/duckdb:parquet	1261585873	1107166480	1.14
tpch_q16/duckdb:parquet	858679586	922653867	0.93
tpch_q17/duckdb:parquet	1415563323	1422658046	1.00
tpch_q18/duckdb:parquet	1479657546	1736493269	0.85
tpch_q19/duckdb:parquet	1573152737	1641036714	0.96
tpch_q20/duckdb:parquet	1978147740	1798194265	1.10
tpch_q21/duckdb:parquet	2007353873	2154215877	0.93
tpch_q22/duckdb:parquet	1156304807	1106386591	1.05

Full attributed analysis

Query	Config	Raw Δ	Control Δ	Attributed α	Noise floor	Significant?
1	datafusion:vortex-compact	-10.4%	-5.5%	-5.1%	+48.3%	➖ noise
1	datafusion:vortex-file-compressed	+13.5%	-5.5%	+20.1%	+50.2%	➖ noise
1	duckdb:vortex-compact	-5.1%	-5.5%	+0.4%	+48.3%	➖ noise
1	duckdb:vortex-file-compressed	-6.0%	-5.5%	-0.5%	+48.3%	➖ noise
2	datafusion:vortex-compact	-34.7%	+10.3%	-40.8%	+48.3%	✅ faster
2	datafusion:vortex-file-compressed	+43.5%	+10.3%	+30.1%	+48.3%	➖ noise
2	duckdb:vortex-compact	+4.4%	+10.3%	-5.4%	+48.3%	➖ noise
2	duckdb:vortex-file-compressed	+2.8%	+10.3%	-6.8%	+48.3%	➖ noise
3	datafusion:vortex-compact	-11.8%	-28.5%	+23.3%	+48.3%	➖ noise
3	datafusion:vortex-file-compressed	+12.7%	-28.5%	+57.6%	+48.3%	🚨 regression
3	duckdb:vortex-compact	-15.0%	-28.5%	+18.8%	+48.3%	➖ noise
3	duckdb:vortex-file-compressed	+8.1%	-28.5%	+51.2%	+48.3%	🚨 regression
4	datafusion:vortex-compact	-7.7%	-17.3%	+11.6%	+48.3%	➖ noise
4	datafusion:vortex-file-compressed	+0.9%	-17.3%	+22.1%	+48.3%	➖ noise
4	duckdb:vortex-compact	-8.8%	-17.3%	+10.3%	+48.3%	➖ noise
4	duckdb:vortex-file-compressed	+2.8%	-17.3%	+24.3%	+48.3%	➖ noise
5	datafusion:vortex-compact	-24.9%	-8.4%	-18.0%	+48.3%	➖ noise
5	datafusion:vortex-file-compressed	-2.4%	-8.4%	+6.6%	+48.3%	➖ noise
5	duckdb:vortex-compact	+5.4%	-8.4%	+15.1%	+48.3%	➖ noise
5	duckdb:vortex-file-compressed	+2.5%	-8.4%	+11.8%	+48.3%	➖ noise
6	datafusion:vortex-compact	-8.3%	+33.0%	-31.1%	+48.3%	➖ noise
6	datafusion:vortex-file-compressed	-1.5%	+33.0%	-25.9%	+48.3%	➖ noise
6	duckdb:vortex-compact	+6.5%	+33.0%	-19.9%	+48.3%	➖ noise
6	duckdb:vortex-file-compressed	+2.9%	+33.0%	-22.6%	+48.3%	➖ noise
7	datafusion:vortex-compact	-8.4%	-6.7%	-1.9%	+48.3%	➖ noise
7	datafusion:vortex-file-compressed	-10.8%	-6.7%	-4.4%	+48.3%	➖ noise
7	duckdb:vortex-compact	-9.6%	-6.7%	-3.1%	+48.3%	➖ noise
7	duckdb:vortex-file-compressed	-7.6%	-6.7%	-0.9%	+48.3%	➖ noise
8	datafusion:vortex-compact	-9.5%	-4.4%	-5.3%	+48.3%	➖ noise
8	datafusion:vortex-file-compressed	+33.8%	-4.4%	+40.0%	+48.3%	➖ noise
8	duckdb:vortex-compact	-16.8%	-4.4%	-13.0%	+48.3%	➖ noise
8	duckdb:vortex-file-compressed	-1.3%	-4.4%	+3.2%	+48.3%	➖ noise
9	datafusion:vortex-compact	-5.5%	+5.2%	-10.1%	+48.3%	➖ noise
9	datafusion:vortex-file-compressed	+22.4%	+5.2%	+16.4%	+48.3%	➖ noise
9	duckdb:vortex-compact	+0.1%	+5.2%	-4.9%	+48.3%	➖ noise
9	duckdb:vortex-file-compressed	+2.4%	+5.2%	-2.6%	+48.3%	➖ noise
10	datafusion:vortex-compact	-12.2%	+13.8%	-22.9%	+48.3%	➖ noise
10	datafusion:vortex-file-compressed	-3.6%	+13.8%	-15.3%	+48.3%	➖ noise
10	duckdb:vortex-compact	-2.3%	+13.8%	-14.2%	+48.3%	➖ noise
10	duckdb:vortex-file-compressed	-7.1%	+13.8%	-18.4%	+48.3%	➖ noise
11	datafusion:vortex-compact	+29.2%	+27.2%	+1.6%	+48.3%	➖ noise
11	datafusion:vortex-file-compressed	+53.8%	+27.2%	+20.8%	+48.3%	➖ noise
11	duckdb:vortex-compact	-11.6%	+27.2%	-30.6%	+48.3%	➖ noise
11	duckdb:vortex-file-compressed	+1.1%	+27.2%	-20.6%	+48.3%	➖ noise
12	datafusion:vortex-compact	+4.2%	-0.2%	+4.4%	+48.3%	➖ noise
12	datafusion:vortex-file-compressed	-11.1%	-0.2%	-10.9%	+48.3%	➖ noise
12	duckdb:vortex-compact	-2.3%	-0.2%	-2.1%	+48.3%	➖ noise
12	duckdb:vortex-file-compressed	+1.4%	-0.2%	+1.6%	+48.3%	➖ noise
13	datafusion:vortex-compact	+11.3%	+4.5%	+6.5%	+48.3%	➖ noise
13	datafusion:vortex-file-compressed	-3.0%	+4.5%	-7.2%	+48.3%	➖ noise
13	duckdb:vortex-compact	-5.7%	+4.5%	-9.8%	+48.3%	➖ noise
13	duckdb:vortex-file-compressed	+7.8%	+4.5%	+3.2%	+48.3%	➖ noise
14	datafusion:vortex-compact	-2.1%	+12.7%	-13.1%	+48.3%	➖ noise
14	datafusion:vortex-file-compressed	+23.5%	+12.7%	+9.6%	+48.3%	➖ noise
14	duckdb:vortex-compact	-7.9%	+12.7%	-18.2%	+48.3%	➖ noise
14	duckdb:vortex-file-compressed	+0.3%	+12.7%	-10.9%	+48.3%	➖ noise
15	datafusion:vortex-compact	+1.1%	+14.7%	-11.9%	+48.3%	➖ noise
15	datafusion:vortex-file-compressed	+21.4%	+14.7%	+5.8%	+48.3%	➖ noise
15	duckdb:vortex-compact	-13.8%	+14.7%	-24.8%	+48.3%	➖ noise
15	duckdb:vortex-file-compressed	+5.1%	+14.7%	-8.4%	+48.3%	➖ noise
16	datafusion:vortex-compact	-18.9%	+31.5%	-38.3%	+48.3%	✅ faster
16	datafusion:vortex-file-compressed	-19.4%	+31.5%	-38.7%	+48.3%	✅ faster
16	duckdb:vortex-compact	-6.6%	+31.5%	-29.0%	+48.3%	➖ noise
16	duckdb:vortex-file-compressed	-2.1%	+31.5%	-25.6%	+48.3%	➖ noise
17	datafusion:vortex-compact	-7.8%	+12.0%	-17.7%	+48.3%	➖ noise
17	datafusion:vortex-file-compressed	-19.3%	+12.0%	-27.9%	+48.3%	➖ noise
17	duckdb:vortex-compact	-2.1%	+12.0%	-12.6%	+48.3%	➖ noise
17	duckdb:vortex-file-compressed	+2.6%	+12.0%	-8.4%	+48.3%	➖ noise
18	datafusion:vortex-compact	-15.4%	+11.8%	-24.3%	+48.3%	➖ noise
18	datafusion:vortex-file-compressed	-27.0%	+11.8%	-34.7%	+48.3%	✅ faster
18	duckdb:vortex-compact	+1.6%	+11.8%	-9.1%	+48.3%	➖ noise
18	duckdb:vortex-file-compressed	+1.6%	+11.8%	-9.1%	+48.3%	➖ noise
19	datafusion:vortex-compact	-9.4%	+1.1%	-10.4%	+48.3%	➖ noise
19	datafusion:vortex-file-compressed	-37.4%	+1.1%	-38.0%	+48.3%	✅ faster
19	duckdb:vortex-compact	+10.4%	+1.1%	+9.2%	+48.3%	➖ noise
19	duckdb:vortex-file-compressed	-13.5%	+1.1%	-14.4%	+48.3%	➖ noise
20	datafusion:vortex-compact	+0.9%	+22.8%	-17.9%	+48.3%	➖ noise
20	datafusion:vortex-file-compressed	-38.8%	+22.8%	-50.1%	+48.3%	✅ faster
20	duckdb:vortex-compact	-8.5%	+22.8%	-25.5%	+48.3%	➖ noise
20	duckdb:vortex-file-compressed	+15.0%	+22.8%	-6.4%	+48.3%	➖ noise
21	datafusion:vortex-compact	-2.0%	-12.4%	+11.9%	+48.3%	➖ noise
21	datafusion:vortex-file-compressed	-14.1%	-12.4%	-1.9%	+48.3%	➖ noise
21	duckdb:vortex-compact	+4.1%	-12.4%	+18.8%	+48.3%	➖ noise
21	duckdb:vortex-file-compressed	-19.3%	-12.4%	-7.8%	+48.3%	➖ noise
22	datafusion:vortex-compact	-30.0%	+2.9%	-32.0%	+48.3%	➖ noise
22	datafusion:vortex-file-compressed	-62.8%	+2.9%	-63.9%	+49.3%	✅ faster
22	duckdb:vortex-compact	+9.9%	+2.9%	+6.8%	+48.3%	➖ noise
22	duckdb:vortex-file-compressed	+2.1%	+2.9%	-0.8%	+48.3%	➖ noise

[AdamGS]

most up to date format: #8123 (comment)