Skip to content

alp_rd: speedup#7064

Open
joseph-isaacs wants to merge 7 commits intodevelopfrom
ji/alp-rd-speedup
Open

alp_rd: speedup#7064
joseph-isaacs wants to merge 7 commits intodevelopfrom
ji/alp-rd-speedup

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs commented Mar 19, 2026

Use in-place alp decompression

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs changed the title fix alp_rd: speedup Mar 19, 2026
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Mar 19, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq bot commented Mar 19, 2026

Merging this PR will improve performance by 92.57%

⚡ 1 improved benchmark
✅ 1097 untouched benchmarks
🆕 24 new benchmarks
⏩ 1530 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation alp_rd_decompress_f64 2.3 ms 1.2 ms +92.57%
🆕 Simulation compress_rd[f32, (100000, 0.01)] N/A 3.6 ms N/A
🆕 Simulation compress_rd[f64, (100000, 0.01)] N/A 4.7 ms N/A
🆕 Simulation compress_rd[f64, (100000, 0.1)] N/A 4.7 ms N/A
🆕 Simulation compress_rd[f64, (10000, 0.01)] N/A 491.5 µs N/A
🆕 Simulation compress_rd[f64, (10000, 0.1)] N/A 493 µs N/A
🆕 Simulation compress_rd[f32, (100000, 0.1)] N/A 3.6 ms N/A
🆕 Simulation compress_rd[f32, (100000, 0.0)] N/A 3.6 ms N/A
🆕 Simulation compress_rd[f32, (10000, 0.01)] N/A 381.4 µs N/A
🆕 Simulation compress_rd[f64, (100000, 0.0)] N/A 4.7 ms N/A
🆕 Simulation compress_rd[f64, (10000, 0.0)] N/A 491.5 µs N/A
🆕 Simulation compress_rd[f32, (10000, 0.0)] N/A 382.1 µs N/A
🆕 Simulation compress_rd[f32, (10000, 0.1)] N/A 382.7 µs N/A
🆕 Simulation decompress_rd[f32, (100000, 0.01)] N/A 757.4 µs N/A
🆕 Simulation decompress_rd[f32, (100000, 0.0)] N/A 757.7 µs N/A
🆕 Simulation decompress_rd[f32, (10000, 0.0)] N/A 145.4 µs N/A
🆕 Simulation decompress_rd[f32, (10000, 0.01)] N/A 106.1 µs N/A
🆕 Simulation decompress_rd[f64, (10000, 0.01)] N/A 156.9 µs N/A
🆕 Simulation decompress_rd[f64, (10000, 0.0)] N/A 156.7 µs N/A
🆕 Simulation decompress_rd[f64, (10000, 0.1)] N/A 156.5 µs N/A
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing ji/alp-rd-speedup (7847609) with develop (db00b43)

Open in CodSpeed

Footnotes

  1. 1530 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 19, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 19, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 19, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 7847609 1 Explore Profiling Data
Previous Runs (4)
Status Commit Job Attempt Link
🟢 Done 749712c 1 Explore Profiling Data
🟢 Done f391bbf 2 Explore Profiling Data
🟢 Done f391bbf 1 Explore Profiling Data
🟢 Done d2668cf 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.973x ➖


datafusion / vortex-file-compressed (0.973x ➖, 0↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 129997739 127863302 1.02
polarsignals_q01/datafusion:vortex-file-compressed 370494211 376628934 0.98
polarsignals_q02/datafusion:vortex-file-compressed 22125427 23523655 0.94
polarsignals_q03/datafusion:vortex-file-compressed 382979852 381310765 1.00
polarsignals_q04/datafusion:vortex-file-compressed 11113965 12145588 0.92
polarsignals_q05/datafusion:vortex-file-compressed 15959597 16101974 0.99
polarsignals_q06/datafusion:vortex-file-compressed 19706839 20069216 0.98
polarsignals_q07/datafusion:vortex-file-compressed 13958202 13976931 1.00
polarsignals_q08/datafusion:vortex-file-compressed 470306126 477722201 0.98
polarsignals_q09/datafusion:vortex-file-compressed 10350994 11231319 0.92

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.3%
Vortex (geomean): 0.961x ➖
Parquet (geomean): 0.990x ➖
Shifts: Parquet (control) -1.0% · Median polish -4.0%


datafusion / vortex-file-compressed (0.967x ➖, 2↑ 1↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 49433706 51292523 0.96
tpch_q02/datafusion:vortex-file-compressed 33858172 35157158 0.96
tpch_q03/datafusion:vortex-file-compressed 27028544 28839184 0.94
tpch_q04/datafusion:vortex-file-compressed 18819463 18702041 1.01
tpch_q05/datafusion:vortex-file-compressed 55395075 58220547 0.95
tpch_q06/datafusion:vortex-file-compressed 9977356 10849976 0.92
tpch_q07/datafusion:vortex-file-compressed 63257286 68681485 0.92
tpch_q08/datafusion:vortex-file-compressed 48291488 48509979 1.00
tpch_q09/datafusion:vortex-file-compressed 57791162 58819615 0.98
tpch_q10/datafusion:vortex-file-compressed 46849945 48217118 0.97
tpch_q11/datafusion:vortex-file-compressed 18502530 19124134 0.97
tpch_q12/datafusion:vortex-file-compressed 24985917 24004768 1.04
tpch_q13/datafusion:vortex-file-compressed 28209967 29119407 0.97
tpch_q14/datafusion:vortex-file-compressed 16076854 17385554 0.92
tpch_q15/datafusion:vortex-file-compressed 🚀 23696757 26354260 0.90
tpch_q16/datafusion:vortex-file-compressed 25318347 25787146 0.98
tpch_q17/datafusion:vortex-file-compressed 66452116 66799245 0.99
tpch_q18/datafusion:vortex-file-compressed 80910018 85025901 0.95
tpch_q19/datafusion:vortex-file-compressed 🚨 26862388 23556236 1.14
tpch_q20/datafusion:vortex-file-compressed 33674358 34740411 0.97
tpch_q21/datafusion:vortex-file-compressed 75893934 79395950 0.96
tpch_q22/datafusion:vortex-file-compressed 🚀 16551457 18511379 0.89
datafusion / vortex-compact (0.968x ➖, 0↑ 1↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 60563501 60264887 1.00
tpch_q02/datafusion:vortex-compact 36996432 39022919 0.95
tpch_q03/datafusion:vortex-compact 31353261 32703318 0.96
tpch_q04/datafusion:vortex-compact 23590013 24225313 0.97
tpch_q05/datafusion:vortex-compact 57238256 58782144 0.97
tpch_q06/datafusion:vortex-compact 13494266 13901204 0.97
tpch_q07/datafusion:vortex-compact 69503447 75174476 0.92
tpch_q08/datafusion:vortex-compact 50099707 52986240 0.95
tpch_q09/datafusion:vortex-compact 63870629 64862495 0.98
tpch_q10/datafusion:vortex-compact 53379932 57300799 0.93
tpch_q11/datafusion:vortex-compact 19781398 21259354 0.93
tpch_q12/datafusion:vortex-compact 35298199 35969004 0.98
tpch_q13/datafusion:vortex-compact 36432593 37677061 0.97
tpch_q14/datafusion:vortex-compact 20832606 22077864 0.94
tpch_q15/datafusion:vortex-compact 35180292 35183439 1.00
tpch_q16/datafusion:vortex-compact 30956153 30672114 1.01
tpch_q17/datafusion:vortex-compact 69447699 75819302 0.92
tpch_q18/datafusion:vortex-compact 85027886 91815736 0.93
tpch_q19/datafusion:vortex-compact 🚨 41828855 34394951 1.22
tpch_q20/datafusion:vortex-compact 38492695 41655056 0.92
tpch_q21/datafusion:vortex-compact 88672646 96002425 0.92
tpch_q22/datafusion:vortex-compact 17322685 17841580 0.97
datafusion / parquet (0.978x ➖, 2↑ 1↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 98419132 98071903 1.00
tpch_q02/datafusion:parquet 69482619 73704853 0.94
tpch_q03/datafusion:parquet 79054037 75214462 1.05
tpch_q04/datafusion:parquet 48231188 50462736 0.96
tpch_q05/datafusion:parquet 101566885 108204894 0.94
tpch_q06/datafusion:parquet 39128282 35727731 1.10
tpch_q07/datafusion:parquet 115250335 120424272 0.96
tpch_q08/datafusion:parquet 107450984 99533601 1.08
tpch_q09/datafusion:parquet 141001430 133280853 1.06
tpch_q10/datafusion:parquet 118958670 126776241 0.94
tpch_q11/datafusion:parquet 47144237 51372925 0.92
tpch_q12/datafusion:parquet 🚀 81543759 99844869 0.82
tpch_q13/datafusion:parquet 206521682 229442628 0.90
tpch_q14/datafusion:parquet 46333286 44242154 1.05
tpch_q15/datafusion:parquet 69404077 66737654 1.04
tpch_q16/datafusion:parquet 49502383 52234443 0.95
tpch_q17/datafusion:parquet 148797669 140861215 1.06
tpch_q18/datafusion:parquet 166024627 173302528 0.96
tpch_q19/datafusion:parquet 🚨 91006075 81895430 1.11
tpch_q20/datafusion:parquet 🚀 71853480 80879491 0.89
tpch_q21/datafusion:parquet 146769888 154293767 0.95
tpch_q22/datafusion:parquet 34309825 37274713 0.92
datafusion / arrow (0.941x ➖, 5↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 52422473 67003453 0.78
tpch_q02/datafusion:arrow 21827010 23767687 0.92
tpch_q03/datafusion:arrow 33887476 37187337 0.91
tpch_q04/datafusion:arrow 🚀 27534767 30735546 0.90
tpch_q05/datafusion:arrow 🚀 78374641 88568447 0.88
tpch_q06/datafusion:arrow 🚀 20908673 23378993 0.89
tpch_q07/datafusion:arrow 113086620 117404638 0.96
tpch_q08/datafusion:arrow 46653061 50141943 0.93
tpch_q09/datafusion:arrow 76621629 75187915 1.02
tpch_q10/datafusion:arrow 57277458 55525141 1.03
tpch_q11/datafusion:arrow 11750776 12274044 0.96
tpch_q12/datafusion:arrow 56702104 56824559 1.00
tpch_q13/datafusion:arrow 50043466 51171453 0.98
tpch_q14/datafusion:arrow 23242202 24790489 0.94
tpch_q15/datafusion:arrow 47774626 49777285 0.96
tpch_q16/datafusion:arrow 21723049 21735305 1.00
tpch_q17/datafusion:arrow 74336527 74949872 0.99
tpch_q18/datafusion:arrow 🚀 143088125 166182337 0.86
tpch_q19/datafusion:arrow 40231559 41770131 0.96
tpch_q20/datafusion:arrow 38472951 41908888 0.92
tpch_q21/datafusion:arrow 153459190 160882844 0.95
tpch_q22/datafusion:arrow 20828957 20882639 1.00
duckdb / vortex-file-compressed (0.952x ➖, 3↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33049100 34034157 0.97
tpch_q02/duckdb:vortex-file-compressed 🚀 26414857 29445722 0.90
tpch_q03/duckdb:vortex-file-compressed 30242247 29892646 1.01
tpch_q04/duckdb:vortex-file-compressed 29915895 31241181 0.96
tpch_q05/duckdb:vortex-file-compressed 33702306 34846329 0.97
tpch_q06/duckdb:vortex-file-compressed 🚀 10561193 11744834 0.90
tpch_q07/duckdb:vortex-file-compressed 36632061 39672377 0.92
tpch_q08/duckdb:vortex-file-compressed 41568194 43034004 0.97
tpch_q09/duckdb:vortex-file-compressed 🚀 78551457 89102350 0.88
tpch_q10/duckdb:vortex-file-compressed 37905663 38033049 1.00
tpch_q11/duckdb:vortex-file-compressed 16238154 17038580 0.95
tpch_q12/duckdb:vortex-file-compressed 23944493 23830683 1.00
tpch_q13/duckdb:vortex-file-compressed 37052935 39325670 0.94
tpch_q14/duckdb:vortex-file-compressed 22527907 23232258 0.97
tpch_q15/duckdb:vortex-file-compressed 16156760 16911823 0.96
tpch_q16/duckdb:vortex-file-compressed 28951223 31729749 0.91
tpch_q17/duckdb:vortex-file-compressed 25507579 26215187 0.97
tpch_q18/duckdb:vortex-file-compressed 48655505 49525412 0.98
tpch_q19/duckdb:vortex-file-compressed 32634714 34118274 0.96
tpch_q20/duckdb:vortex-file-compressed 36457675 36289581 1.00
tpch_q21/duckdb:vortex-file-compressed 103323063 111458140 0.93
tpch_q22/duckdb:vortex-file-compressed 18170360 20154774 0.90
duckdb / vortex-compact (0.960x ➖, 0↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 40085692 41393886 0.97
tpch_q02/duckdb:vortex-compact 37860004 40824157 0.93
tpch_q03/duckdb:vortex-compact 33256528 34602989 0.96
tpch_q04/duckdb:vortex-compact 34218218 38016169 0.90
tpch_q05/duckdb:vortex-compact 39111233 39387039 0.99
tpch_q06/duckdb:vortex-compact 15878266 16150926 0.98
tpch_q07/duckdb:vortex-compact 43209389 44969529 0.96
tpch_q08/duckdb:vortex-compact 46128748 47513263 0.97
tpch_q09/duckdb:vortex-compact 91167050 97464699 0.94
tpch_q10/duckdb:vortex-compact 41545063 43337712 0.96
tpch_q11/duckdb:vortex-compact 20699583 22413344 0.92
tpch_q12/duckdb:vortex-compact 37527630 38970214 0.96
tpch_q13/duckdb:vortex-compact 48314748 50114182 0.96
tpch_q14/duckdb:vortex-compact 30757782 31972573 0.96
tpch_q15/duckdb:vortex-compact 19647565 19963488 0.98
tpch_q16/duckdb:vortex-compact 36039045 38499174 0.94
tpch_q17/duckdb:vortex-compact 32844844 32139022 1.02
tpch_q18/duckdb:vortex-compact 51121162 53754010 0.95
tpch_q19/duckdb:vortex-compact 38915268 39617653 0.98
tpch_q20/duckdb:vortex-compact 45228696 46587385 0.97
tpch_q21/duckdb:vortex-compact 113141585 117631418 0.96
tpch_q22/duckdb:vortex-compact 21080538 22419732 0.94
duckdb / parquet (1.002x ➖, 1↑ 3↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 79889471 80402925 0.99
tpch_q02/duckdb:parquet 39261385 41456667 0.95
tpch_q03/duckdb:parquet 69913297 69923586 1.00
tpch_q04/duckdb:parquet 🚨 55298144 48025794 1.15
tpch_q05/duckdb:parquet 74363978 69434372 1.07
tpch_q06/duckdb:parquet 29389975 29810554 0.99
tpch_q07/duckdb:parquet 73531352 70535042 1.04
tpch_q08/duckdb:parquet 80062232 83329698 0.96
tpch_q09/duckdb:parquet 153683532 163620799 0.94
tpch_q10/duckdb:parquet 140747906 131015224 1.07
tpch_q11/duckdb:parquet 22522053 23236908 0.97
tpch_q12/duckdb:parquet 45661952 45382225 1.01
tpch_q13/duckdb:parquet 266632177 284010429 0.94
tpch_q14/duckdb:parquet 49461160 50370966 0.98
tpch_q15/duckdb:parquet 24362091 25728718 0.95
tpch_q16/duckdb:parquet 56740076 56802146 1.00
tpch_q17/duckdb:parquet 52897027 49497054 1.07
tpch_q18/duckdb:parquet 🚨 137978808 121668081 1.13
tpch_q19/duckdb:parquet 🚀 69275369 90845117 0.76
tpch_q20/duckdb:parquet 🚨 81860513 64787799 1.26
tpch_q21/duckdb:parquet 174754168 189542209 0.92
tpch_q22/duckdb:parquet 52343993 53042610 0.99
duckdb / duckdb (0.956x ➖, 4↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16253961 16258861 1.00
tpch_q02/duckdb:duckdb 12435380 12620798 0.99
tpch_q03/duckdb:duckdb 19074143 19515490 0.98
tpch_q04/duckdb:duckdb 19426418 19154106 1.01
tpch_q05/duckdb:duckdb 🚀 20055525 22372587 0.90
tpch_q06/duckdb:duckdb 5273589 5545648 0.95
tpch_q07/duckdb:duckdb 22638917 24662221 0.92
tpch_q08/duckdb:duckdb 🚀 21050819 23903698 0.88
tpch_q09/duckdb:duckdb 52253588 56139104 0.93
tpch_q10/duckdb:duckdb 43693309 43292774 1.01
tpch_q11/duckdb:duckdb 5795479 6237594 0.93
tpch_q12/duckdb:duckdb 14193678 14217233 1.00
tpch_q13/duckdb:duckdb 38598293 38276112 1.01
tpch_q14/duckdb:duckdb 🚀 15989275 18007779 0.89
tpch_q15/duckdb:duckdb 11680541 12184240 0.96
tpch_q16/duckdb:duckdb 🚀 22882592 25939289 0.88
tpch_q17/duckdb:duckdb 13435791 13879364 0.97
tpch_q18/duckdb:duckdb 39464956 38551330 1.02
tpch_q19/duckdb:duckdb 27849417 30137488 0.92
tpch_q20/duckdb:duckdb 23383735 24113531 0.97
tpch_q21/duckdb:duckdb 56472721 58859098 0.96
tpch_q22/duckdb:duckdb 24778267 25147397 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -21.8% -0.1% -21.6% +30.3% ➖ noise
1 datafusion:vortex-compact +0.5% -0.1% +0.6% +25.8% ➖ noise
1 datafusion:vortex-file-compressed -3.6% -0.1% -3.5% +24.9% ➖ noise
1 duckdb:duckdb -0.0% -0.1% +0.1% +24.1% ➖ noise
1 duckdb:vortex-compact -3.2% -0.1% -3.0% +23.2% ➖ noise
1 duckdb:vortex-file-compressed -2.9% -0.1% -2.8% +24.0% ➖ noise
2 datafusion:arrow -8.2% -5.5% -2.8% +13.3% ➖ noise
2 datafusion:vortex-compact -5.2% -5.5% +0.3% +13.3% ➖ noise
2 datafusion:vortex-file-compressed -3.7% -5.5% +1.9% +13.3% ➖ noise
2 duckdb:duckdb -1.5% -5.5% +4.3% +15.5% ➖ noise
2 duckdb:vortex-compact -7.3% -5.5% -1.9% +13.3% ➖ noise
2 duckdb:vortex-file-compressed -10.3% -5.5% -5.1% +13.3% ➖ noise
3 datafusion:arrow -8.9% +2.5% -11.1% +13.3% ➖ noise
3 datafusion:vortex-compact -4.1% +2.5% -6.5% +13.3% ➖ noise
3 datafusion:vortex-file-compressed -6.3% +2.5% -8.6% +13.3% ➖ noise
3 duckdb:duckdb -2.3% +2.5% -4.7% +21.0% ➖ noise
3 duckdb:vortex-compact -3.9% +2.5% -6.2% +14.5% ➖ noise
3 duckdb:vortex-file-compressed +1.2% +2.5% -1.3% +14.1% ➖ noise
4 datafusion:arrow -10.4% +4.9% -14.6% +13.3% ✅ faster
4 datafusion:vortex-compact -2.6% +4.9% -7.2% +13.3% ➖ noise
4 datafusion:vortex-file-compressed +0.6% +4.9% -4.1% +13.3% ➖ noise
4 duckdb:duckdb +1.4% +4.9% -3.3% +13.4% ➖ noise
4 duckdb:vortex-compact -10.0% +4.9% -14.2% +14.7% ✅ faster
4 duckdb:vortex-file-compressed -4.2% +4.9% -8.7% +13.3% ➖ noise
5 datafusion:arrow -11.5% +0.3% -11.7% +13.3% ✅ faster
5 datafusion:vortex-compact -2.6% +0.3% -2.9% +13.3% ➖ noise
5 datafusion:vortex-file-compressed -4.9% +0.3% -5.1% +13.3% ➖ noise
5 duckdb:duckdb -10.4% +0.3% -10.6% +15.2% ➖ noise
5 duckdb:vortex-compact -0.7% +0.3% -1.0% +13.3% ➖ noise
5 duckdb:vortex-file-compressed -3.3% +0.3% -3.5% +13.3% ➖ noise
6 datafusion:arrow -10.6% +3.9% -13.9% +23.0% ➖ noise
6 datafusion:vortex-compact -2.9% +3.9% -6.6% +23.1% ➖ noise
6 datafusion:vortex-file-compressed -8.0% +3.9% -11.5% +23.7% ➖ noise
6 duckdb:duckdb -4.9% +3.9% -8.5% +25.7% ➖ noise
6 duckdb:vortex-compact -1.7% +3.9% -5.4% +24.5% ➖ noise
6 duckdb:vortex-file-compressed -10.1% +3.9% -13.5% +24.0% ➖ noise
7 datafusion:arrow -3.7% -0.1% -3.6% +13.3% ➖ noise
7 datafusion:vortex-compact -7.5% -0.1% -7.4% +13.3% ➖ noise
7 datafusion:vortex-file-compressed -7.9% -0.1% -7.8% +13.3% ➖ noise
7 duckdb:duckdb -8.2% -0.1% -8.1% +13.3% ➖ noise
7 duckdb:vortex-compact -3.9% -0.1% -3.8% +13.3% ➖ noise
7 duckdb:vortex-file-compressed -7.7% -0.1% -7.6% +13.3% ➖ noise
8 datafusion:arrow -7.0% +1.8% -8.6% +13.3% ➖ noise
8 datafusion:vortex-compact -5.4% +1.8% -7.2% +13.3% ➖ noise
8 datafusion:vortex-file-compressed -0.5% +1.8% -2.3% +13.3% ➖ noise
8 duckdb:duckdb -11.9% +1.8% -13.5% +13.9% ✅ faster
8 duckdb:vortex-compact -2.9% +1.8% -4.7% +13.3% ➖ noise
8 duckdb:vortex-file-compressed -3.4% +1.8% -5.2% +13.3% ➖ noise
9 datafusion:arrow +1.9% -0.3% +2.2% +13.3% ➖ noise
9 datafusion:vortex-compact -1.5% -0.3% -1.2% +13.3% ➖ noise
9 datafusion:vortex-file-compressed -1.7% -0.3% -1.4% +13.3% ➖ noise
9 duckdb:duckdb -6.9% -0.3% -6.6% +13.3% ➖ noise
9 duckdb:vortex-compact -6.5% -0.3% -6.2% +13.3% ➖ noise
9 duckdb:vortex-file-compressed -11.8% -0.3% -11.6% +13.3% ➖ noise
10 datafusion:arrow +3.2% +0.4% +2.7% +13.3% ➖ noise
10 datafusion:vortex-compact -6.8% +0.4% -7.2% +13.3% ➖ noise
10 datafusion:vortex-file-compressed -2.8% +0.4% -3.2% +13.3% ➖ noise
10 duckdb:duckdb +0.9% +0.4% +0.5% +16.8% ➖ noise
10 duckdb:vortex-compact -4.1% +0.4% -4.5% +13.3% ➖ noise
10 duckdb:vortex-file-compressed -0.3% +0.4% -0.7% +13.3% ➖ noise
11 datafusion:arrow -4.3% -5.7% +1.5% +15.1% ➖ noise
11 datafusion:vortex-compact -7.0% -5.7% -1.3% +13.3% ➖ noise
11 datafusion:vortex-file-compressed -3.3% -5.7% +2.6% +13.3% ➖ noise
11 duckdb:duckdb -7.1% -5.7% -1.5% +13.3% ➖ noise
11 duckdb:vortex-compact -7.6% -5.7% -2.1% +13.3% ➖ noise
11 duckdb:vortex-file-compressed -4.7% -5.7% +1.1% +13.3% ➖ noise
12 datafusion:arrow -0.2% -9.4% +10.1% +18.8% ➖ noise
12 datafusion:vortex-compact -1.9% -9.4% +8.3% +15.3% ➖ noise
12 datafusion:vortex-file-compressed +4.1% -9.4% +14.8% +15.3% ➖ noise
12 duckdb:duckdb -0.2% -9.4% +10.1% +21.4% ➖ noise
12 duckdb:vortex-compact -3.7% -9.4% +6.2% +15.1% ➖ noise
12 duckdb:vortex-file-compressed +0.5% -9.4% +10.8% +14.2% ➖ noise
13 datafusion:arrow -2.2% -8.1% +6.4% +13.3% ➖ noise
13 datafusion:vortex-compact -3.3% -8.1% +5.2% +13.3% ➖ noise
13 datafusion:vortex-file-compressed -3.1% -8.1% +5.4% +13.3% ➖ noise
13 duckdb:duckdb +0.8% -8.1% +9.7% +13.3% ➖ noise
13 duckdb:vortex-compact -3.6% -8.1% +4.9% +13.3% ➖ noise
13 duckdb:vortex-file-compressed -5.8% -8.1% +2.5% +13.3% ➖ noise
14 datafusion:arrow -6.2% +1.4% -7.5% +17.9% ➖ noise
14 datafusion:vortex-compact -5.6% +1.4% -7.0% +14.2% ➖ noise
14 datafusion:vortex-file-compressed -7.5% +1.4% -8.8% +17.3% ➖ noise
14 duckdb:duckdb -11.2% +1.4% -12.4% +19.4% ➖ noise
14 duckdb:vortex-compact -3.8% +1.4% -5.1% +15.8% ➖ noise
14 duckdb:vortex-file-compressed -3.0% +1.4% -4.4% +16.1% ➖ noise
15 datafusion:arrow -4.0% -0.8% -3.3% +19.3% ➖ noise
15 datafusion:vortex-compact -0.0% -0.8% +0.8% +18.8% ➖ noise
15 datafusion:vortex-file-compressed -10.1% -0.8% -9.4% +20.7% ➖ noise
15 duckdb:duckdb -4.1% -0.8% -3.4% +21.8% ➖ noise
15 duckdb:vortex-compact -1.6% -0.8% -0.8% +23.0% ➖ noise
15 duckdb:vortex-file-compressed -4.5% -0.8% -3.7% +19.1% ➖ noise
16 datafusion:arrow -0.1% -2.7% +2.7% +13.3% ➖ noise
16 datafusion:vortex-compact +0.9% -2.7% +3.7% +13.3% ➖ noise
16 datafusion:vortex-file-compressed -1.8% -2.7% +0.9% +13.3% ➖ noise
16 duckdb:duckdb -11.8% -2.7% -9.3% +17.4% ➖ noise
16 duckdb:vortex-compact -6.4% -2.7% -3.8% +13.3% ➖ noise
16 duckdb:vortex-file-compressed -8.8% -2.7% -6.2% +13.3% ➖ noise
17 datafusion:arrow -0.8% +6.2% -6.7% +13.6% ➖ noise
17 datafusion:vortex-compact -8.4% +6.2% -13.8% +13.9% ✅ faster
17 datafusion:vortex-file-compressed -0.5% +6.2% -6.4% +16.7% ➖ noise
17 duckdb:duckdb -3.2% +6.2% -8.9% +14.9% ➖ noise
17 duckdb:vortex-compact +2.2% +6.2% -3.8% +15.7% ➖ noise
17 duckdb:vortex-file-compressed -2.7% +6.2% -8.4% +16.7% ➖ noise
18 datafusion:arrow -13.9% +4.2% -17.4% +13.3% ✅ faster
18 datafusion:vortex-compact -7.4% +4.2% -11.2% +13.3% ➖ noise
18 datafusion:vortex-file-compressed -4.8% +4.2% -8.7% +13.3% ➖ noise
18 duckdb:duckdb +2.4% +4.2% -1.8% +13.3% ➖ noise
18 duckdb:vortex-compact -4.9% +4.2% -8.8% +13.3% ➖ noise
18 duckdb:vortex-file-compressed -1.8% +4.2% -5.7% +14.9% ➖ noise
19 datafusion:arrow -3.7% -7.9% +4.6% +19.0% ➖ noise
19 datafusion:vortex-compact +21.6% -7.9% +32.1% +15.3% 🚨 regression
19 datafusion:vortex-file-compressed +14.0% -7.9% +23.9% +15.0% 🚨 regression
19 duckdb:duckdb -7.6% -7.9% +0.4% +15.4% ➖ noise
19 duckdb:vortex-compact -1.8% -7.9% +6.7% +14.2% ➖ noise
19 duckdb:vortex-file-compressed -4.3% -7.9% +3.9% +19.7% ➖ noise
20 datafusion:arrow -8.2% +5.9% -13.4% +13.3% ✅ faster
20 datafusion:vortex-compact -7.6% +5.9% -12.8% +13.3% ✅ faster
20 datafusion:vortex-file-compressed -3.1% +5.9% -8.5% +13.8% ➖ noise
20 duckdb:duckdb -3.0% +5.9% -8.5% +14.6% ➖ noise
20 duckdb:vortex-compact -2.9% +5.9% -8.4% +17.5% ➖ noise
20 duckdb:vortex-file-compressed +0.5% +5.9% -5.2% +20.3% ➖ noise
21 datafusion:arrow -4.6% -6.4% +1.9% +13.3% ➖ noise
21 datafusion:vortex-compact -7.6% -6.4% -1.4% +13.3% ➖ noise
21 datafusion:vortex-file-compressed -4.4% -6.4% +2.1% +13.3% ➖ noise
21 duckdb:duckdb -4.1% -6.4% +2.5% +13.3% ➖ noise
21 duckdb:vortex-compact -3.8% -6.4% +2.7% +13.3% ➖ noise
21 duckdb:vortex-file-compressed -7.3% -6.4% -1.0% +13.3% ➖ noise
22 datafusion:arrow -0.3% -4.7% +4.7% +13.3% ➖ noise
22 datafusion:vortex-compact -2.9% -4.7% +1.9% +16.7% ➖ noise
22 datafusion:vortex-file-compressed -10.6% -4.7% -6.2% +13.3% ➖ noise
22 duckdb:duckdb -1.5% -4.7% +3.4% +13.3% ➖ noise
22 duckdb:vortex-compact -6.0% -4.7% -1.3% +13.3% ➖ noise
22 duckdb:vortex-file-compressed -9.8% -4.7% -5.4% +13.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Vortex (geomean): 0.985x ➖
Parquet (geomean): 0.994x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.4%


datafusion / vortex-file-compressed (0.967x ➖, 1↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 4934638 5265549 0.94
fineweb_q01/datafusion:vortex-file-compressed 29073094 28116594 1.03
fineweb_q02/datafusion:vortex-file-compressed 31634671 29759959 1.06
fineweb_q03/datafusion:vortex-file-compressed 90258743 83255747 1.08
fineweb_q04/datafusion:vortex-file-compressed 248646743 272075064 0.91
fineweb_q05/datafusion:vortex-file-compressed 223711182 231696710 0.97
fineweb_q06/datafusion:vortex-file-compressed 🚀 64977513 74435295 0.87
fineweb_q07/datafusion:vortex-file-compressed 68089222 74098224 0.92
fineweb_q08/datafusion:vortex-file-compressed 24056265 25647149 0.94
datafusion / vortex-compact (1.003x ➖, 0↑ 1↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 5568575 4983887 1.12
fineweb_q01/datafusion:vortex-compact 162718096 163535662 1.00
fineweb_q02/datafusion:vortex-compact 165458862 164478736 1.01
fineweb_q03/datafusion:vortex-compact 1437948073 1447721519 0.99
fineweb_q04/datafusion:vortex-compact 1560933859 1571519450 0.99
fineweb_q05/datafusion:vortex-compact 1238005112 1259757533 0.98
fineweb_q06/datafusion:vortex-compact 691535252 702355552 0.98
fineweb_q07/datafusion:vortex-compact 735228055 737814631 1.00
fineweb_q08/datafusion:vortex-compact 21894749 22721311 0.96
datafusion / parquet (0.988x ➖, 0↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6280506 6537770 0.96
fineweb_q01/datafusion:parquet 267473808 272009596 0.98
fineweb_q02/datafusion:parquet 268025324 275573962 0.97
fineweb_q03/datafusion:parquet 270524955 270476799 1.00
fineweb_q04/datafusion:parquet 284161407 281146355 1.01
fineweb_q05/datafusion:parquet 280011589 279895029 1.00
fineweb_q06/datafusion:parquet 271852539 279531370 0.97
fineweb_q07/datafusion:parquet 266880845 268335210 0.99
fineweb_q08/datafusion:parquet 264822461 265780224 1.00
duckdb / vortex-file-compressed (0.972x ➖, 1↑ 1↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3405600 3255763 1.05
fineweb_q01/duckdb:vortex-file-compressed 🚀 30676705 37538920 0.82
fineweb_q02/duckdb:vortex-file-compressed 26524865 27916120 0.95
fineweb_q03/duckdb:vortex-file-compressed 🚨 155089982 140050196 1.11
fineweb_q04/duckdb:vortex-file-compressed 229739991 235982250 0.97
fineweb_q05/duckdb:vortex-file-compressed 214090675 212530695 1.01
fineweb_q06/duckdb:vortex-file-compressed 64462104 69707038 0.92
fineweb_q07/duckdb:vortex-file-compressed 65628611 66431363 0.99
fineweb_q08/duckdb:vortex-file-compressed 25010762 26032448 0.96
duckdb / vortex-compact (0.998x ➖, 0↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4034737 3984302 1.01
fineweb_q01/duckdb:vortex-compact 111900298 116398436 0.96
fineweb_q02/duckdb:vortex-compact 111258103 108946325 1.02
fineweb_q03/duckdb:vortex-compact 868411774 851814244 1.02
fineweb_q04/duckdb:vortex-compact 909041866 906833952 1.00
fineweb_q05/duckdb:vortex-compact 813177271 811244815 1.00
fineweb_q06/duckdb:vortex-compact 469113216 469929493 1.00
fineweb_q07/duckdb:vortex-compact 474897938 476238910 1.00
fineweb_q08/duckdb:vortex-compact 21633512 22320292 0.97
duckdb / parquet (1.000x ➖, 0↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 36558752 36196080 1.01
fineweb_q01/duckdb:parquet 90989471 93117829 0.98
fineweb_q02/duckdb:parquet 95055993 95186975 1.00
fineweb_q03/duckdb:parquet 306734098 307103299 1.00
fineweb_q04/duckdb:parquet 438752913 437244894 1.00
fineweb_q05/duckdb:parquet 408880333 408549812 1.00
fineweb_q06/duckdb:parquet 196140052 196699089 1.00
fineweb_q07/duckdb:parquet 208018413 207376554 1.00
fineweb_q08/duckdb:parquet 57537704 56783981 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +11.7% -1.5% +13.4% +42.7% ➖ noise
0 datafusion:vortex-file-compressed -6.3% -1.5% -4.9% +78.4% ➖ noise
0 duckdb:vortex-compact +1.3% -1.5% +2.8% +37.0% ➖ noise
0 duckdb:vortex-file-compressed +4.6% -1.5% +6.2% +49.3% ➖ noise
1 datafusion:vortex-compact -0.5% -2.0% +1.5% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +3.4% -2.0% +5.5% +16.5% ➖ noise
1 duckdb:vortex-compact -3.9% -2.0% -1.9% +20.8% ➖ noise
1 duckdb:vortex-file-compressed -18.3% -2.0% -16.6% +30.2% ➖ noise
2 datafusion:vortex-compact +0.6% -1.4% +2.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +6.3% -1.4% +7.9% +14.3% ➖ noise
2 duckdb:vortex-compact +2.1% -1.4% +3.6% +16.0% ➖ noise
2 duckdb:vortex-file-compressed -5.0% -1.4% -3.6% +14.4% ➖ noise
3 datafusion:vortex-compact -0.7% -0.1% -0.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +8.4% -0.1% +8.5% +20.4% ➖ noise
3 duckdb:vortex-compact +1.9% -0.1% +2.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +10.7% -0.1% +10.8% +25.7% ➖ noise
4 datafusion:vortex-compact -0.7% +0.7% -1.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -8.6% +0.7% -9.3% +10.0% ✅ faster
4 duckdb:vortex-compact +0.2% +0.7% -0.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.6% +0.7% -3.3% +10.0% ➖ noise
5 datafusion:vortex-compact -1.7% +0.1% -1.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -3.4% +0.1% -3.5% +10.0% ➖ noise
5 duckdb:vortex-compact +0.2% +0.1% +0.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.7% +0.1% +0.7% +10.0% ➖ noise
6 datafusion:vortex-compact -1.5% -1.5% -0.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -12.7% -1.5% -11.4% +14.4% ➖ noise
6 duckdb:vortex-compact -0.2% -1.5% +1.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -7.5% -1.5% -6.1% +10.0% ➖ noise
7 datafusion:vortex-compact -0.4% -0.1% -0.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -8.1% -0.1% -8.0% +17.8% ➖ noise
7 duckdb:vortex-compact -0.3% -0.1% -0.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.2% -0.1% -1.1% +10.6% ➖ noise
8 datafusion:vortex-compact -3.6% +0.5% -4.1% +23.3% ➖ noise
8 datafusion:vortex-file-compressed -6.2% +0.5% -6.7% +29.6% ➖ noise
8 duckdb:vortex-compact -3.1% +0.5% -3.5% +19.7% ➖ noise
8 duckdb:vortex-file-compressed -3.9% +0.5% -4.4% +15.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.4%
Vortex (geomean): 0.905x ➖
Parquet (geomean): 0.937x ➖
Shifts: Parquet (control) -6.3% · Median polish -8.4%


datafusion / vortex-file-compressed (0.901x ➖, 51↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 28487346 30174792 0.94
tpcds_q02/datafusion:vortex-file-compressed 53895190 59763280 0.90
tpcds_q03/datafusion:vortex-file-compressed 21331753 23490618 0.91
tpcds_q04/datafusion:vortex-file-compressed 🚀 294049601 342616153 0.86
tpcds_q05/datafusion:vortex-file-compressed 59368368 61170725 0.97
tpcds_q06/datafusion:vortex-file-compressed 🚀 52865362 60307117 0.88
tpcds_q07/datafusion:vortex-file-compressed 52327355 56814172 0.92
tpcds_q08/datafusion:vortex-file-compressed 38800675 41559743 0.93
tpcds_q09/datafusion:vortex-file-compressed 🚀 56056122 64196097 0.87
tpcds_q10/datafusion:vortex-file-compressed 47986232 52376955 0.92
tpcds_q11/datafusion:vortex-file-compressed 177331492 195798213 0.91
tpcds_q12/datafusion:vortex-file-compressed 🚀 23667084 27818836 0.85
tpcds_q13/datafusion:vortex-file-compressed 66440222 68240487 0.97
tpcds_q14/datafusion:vortex-file-compressed 209050236 226345483 0.92
tpcds_q15/datafusion:vortex-file-compressed 38289117 38990415 0.98
tpcds_q16/datafusion:vortex-file-compressed 🚀 30735117 34185518 0.90
tpcds_q17/datafusion:vortex-file-compressed 🚀 68779957 77814562 0.88
tpcds_q18/datafusion:vortex-file-compressed 81793203 88809243 0.92
tpcds_q19/datafusion:vortex-file-compressed 🚀 31297330 35428420 0.88
tpcds_q20/datafusion:vortex-file-compressed 🚀 25724998 29845416 0.86
tpcds_q21/datafusion:vortex-file-compressed 🚀 136485813 155725395 0.88
tpcds_q22/datafusion:vortex-file-compressed 59516821 65498255 0.91
tpcds_q23/datafusion:vortex-file-compressed 🚀 149980244 170006341 0.88
tpcds_q24/datafusion:vortex-file-compressed 🚀 114538973 127413262 0.90
tpcds_q25/datafusion:vortex-file-compressed 🚀 68244413 77494327 0.88
tpcds_q26/datafusion:vortex-file-compressed 38547218 42433767 0.91
tpcds_q27/datafusion:vortex-file-compressed 124462696 136315991 0.91
tpcds_q28/datafusion:vortex-file-compressed 🚀 49874982 57249776 0.87
tpcds_q29/datafusion:vortex-file-compressed 72522619 78015765 0.93
tpcds_q30/datafusion:vortex-file-compressed 34886042 34371037 1.01
tpcds_q31/datafusion:vortex-file-compressed 106058190 110630444 0.96
tpcds_q32/datafusion:vortex-file-compressed 25111417 23226425 1.08
tpcds_q33/datafusion:vortex-file-compressed 43132696 43532905 0.99
tpcds_q34/datafusion:vortex-file-compressed 36512118 36722411 0.99
tpcds_q35/datafusion:vortex-file-compressed 58417393 61679259 0.95
tpcds_q36/datafusion:vortex-file-compressed 🚀 76128224 88107526 0.86
tpcds_q37/datafusion:vortex-file-compressed 🚀 35366484 41112565 0.86
tpcds_q38/datafusion:vortex-file-compressed 55514150 61283199 0.91
tpcds_q39/datafusion:vortex-file-compressed 🚀 151422691 171709359 0.88
tpcds_q40/datafusion:vortex-file-compressed 🚀 53158124 61632290 0.86
tpcds_q41/datafusion:vortex-file-compressed 20425932 21728001 0.94
tpcds_q42/datafusion:vortex-file-compressed 19240542 21205073 0.91
tpcds_q43/datafusion:vortex-file-compressed 33850461 36740532 0.92
tpcds_q44/datafusion:vortex-file-compressed 48096006 51601039 0.93
tpcds_q45/datafusion:vortex-file-compressed 35238100 38044238 0.93
tpcds_q46/datafusion:vortex-file-compressed 51841624 56107677 0.92
tpcds_q47/datafusion:vortex-file-compressed 217231354 235075671 0.92
tpcds_q48/datafusion:vortex-file-compressed 🚀 51010374 56890067 0.90
tpcds_q49/datafusion:vortex-file-compressed 🚀 70020329 81054040 0.86
tpcds_q50/datafusion:vortex-file-compressed 🚀 46266761 53793394 0.86
tpcds_q51/datafusion:vortex-file-compressed 🚀 89529205 103150902 0.87
tpcds_q52/datafusion:vortex-file-compressed 🚀 19671482 22180496 0.89
tpcds_q53/datafusion:vortex-file-compressed 🚀 26303439 32150312 0.82
tpcds_q54/datafusion:vortex-file-compressed 46330498 50133471 0.92
tpcds_q55/datafusion:vortex-file-compressed 🚀 19114869 21605582 0.88
tpcds_q56/datafusion:vortex-file-compressed 🚀 41409324 47517391 0.87
tpcds_q57/datafusion:vortex-file-compressed 130519352 142592039 0.92
tpcds_q58/datafusion:vortex-file-compressed 70750711 78531059 0.90
tpcds_q59/datafusion:vortex-file-compressed 🚀 72385085 87196678 0.83
tpcds_q60/datafusion:vortex-file-compressed 🚀 42016437 49198519 0.85
tpcds_q61/datafusion:vortex-file-compressed 52671321 57475175 0.92
tpcds_q62/datafusion:vortex-file-compressed 🚀 32250801 36395062 0.89
tpcds_q63/datafusion:vortex-file-compressed 🚀 26824328 30817639 0.87
tpcds_q64/datafusion:vortex-file-compressed 🚀 468462007 532577798 0.88
tpcds_q65/datafusion:vortex-file-compressed 🚀 48789107 57584551 0.85
tpcds_q66/datafusion:vortex-file-compressed 🚀 89967243 102583785 0.88
tpcds_q67/datafusion:vortex-file-compressed 🚀 114611870 132243604 0.87
tpcds_q68/datafusion:vortex-file-compressed 🚀 47862955 53581779 0.89
tpcds_q69/datafusion:vortex-file-compressed 🚀 46027577 51244394 0.90
tpcds_q70/datafusion:vortex-file-compressed 112896232 125195421 0.90
tpcds_q71/datafusion:vortex-file-compressed 35888973 36419663 0.99
tpcds_q72/datafusion:vortex-file-compressed 🚀 2643306168 3114865354 0.85
tpcds_q73/datafusion:vortex-file-compressed 38462372 39960437 0.96
tpcds_q74/datafusion:vortex-file-compressed 🚀 120849868 139669213 0.87
tpcds_q75/datafusion:vortex-file-compressed 🚀 121514696 136741841 0.89
tpcds_q76/datafusion:vortex-file-compressed 38631640 41433893 0.93
tpcds_q77/datafusion:vortex-file-compressed 🚀 51986041 59697225 0.87
tpcds_q78/datafusion:vortex-file-compressed 🚀 126679132 150541549 0.84
tpcds_q79/datafusion:vortex-file-compressed 🚀 40545897 46665701 0.87
tpcds_q80/datafusion:vortex-file-compressed 🚀 114070138 126892951 0.90
tpcds_q81/datafusion:vortex-file-compressed 37492352 40213305 0.93
tpcds_q82/datafusion:vortex-file-compressed 36375343 39738341 0.92
tpcds_q83/datafusion:vortex-file-compressed 50662556 55966619 0.91
tpcds_q84/datafusion:vortex-file-compressed 🚀 15339959 18052751 0.85
tpcds_q85/datafusion:vortex-file-compressed 103414255 111020488 0.93
tpcds_q86/datafusion:vortex-file-compressed 20010004 20687604 0.97
tpcds_q87/datafusion:vortex-file-compressed 55675153 60835749 0.92
tpcds_q88/datafusion:vortex-file-compressed 🚀 82897299 94035128 0.88
tpcds_q89/datafusion:vortex-file-compressed 🚀 37110889 43762597 0.85
tpcds_q90/datafusion:vortex-file-compressed 18968955 20762008 0.91
tpcds_q91/datafusion:vortex-file-compressed 🚀 25978878 29288203 0.89
tpcds_q92/datafusion:vortex-file-compressed 19293432 20540415 0.94
tpcds_q93/datafusion:vortex-file-compressed 🚀 34691318 39727745 0.87
tpcds_q94/datafusion:vortex-file-compressed 25298557 27747823 0.91
tpcds_q95/datafusion:vortex-file-compressed 61933249 66000197 0.94
tpcds_q96/datafusion:vortex-file-compressed 🚀 18462281 20626043 0.90
tpcds_q97/datafusion:vortex-file-compressed 🚀 32031657 36777984 0.87
tpcds_q98/datafusion:vortex-file-compressed 🚀 32368802 40038457 0.81
tpcds_q99/datafusion:vortex-file-compressed 🚀 44905364 54328806 0.83
datafusion / vortex-compact (0.913x ➖, 35↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚀 36494076 41005890 0.89
tpcds_q02/datafusion:vortex-compact 🚀 58924607 65553795 0.90
tpcds_q03/datafusion:vortex-compact 🚀 25662813 29629773 0.87
tpcds_q04/datafusion:vortex-compact 🚀 328122487 386905932 0.85
tpcds_q05/datafusion:vortex-compact 🚀 64485632 77176176 0.84
tpcds_q06/datafusion:vortex-compact 🚀 55463007 66245609 0.84
tpcds_q07/datafusion:vortex-compact 🚀 65036357 77364873 0.84
tpcds_q08/datafusion:vortex-compact 46203716 48588734 0.95
tpcds_q09/datafusion:vortex-compact 🚀 103338511 117642378 0.88
tpcds_q10/datafusion:vortex-compact 65234333 71433210 0.91
tpcds_q11/datafusion:vortex-compact 🚀 188382326 215204591 0.88
tpcds_q12/datafusion:vortex-compact 🚀 25179331 28543933 0.88
tpcds_q13/datafusion:vortex-compact 128123212 137658375 0.93
tpcds_q14/datafusion:vortex-compact 🚀 254731699 286559195 0.89
tpcds_q15/datafusion:vortex-compact 🚀 38389246 44940336 0.85
tpcds_q16/datafusion:vortex-compact 40403499 42984675 0.94
tpcds_q17/datafusion:vortex-compact 95374516 105786140 0.90
tpcds_q18/datafusion:vortex-compact 🚀 94221074 106826255 0.88
tpcds_q19/datafusion:vortex-compact 43466617 47511614 0.91
tpcds_q20/datafusion:vortex-compact 30391566 33696491 0.90
tpcds_q21/datafusion:vortex-compact 149147864 157927353 0.94
tpcds_q22/datafusion:vortex-compact 🚀 66048600 74383236 0.89
tpcds_q23/datafusion:vortex-compact 🚀 188997623 215466920 0.88
tpcds_q24/datafusion:vortex-compact 146545274 159817585 0.92
tpcds_q25/datafusion:vortex-compact 97620378 106693613 0.91
tpcds_q26/datafusion:vortex-compact 🚀 50646186 56717594 0.89
tpcds_q27/datafusion:vortex-compact 170210993 180556964 0.94
tpcds_q28/datafusion:vortex-compact 108087211 111468508 0.97
tpcds_q29/datafusion:vortex-compact 103593908 107881164 0.96
tpcds_q30/datafusion:vortex-compact 38638308 39578444 0.98
tpcds_q31/datafusion:vortex-compact 135348889 139757723 0.97
tpcds_q32/datafusion:vortex-compact 29517102 30717549 0.96
tpcds_q33/datafusion:vortex-compact 57508072 56555824 1.02
tpcds_q34/datafusion:vortex-compact 51416317 53658750 0.96
tpcds_q35/datafusion:vortex-compact 72107029 78192940 0.92
tpcds_q36/datafusion:vortex-compact 100989501 111699530 0.90
tpcds_q37/datafusion:vortex-compact 50449756 55342860 0.91
tpcds_q38/datafusion:vortex-compact 67928434 75112484 0.90
tpcds_q39/datafusion:vortex-compact 155851446 170452877 0.91
tpcds_q40/datafusion:vortex-compact 60159679 65817728 0.91
tpcds_q41/datafusion:vortex-compact 21940941 23134588 0.95
tpcds_q42/datafusion:vortex-compact 24836117 26987852 0.92
tpcds_q43/datafusion:vortex-compact 39189728 42171730 0.93
tpcds_q44/datafusion:vortex-compact 78013091 84442462 0.92
tpcds_q45/datafusion:vortex-compact 38335466 42221376 0.91
tpcds_q46/datafusion:vortex-compact 70590881 75174731 0.94
tpcds_q47/datafusion:vortex-compact 🚀 231433224 265563630 0.87
tpcds_q48/datafusion:vortex-compact 102240563 105378959 0.97
tpcds_q49/datafusion:vortex-compact 100823599 107774391 0.94
tpcds_q50/datafusion:vortex-compact 66417774 71427207 0.93
tpcds_q51/datafusion:vortex-compact 97468675 106154017 0.92
tpcds_q52/datafusion:vortex-compact 26196374 28801170 0.91
tpcds_q53/datafusion:vortex-compact 🚀 34589022 38650295 0.89
tpcds_q54/datafusion:vortex-compact 58641361 63441398 0.92
tpcds_q55/datafusion:vortex-compact 24393640 25973254 0.94
tpcds_q56/datafusion:vortex-compact 55462850 57381937 0.97
tpcds_q57/datafusion:vortex-compact 139391717 152607158 0.91
tpcds_q58/datafusion:vortex-compact 82989687 87133442 0.95
tpcds_q59/datafusion:vortex-compact 92944681 97038294 0.96
tpcds_q60/datafusion:vortex-compact 61478286 61162494 1.01
tpcds_q61/datafusion:vortex-compact 77616921 79085488 0.98
tpcds_q62/datafusion:vortex-compact 34220719 35949756 0.95
tpcds_q63/datafusion:vortex-compact 34806069 37786978 0.92
tpcds_q64/datafusion:vortex-compact 544707935 590563763 0.92
tpcds_q65/datafusion:vortex-compact 69708592 75918735 0.92
tpcds_q66/datafusion:vortex-compact 110696379 108890184 1.02
tpcds_q67/datafusion:vortex-compact 130074619 142892829 0.91
tpcds_q68/datafusion:vortex-compact 🚀 68881310 78518065 0.88
tpcds_q69/datafusion:vortex-compact 62376757 65276507 0.96
tpcds_q70/datafusion:vortex-compact 126404716 139793869 0.90
tpcds_q71/datafusion:vortex-compact 🚀 44740547 50257060 0.89
tpcds_q72/datafusion:vortex-compact 🚀 2644066859 3171938648 0.83
tpcds_q73/datafusion:vortex-compact 51395355 56531376 0.91
tpcds_q74/datafusion:vortex-compact 🚀 133021039 156848465 0.85
tpcds_q75/datafusion:vortex-compact 🚀 165049128 183403068 0.90
tpcds_q76/datafusion:vortex-compact 🚀 51057143 57129531 0.89
tpcds_q77/datafusion:vortex-compact 67620143 73698623 0.92
tpcds_q78/datafusion:vortex-compact 158725412 172682457 0.92
tpcds_q79/datafusion:vortex-compact 🚀 58220586 64960182 0.90
tpcds_q80/datafusion:vortex-compact 🚀 130578714 149758511 0.87
tpcds_q81/datafusion:vortex-compact 🚀 42218413 47910093 0.88
tpcds_q82/datafusion:vortex-compact 49171517 54034518 0.91
tpcds_q83/datafusion:vortex-compact 62287352 67488757 0.92
tpcds_q84/datafusion:vortex-compact 🚀 18642472 21688381 0.86
tpcds_q85/datafusion:vortex-compact 125057248 136667180 0.92
tpcds_q86/datafusion:vortex-compact 🚀 20315667 22778063 0.89
tpcds_q87/datafusion:vortex-compact 🚀 65591103 74264398 0.88
tpcds_q88/datafusion:vortex-compact 131260200 143907815 0.91
tpcds_q89/datafusion:vortex-compact 🚀 45571640 52400545 0.87
tpcds_q90/datafusion:vortex-compact 24599390 27140528 0.91
tpcds_q91/datafusion:vortex-compact 🚀 40196193 45864937 0.88
tpcds_q92/datafusion:vortex-compact 20713972 22894495 0.90
tpcds_q93/datafusion:vortex-compact 🚀 47533054 53018701 0.90
tpcds_q94/datafusion:vortex-compact 🚀 32181417 36605462 0.88
tpcds_q95/datafusion:vortex-compact 72482364 79436657 0.91
tpcds_q96/datafusion:vortex-compact 26622863 27697488 0.96
tpcds_q97/datafusion:vortex-compact 41446110 44799188 0.93
tpcds_q98/datafusion:vortex-compact 🚀 38046227 43741712 0.87
tpcds_q99/datafusion:vortex-compact 50571601 52662706 0.96
datafusion / parquet (0.931x ➖, 26↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 38088808 38503600 0.99
tpcds_q02/datafusion:parquet 47514974 50839334 0.93
tpcds_q03/datafusion:parquet 16708819 18035330 0.93
tpcds_q04/datafusion:parquet 357437663 364540038 0.98
tpcds_q05/datafusion:parquet 56618500 57962608 0.98
tpcds_q06/datafusion:parquet 66874590 66747274 1.00
tpcds_q07/datafusion:parquet 97489229 96015890 1.02
tpcds_q08/datafusion:parquet 34871887 35148496 0.99
tpcds_q09/datafusion:parquet 61651348 61809597 1.00
tpcds_q10/datafusion:parquet 84755917 87994604 0.96
tpcds_q11/datafusion:parquet 194578903 196531864 0.99
tpcds_q12/datafusion:parquet 🚀 22986787 25676751 0.90
tpcds_q13/datafusion:parquet 93701256 96425382 0.97
tpcds_q14/datafusion:parquet 215261969 220218877 0.98
tpcds_q15/datafusion:parquet 27588895 26823497 1.03
tpcds_q16/datafusion:parquet 30785517 31075657 0.99
tpcds_q17/datafusion:parquet 77860468 76016117 1.02
tpcds_q18/datafusion:parquet 139324975 143254565 0.97
tpcds_q19/datafusion:parquet 29849686 30565816 0.98
tpcds_q20/datafusion:parquet 23213794 23702689 0.98
tpcds_q21/datafusion:parquet 23985321 24770214 0.97
tpcds_q22/datafusion:parquet 159196317 150361149 1.06
tpcds_q23/datafusion:parquet 170392522 186187927 0.92
tpcds_q24/datafusion:parquet 🚀 105669033 121909190 0.87
tpcds_q25/datafusion:parquet 🚀 72240094 80954507 0.89
tpcds_q26/datafusion:parquet 79746697 83005092 0.96
tpcds_q27/datafusion:parquet 168432478 181787252 0.93
tpcds_q28/datafusion:parquet 🚀 49138598 55256366 0.89
tpcds_q29/datafusion:parquet 74552696 81835934 0.91
tpcds_q30/datafusion:parquet 45323860 48649054 0.93
tpcds_q31/datafusion:parquet 76910681 80630941 0.95
tpcds_q32/datafusion:parquet 23400632 25327630 0.92
tpcds_q33/datafusion:parquet 36959874 38327238 0.96
tpcds_q34/datafusion:parquet 26768140 28869424 0.93
tpcds_q35/datafusion:parquet 🚀 84723923 94954605 0.89
tpcds_q36/datafusion:parquet 🚀 63099117 74918444 0.84
tpcds_q37/datafusion:parquet 23918887 25423166 0.94
tpcds_q38/datafusion:parquet 51126096 54714019 0.93
tpcds_q39/datafusion:parquet 🚀 86914374 96725730 0.90
tpcds_q40/datafusion:parquet 28313951 29794763 0.95
tpcds_q41/datafusion:parquet 17264697 18279553 0.94
tpcds_q42/datafusion:parquet 14892932 14993705 0.99
tpcds_q43/datafusion:parquet 19798869 20985592 0.94
tpcds_q44/datafusion:parquet 🚀 41350023 47085702 0.88
tpcds_q45/datafusion:parquet 33248107 35924957 0.93
tpcds_q46/datafusion:parquet 🚀 39189163 43722336 0.90
tpcds_q47/datafusion:parquet 138745763 152560368 0.91
tpcds_q48/datafusion:parquet 🚀 80871615 89974499 0.90
tpcds_q49/datafusion:parquet 🚀 66408773 74329660 0.89
tpcds_q50/datafusion:parquet 🚀 48737342 54841626 0.89
tpcds_q51/datafusion:parquet 🚀 91446346 102286484 0.89
tpcds_q52/datafusion:parquet 15400968 16925311 0.91
tpcds_q53/datafusion:parquet 23527547 24222576 0.97
tpcds_q54/datafusion:parquet 🚀 41665115 47196100 0.88
tpcds_q55/datafusion:parquet 14022520 15323962 0.92
tpcds_q56/datafusion:parquet 36732315 40308105 0.91
tpcds_q57/datafusion:parquet 114618366 119624879 0.96
tpcds_q58/datafusion:parquet 60537670 60921756 0.99
tpcds_q59/datafusion:parquet 58773506 64071959 0.92
tpcds_q60/datafusion:parquet 36568817 39875542 0.92
tpcds_q61/datafusion:parquet 50660170 54519996 0.93
tpcds_q62/datafusion:parquet 28204826 30489183 0.93
tpcds_q63/datafusion:parquet 🚀 21815468 24989055 0.87
tpcds_q64/datafusion:parquet 557339841 607197197 0.92
tpcds_q65/datafusion:parquet 🚀 43836002 50420449 0.87
tpcds_q66/datafusion:parquet 72572633 77960838 0.93
tpcds_q67/datafusion:parquet 156658379 173681898 0.90
tpcds_q68/datafusion:parquet 40832539 44947644 0.91
tpcds_q69/datafusion:parquet 79601958 86487212 0.92
tpcds_q70/datafusion:parquet 97508403 102825709 0.95
tpcds_q71/datafusion:parquet 27366948 27203102 1.01
tpcds_q72/datafusion:parquet 688092758 738894292 0.93
tpcds_q73/datafusion:parquet 27661533 26796935 1.03
tpcds_q74/datafusion:parquet 108360187 119401605 0.91
tpcds_q75/datafusion:parquet 119954482 129859124 0.92
tpcds_q76/datafusion:parquet 🚀 34190567 40008011 0.85
tpcds_q77/datafusion:parquet 51516800 54875946 0.94
tpcds_q78/datafusion:parquet 🚀 123434562 137243790 0.90
tpcds_q79/datafusion:parquet 31412049 33984467 0.92
tpcds_q80/datafusion:parquet 94870337 104452385 0.91
tpcds_q81/datafusion:parquet 41695383 44257810 0.94
tpcds_q82/datafusion:parquet 23883444 24411938 0.98
tpcds_q83/datafusion:parquet 50113282 52364136 0.96
tpcds_q84/datafusion:parquet 48055235 49963286 0.96
tpcds_q85/datafusion:parquet 171405522 180823305 0.95
tpcds_q86/datafusion:parquet 🚀 17563775 20504187 0.86
tpcds_q87/datafusion:parquet 51401114 55486457 0.93
tpcds_q88/datafusion:parquet 70931893 77956594 0.91
tpcds_q89/datafusion:parquet 🚀 23895343 29564896 0.81
tpcds_q90/datafusion:parquet 19112783 20759088 0.92
tpcds_q91/datafusion:parquet 71551704 74815846 0.96
tpcds_q92/datafusion:parquet 🚀 21388590 24777300 0.86
tpcds_q93/datafusion:parquet 🚀 35097960 39279286 0.89
tpcds_q94/datafusion:parquet 🚀 24929669 27743997 0.90
tpcds_q95/datafusion:parquet 67350655 73919271 0.91
tpcds_q96/datafusion:parquet 🚀 14740289 17241339 0.85
tpcds_q97/datafusion:parquet 🚀 33131205 36898755 0.90
tpcds_q98/datafusion:parquet 27080010 27767688 0.98
tpcds_q99/datafusion:parquet 🚀 29375741 36597315 0.80
duckdb / vortex-file-compressed (0.899x ✅, 48↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 26521393 28774474 0.92
tpcds_q02/duckdb:vortex-file-compressed 🚀 79415704 90526127 0.88
tpcds_q03/duckdb:vortex-file-compressed 25246234 27428657 0.92
tpcds_q04/duckdb:vortex-file-compressed 🚀 106837910 119367318 0.90
tpcds_q05/duckdb:vortex-file-compressed 97594776 107917705 0.90
tpcds_q06/duckdb:vortex-file-compressed 🚀 36052398 40126894 0.90
tpcds_q07/duckdb:vortex-file-compressed 24651610 27026262 0.91
tpcds_q08/duckdb:vortex-file-compressed 23854244 25931417 0.92
tpcds_q09/duckdb:vortex-file-compressed 🚀 40538268 46701661 0.87
tpcds_q10/duckdb:vortex-file-compressed 🚀 35902826 41980264 0.86
tpcds_q11/duckdb:vortex-file-compressed 🚀 62137990 69295703 0.90
tpcds_q12/duckdb:vortex-file-compressed 14659530 15531657 0.94
tpcds_q13/duckdb:vortex-file-compressed 🚀 33464425 39449549 0.85
tpcds_q14/duckdb:vortex-file-compressed 202745453 215991466 0.94
tpcds_q15/duckdb:vortex-file-compressed 41795736 45175756 0.93
tpcds_q16/duckdb:vortex-file-compressed 31399933 34428302 0.91
tpcds_q17/duckdb:vortex-file-compressed 39385642 42131860 0.93
tpcds_q18/duckdb:vortex-file-compressed 🚀 45172589 52570400 0.86
tpcds_q19/duckdb:vortex-file-compressed 🚀 33967489 37879375 0.90
tpcds_q20/duckdb:vortex-file-compressed 15793966 17156546 0.92
tpcds_q21/duckdb:vortex-file-compressed 🚀 20193403 22699678 0.89
tpcds_q22/duckdb:vortex-file-compressed 🚀 111401658 124200918 0.90
tpcds_q23/duckdb:vortex-file-compressed 🚀 130706911 151771669 0.86
tpcds_q24/duckdb:vortex-file-compressed 56498646 59977181 0.94
tpcds_q25/duckdb:vortex-file-compressed 39950385 42129256 0.95
tpcds_q26/duckdb:vortex-file-compressed 43299316 43586722 0.99
tpcds_q27/duckdb:vortex-file-compressed 🚀 90432155 101820969 0.89
tpcds_q28/duckdb:vortex-file-compressed 37348819 38773640 0.96
tpcds_q29/duckdb:vortex-file-compressed 🚀 36550817 41464804 0.88
tpcds_q30/duckdb:vortex-file-compressed 🚀 29184032 33491610 0.87
tpcds_q31/duckdb:vortex-file-compressed 26605557 28848102 0.92
tpcds_q32/duckdb:vortex-file-compressed 🚀 16127507 18498313 0.87
tpcds_q33/duckdb:vortex-file-compressed 🚀 65938817 77723982 0.85
tpcds_q34/duckdb:vortex-file-compressed 19876087 21362222 0.93
tpcds_q35/duckdb:vortex-file-compressed 66470694 71478937 0.93
tpcds_q36/duckdb:vortex-file-compressed 27801355 30025170 0.93
tpcds_q37/duckdb:vortex-file-compressed 🚀 21668671 24509035 0.88
tpcds_q38/duckdb:vortex-file-compressed 38437698 39940384 0.96
tpcds_q39/duckdb:vortex-file-compressed 44949235 48417053 0.93
tpcds_q40/duckdb:vortex-file-compressed 24129935 26215206 0.92
tpcds_q41/duckdb:vortex-file-compressed 13641988 14937346 0.91
tpcds_q42/duckdb:vortex-file-compressed 12202796 13154103 0.93
tpcds_q43/duckdb:vortex-file-compressed 🚀 19926098 22652649 0.88
tpcds_q44/duckdb:vortex-file-compressed 🚀 22440967 25347403 0.89
tpcds_q45/duckdb:vortex-file-compressed 🚀 26763543 30426107 0.88
tpcds_q46/duckdb:vortex-file-compressed 50120156 54235766 0.92
tpcds_q47/duckdb:vortex-file-compressed 49578456 54176031 0.92
tpcds_q48/duckdb:vortex-file-compressed 32456909 34201818 0.95
tpcds_q49/duckdb:vortex-file-compressed 🚀 31949796 36594857 0.87
tpcds_q50/duckdb:vortex-file-compressed 🚀 36607608 41456989 0.88
tpcds_q51/duckdb:vortex-file-compressed 101100755 111050815 0.91
tpcds_q52/duckdb:vortex-file-compressed 🚀 11985849 14373917 0.83
tpcds_q53/duckdb:vortex-file-compressed 🚀 17298420 19548210 0.88
tpcds_q54/duckdb:vortex-file-compressed 🚀 50905941 58512074 0.87
tpcds_q55/duckdb:vortex-file-compressed 🚀 11837937 13902473 0.85
tpcds_q56/duckdb:vortex-file-compressed 🚀 67877144 76798736 0.88
tpcds_q57/duckdb:vortex-file-compressed 43817191 48512006 0.90
tpcds_q58/duckdb:vortex-file-compressed 🚀 32156520 36316831 0.89
tpcds_q59/duckdb:vortex-file-compressed 🚀 61597671 68475089 0.90
tpcds_q60/duckdb:vortex-file-compressed 🚀 69508764 84087800 0.83
tpcds_q61/duckdb:vortex-file-compressed 39272940 42339338 0.93
tpcds_q62/duckdb:vortex-file-compressed 18752137 20622010 0.91
tpcds_q63/duckdb:vortex-file-compressed 🚀 18468339 20817038 0.89
tpcds_q64/duckdb:vortex-file-compressed 🚀 80171808 91836624 0.87
tpcds_q65/duckdb:vortex-file-compressed 24905875 26327649 0.95
tpcds_q66/duckdb:vortex-file-compressed 60519109 62059812 0.98
tpcds_q67/duckdb:vortex-file-compressed 🚀 143505602 164343875 0.87
tpcds_q68/duckdb:vortex-file-compressed 42444387 46386481 0.92
tpcds_q69/duckdb:vortex-file-compressed 39572189 43681810 0.91
tpcds_q70/duckdb:vortex-file-compressed 25704674 27330002 0.94
tpcds_q71/duckdb:vortex-file-compressed 🚀 20530241 23155902 0.89
tpcds_q72/duckdb:vortex-file-compressed 178461971 190310206 0.94
tpcds_q73/duckdb:vortex-file-compressed 19821256 21640841 0.92
tpcds_q74/duckdb:vortex-file-compressed 51881151 55437108 0.94
tpcds_q75/duckdb:vortex-file-compressed 57857702 63573612 0.91
tpcds_q76/duckdb:vortex-file-compressed 🚀 65730476 89064053 0.74
tpcds_q77/duckdb:vortex-file-compressed 🚀 66110822 79692558 0.83
tpcds_q78/duckdb:vortex-file-compressed 🚀 75592490 85469819 0.88
tpcds_q79/duckdb:vortex-file-compressed 43793729 46673515 0.94
tpcds_q80/duckdb:vortex-file-compressed 🚀 93484864 108356682 0.86
tpcds_q81/duckdb:vortex-file-compressed 🚀 33031708 37237219 0.89
tpcds_q82/duckdb:vortex-file-compressed 🚀 22794086 26102335 0.87
tpcds_q83/duckdb:vortex-file-compressed 28013733 30910727 0.91
tpcds_q84/duckdb:vortex-file-compressed 17587087 18944141 0.93
tpcds_q85/duckdb:vortex-file-compressed 46819670 51807635 0.90
tpcds_q86/duckdb:vortex-file-compressed 🚀 16333474 19140382 0.85
tpcds_q87/duckdb:vortex-file-compressed 40458100 44891949 0.90
tpcds_q88/duckdb:vortex-file-compressed 35331123 38429177 0.92
tpcds_q89/duckdb:vortex-file-compressed 18010420 19403154 0.93
tpcds_q90/duckdb:vortex-file-compressed 15388917 16877610 0.91
tpcds_q91/duckdb:vortex-file-compressed 🚀 27241167 30978865 0.88
tpcds_q92/duckdb:vortex-file-compressed 13928857 15184558 0.92
tpcds_q93/duckdb:vortex-file-compressed 🚀 30385577 35152694 0.86
tpcds_q94/duckdb:vortex-file-compressed 🚀 21591571 25135922 0.86
tpcds_q95/duckdb:vortex-file-compressed 156072731 159351756 0.98
tpcds_q96/duckdb:vortex-file-compressed 🚀 11919141 13499812 0.88
tpcds_q97/duckdb:vortex-file-compressed 🚀 37256655 43916147 0.85
tpcds_q98/duckdb:vortex-file-compressed 🚀 16575406 20277310 0.82
tpcds_q99/duckdb:vortex-file-compressed 32064616 34401269 0.93
duckdb / vortex-compact (0.909x ➖, 30↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 34011340 37258233 0.91
tpcds_q02/duckdb:vortex-compact 126622872 129372337 0.98
tpcds_q03/duckdb:vortex-compact 49217234 54425284 0.90
tpcds_q04/duckdb:vortex-compact 🚀 124902340 142594791 0.88
tpcds_q05/duckdb:vortex-compact 166832704 176780987 0.94
tpcds_q06/duckdb:vortex-compact 37667480 41521434 0.91
tpcds_q07/duckdb:vortex-compact 36983809 39122812 0.95
tpcds_q08/duckdb:vortex-compact 🚀 27228682 31061917 0.88
tpcds_q09/duckdb:vortex-compact 110569445 122349079 0.90
tpcds_q10/duckdb:vortex-compact 45540690 50487154 0.90
tpcds_q11/duckdb:vortex-compact 75037325 81223796 0.92
tpcds_q12/duckdb:vortex-compact 19658095 21698948 0.91
tpcds_q13/duckdb:vortex-compact 46990203 51399363 0.91
tpcds_q14/duckdb:vortex-compact 🚀 263638982 294242400 0.90
tpcds_q15/duckdb:vortex-compact 44983399 48891586 0.92
tpcds_q16/duckdb:vortex-compact 36295764 39405115 0.92
tpcds_q17/duckdb:vortex-compact 47648236 52463621 0.91
tpcds_q18/duckdb:vortex-compact 70382730 74278250 0.95
tpcds_q19/duckdb:vortex-compact 🚀 37595448 41976131 0.90
tpcds_q20/duckdb:vortex-compact 🚀 20354970 23000031 0.88
tpcds_q21/duckdb:vortex-compact 26867782 29019769 0.93
tpcds_q22/duckdb:vortex-compact 🚀 114334081 134734118 0.85
tpcds_q23/duckdb:vortex-compact 167865362 183181620 0.92
tpcds_q24/duckdb:vortex-compact 🚀 71091075 82291957 0.86
tpcds_q25/duckdb:vortex-compact 47637982 51909597 0.92
tpcds_q26/duckdb:vortex-compact 50986359 53567561 0.95
tpcds_q27/duckdb:vortex-compact 127753407 135203758 0.94
tpcds_q28/duckdb:vortex-compact 107755307 115099504 0.94
tpcds_q29/duckdb:vortex-compact 47999095 53170123 0.90
tpcds_q30/duckdb:vortex-compact 🚀 34981506 39728372 0.88
tpcds_q31/duckdb:vortex-compact 🚀 28982908 34782700 0.83
tpcds_q32/duckdb:vortex-compact 23679666 25082058 0.94
tpcds_q33/duckdb:vortex-compact 🚀 128723518 144380499 0.89
tpcds_q34/duckdb:vortex-compact 22423129 24164488 0.93
tpcds_q35/duckdb:vortex-compact 🚀 65935691 75434534 0.87
tpcds_q36/duckdb:vortex-compact 33520591 35480778 0.94
tpcds_q37/duckdb:vortex-compact 31628552 33224217 0.95
tpcds_q38/duckdb:vortex-compact 🚀 38927299 45405712 0.86
tpcds_q39/duckdb:vortex-compact 🚀 53333865 66154483 0.81
tpcds_q40/duckdb:vortex-compact 31299578 34234957 0.91
tpcds_q41/duckdb:vortex-compact 17609105 18537627 0.95
tpcds_q42/duckdb:vortex-compact 14836219 16392466 0.91
tpcds_q43/duckdb:vortex-compact 23516708 25555231 0.92
tpcds_q44/duckdb:vortex-compact 28928555 30872151 0.94
tpcds_q45/duckdb:vortex-compact 33004413 36318128 0.91
tpcds_q46/duckdb:vortex-compact 57872287 61124384 0.95
tpcds_q47/duckdb:vortex-compact 54023471 58353403 0.93
tpcds_q48/duckdb:vortex-compact 40849210 42910861 0.95
tpcds_q49/duckdb:vortex-compact 49184013 51335491 0.96
tpcds_q50/duckdb:vortex-compact 36607794 39926800 0.92
tpcds_q51/duckdb:vortex-compact 105647117 113106821 0.93
tpcds_q52/duckdb:vortex-compact 15428472 16519438 0.93
tpcds_q53/duckdb:vortex-compact 21222909 22523717 0.94
tpcds_q54/duckdb:vortex-compact 86571730 92372241 0.94
tpcds_q55/duckdb:vortex-compact 15410496 16929728 0.91
tpcds_q56/duckdb:vortex-compact 🚀 118803559 143273164 0.83
tpcds_q57/duckdb:vortex-compact 48234635 50984767 0.95
tpcds_q58/duckdb:vortex-compact 🚀 42389213 51784149 0.82
tpcds_q59/duckdb:vortex-compact 75618514 78011095 0.97
tpcds_q60/duckdb:vortex-compact 134496599 148018830 0.91
tpcds_q61/duckdb:vortex-compact 48462156 50230601 0.96
tpcds_q62/duckdb:vortex-compact 🚀 22044155 24579347 0.90
tpcds_q63/duckdb:vortex-compact 🚀 21311995 23778514 0.90
tpcds_q64/duckdb:vortex-compact 99757448 107493022 0.93
tpcds_q65/duckdb:vortex-compact 26426223 29020160 0.91
tpcds_q66/duckdb:vortex-compact 98753671 108879713 0.91
tpcds_q67/duckdb:vortex-compact 🚀 151601317 169146291 0.90
tpcds_q68/duckdb:vortex-compact 🚀 50205643 57327638 0.88
tpcds_q69/duckdb:vortex-compact 46390098 49590311 0.94
tpcds_q70/duckdb:vortex-compact 27975412 29033869 0.96
tpcds_q71/duckdb:vortex-compact 25863587 26780813 0.97
tpcds_q72/duckdb:vortex-compact 200989471 205954400 0.98
tpcds_q73/duckdb:vortex-compact 22006819 24243262 0.91
tpcds_q74/duckdb:vortex-compact 🚀 56996051 64304473 0.89
tpcds_q75/duckdb:vortex-compact 🚀 70521590 81476781 0.87
tpcds_q76/duckdb:vortex-compact 🚀 111830692 140447188 0.80
tpcds_q77/duckdb:vortex-compact 129523039 139926496 0.93
tpcds_q78/duckdb:vortex-compact 86771078 95199034 0.91
tpcds_q79/duckdb:vortex-compact 72770225 78912099 0.92
tpcds_q80/duckdb:vortex-compact 🚀 155170976 181362162 0.86
tpcds_q81/duckdb:vortex-compact 🚀 39745842 44946614 0.88
tpcds_q82/duckdb:vortex-compact 30645113 33942288 0.90
tpcds_q83/duckdb:vortex-compact 48301798 49753229 0.97
tpcds_q84/duckdb:vortex-compact 🚀 20367166 24235263 0.84
tpcds_q85/duckdb:vortex-compact 61157848 67126109 0.91
tpcds_q86/duckdb:vortex-compact 19106612 21092675 0.91
tpcds_q87/duckdb:vortex-compact 41306138 45890497 0.90
tpcds_q88/duckdb:vortex-compact 34532231 36980388 0.93
tpcds_q89/duckdb:vortex-compact 21962210 23558612 0.93
tpcds_q90/duckdb:vortex-compact 15829633 17268631 0.92
tpcds_q91/duckdb:vortex-compact 44069717 48322805 0.91
tpcds_q92/duckdb:vortex-compact 🚀 19591769 22629823 0.87
tpcds_q93/duckdb:vortex-compact 35473274 39269886 0.90
tpcds_q94/duckdb:vortex-compact 🚀 26552163 31190672 0.85
tpcds_q95/duckdb:vortex-compact 🚀 142767492 164247769 0.87
tpcds_q96/duckdb:vortex-compact 🚀 11395449 12798580 0.89
tpcds_q97/duckdb:vortex-compact 39866946 43636967 0.91
tpcds_q98/duckdb:vortex-compact 🚀 22341926 26101619 0.86
tpcds_q99/duckdb:vortex-compact 38022253 40490070 0.94
duckdb / parquet (0.943x ➖, 12↑ 1↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 44896747 47284901 0.95
tpcds_q02/duckdb:parquet 60148923 65622773 0.92
tpcds_q03/duckdb:parquet 🚀 11695415 13029499 0.90
tpcds_q04/duckdb:parquet 125979692 137817859 0.91
tpcds_q05/duckdb:parquet 76563981 76215550 1.00
tpcds_q06/duckdb:parquet 33194140 33512489 0.99
tpcds_q07/duckdb:parquet 23906242 25327446 0.94
tpcds_q08/duckdb:parquet 28424043 29872521 0.95
tpcds_q09/duckdb:parquet 40027890 42051313 0.95
tpcds_q10/duckdb:parquet 34911191 37119245 0.94
tpcds_q11/duckdb:parquet 90288964 95882304 0.94
tpcds_q12/duckdb:parquet 15428977 16452086 0.94
tpcds_q13/duckdb:parquet 36448096 37248623 0.98
tpcds_q14/duckdb:parquet 172101736 174776418 0.98
tpcds_q15/duckdb:parquet 34034182 32500031 1.05
tpcds_q16/duckdb:parquet 22825983 22528046 1.01
tpcds_q17/duckdb:parquet 40493842 40103069 1.01
tpcds_q18/duckdb:parquet 48087563 49054275 0.98
tpcds_q19/duckdb:parquet 31104772 32316497 0.96
tpcds_q20/duckdb:parquet 16230562 17499139 0.93
tpcds_q21/duckdb:parquet 11408301 12639703 0.90
tpcds_q22/duckdb:parquet 71601494 79190345 0.90
tpcds_q23/duckdb:parquet 120893540 127603146 0.95
tpcds_q24/duckdb:parquet 45904843 50167944 0.92
tpcds_q25/duckdb:parquet 33459745 35441830 0.94
tpcds_q26/duckdb:parquet 39232017 40175002 0.98
tpcds_q27/duckdb:parquet 90506187 95405263 0.95
tpcds_q28/duckdb:parquet 37311455 38727876 0.96
tpcds_q29/duckdb:parquet 🚀 35300095 40079652 0.88
tpcds_q30/duckdb:parquet 40350874 42875906 0.94
tpcds_q31/duckdb:parquet 23153714 24977138 0.93
tpcds_q32/duckdb:parquet 11821001 11735063 1.01
tpcds_q33/duckdb:parquet 71246402 74002832 0.96
tpcds_q34/duckdb:parquet 21385677 22171156 0.96
tpcds_q35/duckdb:parquet 61026808 62441949 0.98
tpcds_q36/duckdb:parquet 20799417 22894971 0.91
tpcds_q37/duckdb:parquet 14171459 15122431 0.94
tpcds_q38/duckdb:parquet 35010705 37806697 0.93
tpcds_q39/duckdb:parquet 🚨 39352970 33889636 1.16
tpcds_q40/duckdb:parquet 19104469 19408958 0.98
tpcds_q41/duckdb:parquet 🚀 7455254 8428402 0.88
tpcds_q42/duckdb:parquet 10467918 11144683 0.94
tpcds_q43/duckdb:parquet 15723504 17085816 0.92
tpcds_q44/duckdb:parquet 21720537 23659393 0.92
tpcds_q45/duckdb:parquet 27923856 28359496 0.98
tpcds_q46/duckdb:parquet 48093243 51161417 0.94
tpcds_q47/duckdb:parquet 47038067 50045339 0.94
tpcds_q48/duckdb:parquet 30390039 33044570 0.92
tpcds_q49/duckdb:parquet 25874945 25365879 1.02
tpcds_q50/duckdb:parquet 24864366 25847136 0.96
tpcds_q51/duckdb:parquet 🚀 95491168 126043612 0.76
tpcds_q52/duckdb:parquet 11227889 11984881 0.94
tpcds_q53/duckdb:parquet 16254364 17297472 0.94
tpcds_q54/duckdb:parquet 41293931 44290952 0.93
tpcds_q55/duckdb:parquet 10922562 11146044 0.98
tpcds_q56/duckdb:parquet 69770225 73605221 0.95
tpcds_q57/duckdb:parquet 35360906 36563188 0.97
tpcds_q58/duckdb:parquet 21890576 23784335 0.92
tpcds_q59/duckdb:parquet 37132405 36961520 1.00
tpcds_q60/duckdb:parquet 75042529 73607831 1.02
tpcds_q61/duckdb:parquet 32197265 34720691 0.93
tpcds_q62/duckdb:parquet 12009490 12516567 0.96
tpcds_q63/duckdb:parquet 15349626 16127120 0.95
tpcds_q64/duckdb:parquet 73416846 78452417 0.94
tpcds_q65/duckdb:parquet 21664647 22685375 0.96
tpcds_q66/duckdb:parquet 55772155 57743040 0.97
tpcds_q67/duckdb:parquet 142453251 156766173 0.91
tpcds_q68/duckdb:parquet 38482339 40291384 0.96
tpcds_q69/duckdb:parquet 37892968 38911655 0.97
tpcds_q70/duckdb:parquet 19989217 20745903 0.96
tpcds_q71/duckdb:parquet 19826148 20123015 0.99
tpcds_q72/duckdb:parquet 166483180 170070610 0.98
tpcds_q73/duckdb:parquet 18478425 19448327 0.95
tpcds_q74/duckdb:parquet 50717958 54798807 0.93
tpcds_q75/duckdb:parquet 53979566 58316114 0.93
tpcds_q76/duckdb:parquet 69121518 76311671 0.91
tpcds_q77/duckdb:parquet 62447056 67239124 0.93
tpcds_q78/duckdb:parquet 🚀 75317561 83996782 0.90
tpcds_q79/duckdb:parquet 🚀 27673414 30797096 0.90
tpcds_q80/duckdb:parquet 81774945 89081241 0.92
tpcds_q81/duckdb:parquet 47671029 50110951 0.95
tpcds_q82/duckdb:parquet 16431995 16688329 0.98
tpcds_q83/duckdb:parquet 16438530 17174020 0.96
tpcds_q84/duckdb:parquet 20389678 20622433 0.99
tpcds_q85/duckdb:parquet 🚀 38479235 42769574 0.90
tpcds_q86/duckdb:parquet 12353022 13015176 0.95
tpcds_q87/duckdb:parquet 37011205 39821659 0.93
tpcds_q88/duckdb:parquet 28859955 30341682 0.95
tpcds_q89/duckdb:parquet 17627982 18564647 0.95
tpcds_q90/duckdb:parquet 🚀 7094282 8255218 0.86
tpcds_q91/duckdb:parquet 23563673 24248056 0.97
tpcds_q92/duckdb:parquet 🚀 11261884 13546200 0.83
tpcds_q93/duckdb:parquet 30539176 33157485 0.92
tpcds_q94/duckdb:parquet 17205873 18124440 0.95
tpcds_q95/duckdb:parquet 🚀 119573147 152197446 0.79
tpcds_q96/duckdb:parquet 9496771 10244561 0.93
tpcds_q97/duckdb:parquet 🚀 34739915 38700217 0.90
tpcds_q98/duckdb:parquet 18511268 19175361 0.97
tpcds_q99/duckdb:parquet 🚀 19382274 21939766 0.88
duckdb / duckdb (0.904x ➖, 41↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 19500997 21557218 0.90
tpcds_q02/duckdb:duckdb 17867585 18865144 0.95
tpcds_q03/duckdb:duckdb 🚀 8054471 10150562 0.79
tpcds_q04/duckdb:duckdb 161488946 169261967 0.95
tpcds_q05/duckdb:duckdb 🚀 18553773 21230903 0.87
tpcds_q06/duckdb:duckdb 22701713 24793445 0.92
tpcds_q07/duckdb:duckdb 38519200 40907531 0.94
tpcds_q08/duckdb:duckdb 119349554 121139731 0.99
tpcds_q09/duckdb:duckdb 19789002 20024075 0.99
tpcds_q10/duckdb:duckdb 23535702 24949453 0.94
tpcds_q11/duckdb:duckdb 138425175 146308005 0.95
tpcds_q12/duckdb:duckdb 11403149 11485476 0.99
tpcds_q13/duckdb:duckdb 🚀 23331537 25994231 0.90
tpcds_q14/duckdb:duckdb 94178123 98809468 0.95
tpcds_q15/duckdb:duckdb 🚀 24181486 27473359 0.88
tpcds_q16/duckdb:duckdb 🚀 16143867 19380588 0.83
tpcds_q17/duckdb:duckdb 🚀 20473813 24678538 0.83
tpcds_q18/duckdb:duckdb 43870852 47743507 0.92
tpcds_q19/duckdb:duckdb 🚀 15920123 18470076 0.86
tpcds_q20/duckdb:duckdb 11727794 12967767 0.90
tpcds_q21/duckdb:duckdb 🚀 6568125 7298910 0.90
tpcds_q22/duckdb:duckdb 🚀 58995724 70958411 0.83
tpcds_q23/duckdb:duckdb 75610028 80762788 0.94
tpcds_q24/duckdb:duckdb 🚀 21950510 25168344 0.87
tpcds_q25/duckdb:duckdb 17558038 18350968 0.96
tpcds_q26/duckdb:duckdb 🚀 25135657 29790223 0.84
tpcds_q27/duckdb:duckdb 🚀 36070161 45013226 0.80
tpcds_q28/duckdb:duckdb 21580714 22241000 0.97
tpcds_q29/duckdb:duckdb 19812255 21455712 0.92
tpcds_q30/duckdb:duckdb 28269125 31338986 0.90
tpcds_q31/duckdb:duckdb 🚀 20055349 22337896 0.90
tpcds_q32/duckdb:duckdb 🚀 6920664 8172428 0.85
tpcds_q33/duckdb:duckdb 12724969 13377916 0.95
tpcds_q34/duckdb:duckdb 🚀 14001034 15605653 0.90
tpcds_q35/duckdb:duckdb 🚀 31510501 35823081 0.88
tpcds_q36/duckdb:duckdb 🚀 66834668 79385902 0.84
tpcds_q37/duckdb:duckdb 🚀 7079495 7892688 0.90
tpcds_q38/duckdb:duckdb 29785402 31546623 0.94
tpcds_q39/duckdb:duckdb 26761309 27986945 0.96
tpcds_q40/duckdb:duckdb 12894665 14249010 0.90
tpcds_q41/duckdb:duckdb 🚀 7743385 9440137 0.82
tpcds_q42/duckdb:duckdb 🚀 6013955 7363391 0.82
tpcds_q43/duckdb:duckdb 11103971 12278209 0.90
tpcds_q44/duckdb:duckdb 🚀 12547178 14609815 0.86
tpcds_q45/duckdb:duckdb 17582274 17780197 0.99
tpcds_q46/duckdb:duckdb 🚀 35647810 41224214 0.86
tpcds_q47/duckdb:duckdb 🚀 40156470 45905658 0.87
tpcds_q48/duckdb:duckdb 21786523 23561853 0.92
tpcds_q49/duckdb:duckdb 16476612 18295143 0.90
tpcds_q50/duckdb:duckdb 🚀 13678075 15575221 0.88
tpcds_q51/duckdb:duckdb 91570975 97128490 0.94
tpcds_q52/duckdb:duckdb 7253349 7846299 0.92
tpcds_q53/duckdb:duckdb 11566710 12433068 0.93
tpcds_q54/duckdb:duckdb 16168373 17674047 0.91
tpcds_q55/duckdb:duckdb 🚀 6659642 7560222 0.88
tpcds_q56/duckdb:duckdb 13454905 13747310 0.98
tpcds_q57/duckdb:duckdb 🚀 30284313 34278372 0.88
tpcds_q58/duckdb:duckdb 🚀 11658155 13588428 0.86
tpcds_q59/duckdb:duckdb 34106908 37481836 0.91
tpcds_q60/duckdb:duckdb 🚀 14243874 16026349 0.89
tpcds_q61/duckdb:duckdb 14686842 15792027 0.93
tpcds_q62/duckdb:duckdb 8815860 9778825 0.90
tpcds_q63/duckdb:duckdb 10949132 12013084 0.91
tpcds_q64/duckdb:duckdb 🚀 50858011 57295258 0.89
tpcds_q65/duckdb:duckdb 34268071 36470614 0.94
tpcds_q66/duckdb:duckdb 24268308 26597126 0.91
tpcds_q67/duckdb:duckdb 🚀 126416460 142208748 0.89
tpcds_q68/duckdb:duckdb 24731818 26478554 0.93
tpcds_q69/duckdb:duckdb 23721270 25983894 0.91
tpcds_q70/duckdb:duckdb 🚀 13919251 15618776 0.89
tpcds_q71/duckdb:duckdb 🚀 12004356 14218320 0.84
tpcds_q72/duckdb:duckdb 41436883 44677022 0.93
tpcds_q73/duckdb:duckdb 🚀 9927881 11911093 0.83
tpcds_q74/duckdb:duckdb 95546707 105032748 0.91
tpcds_q75/duckdb:duckdb 41498814 45359334 0.91
tpcds_q76/duckdb:duckdb 12485266 12360078 1.01
tpcds_q77/duckdb:duckdb 11426204 11979207 0.95
tpcds_q78/duckdb:duckdb 62136260 67396103 0.92
tpcds_q79/duckdb:duckdb 🚀 17669863 20094503 0.88
tpcds_q80/duckdb:duckdb 27159144 30134061 0.90
tpcds_q81/duckdb:duckdb 37135067 38025073 0.98
tpcds_q82/duckdb:duckdb 8469514 9022982 0.94
tpcds_q83/duckdb:duckdb 9090427 9919067 0.92
tpcds_q84/duckdb:duckdb 13304632 14499835 0.92
tpcds_q85/duckdb:duckdb 🚀 23630022 26652497 0.89
tpcds_q86/duckdb:duckdb 10752375 11459466 0.94
tpcds_q87/duckdb:duckdb 33822842 35639261 0.95
tpcds_q88/duckdb:duckdb 23903482 25354354 0.94
tpcds_q89/duckdb:duckdb 13273241 14343477 0.93
tpcds_q90/duckdb:duckdb 5465096 6065476 0.90
tpcds_q91/duckdb:duckdb 🚀 12708095 14436895 0.88
tpcds_q92/duckdb:duckdb 🚀 8936039 10060558 0.89
tpcds_q93/duckdb:duckdb 🚀 19352964 24795042 0.78
tpcds_q94/duckdb:duckdb 12369803 12619714 0.98
tpcds_q95/duckdb:duckdb 🚀 115261094 136508036 0.84
tpcds_q96/duckdb:duckdb 🚀 4350874 4852073 0.90
tpcds_q97/duckdb:duckdb 🚀 29441501 35211817 0.84
tpcds_q98/duckdb:duckdb 12894839 14258766 0.90
tpcds_q99/duckdb:duckdb 16333946 17318102 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -11.0% -3.1% -8.2% +11.2% ➖ noise
1 datafusion:vortex-file-compressed -5.6% -3.1% -2.6% +12.0% ➖ noise
1 duckdb:duckdb -9.5% -3.1% -6.7% +12.9% ➖ noise
1 duckdb:vortex-compact -8.7% -3.1% -5.8% +11.2% ➖ noise
1 duckdb:vortex-file-compressed -7.8% -3.1% -4.9% +15.9% ➖ noise
2 datafusion:vortex-compact -10.1% -7.4% -2.9% +11.2% ➖ noise
2 datafusion:vortex-file-compressed -9.8% -7.4% -2.6% +11.2% ➖ noise
2 duckdb:duckdb -5.3% -7.4% +2.3% +13.4% ➖ noise
2 duckdb:vortex-compact -2.1% -7.4% +5.7% +11.2% ➖ noise
2 duckdb:vortex-file-compressed -12.3% -7.4% -5.2% +12.8% ➖ noise
3 datafusion:vortex-compact -13.4% -8.8% -5.0% +11.2% ➖ noise
3 datafusion:vortex-file-compressed -9.2% -8.8% -0.4% +11.9% ➖ noise
3 duckdb:duckdb -20.6% -8.8% -13.0% +14.8% ✅ faster
3 duckdb:vortex-compact -9.6% -8.8% -0.8% +12.3% ➖ noise
3 duckdb:vortex-file-compressed -8.0% -8.8% +0.9% +16.0% ➖ noise
4 datafusion:vortex-compact -15.2% -5.3% -10.4% +11.2% ✅ faster
4 datafusion:vortex-file-compressed -14.2% -5.3% -9.3% +11.2% ➖ noise
4 duckdb:duckdb -4.6% -5.3% +0.8% +11.2% ➖ noise
4 duckdb:vortex-compact -12.4% -5.3% -7.5% +11.2% ➖ noise
4 duckdb:vortex-file-compressed -10.5% -5.3% -5.5% +11.2% ➖ noise
5 datafusion:vortex-compact -16.4% -0.9% -15.7% +11.2% ✅ faster
5 datafusion:vortex-file-compressed -2.9% -0.9% -2.0% +14.3% ➖ noise
5 duckdb:duckdb -12.6% -0.9% -11.8% +11.7% ✅ faster
5 duckdb:vortex-compact -5.6% -0.9% -4.7% +11.2% ➖ noise
5 duckdb:vortex-file-compressed -9.6% -0.9% -8.7% +15.0% ➖ noise
6 datafusion:vortex-compact -16.3% -0.4% -16.0% +11.2% ✅ faster
6 datafusion:vortex-file-compressed -12.3% -0.4% -12.0% +11.2% ✅ faster
6 duckdb:duckdb -8.4% -0.4% -8.1% +12.7% ➖ noise
6 duckdb:vortex-compact -9.3% -0.4% -8.9% +11.2% ➖ noise
6 duckdb:vortex-file-compressed -10.2% -0.4% -9.8% +11.2% ➖ noise
7 datafusion:vortex-compact -15.9% -2.1% -14.1% +11.2% ✅ faster
7 datafusion:vortex-file-compressed -7.9% -2.1% -5.9% +11.2% ➖ noise
7 duckdb:duckdb -5.8% -2.1% -3.8% +15.8% ➖ noise
7 duckdb:vortex-compact -5.5% -2.1% -3.4% +11.2% ➖ noise
7 duckdb:vortex-file-compressed -8.8% -2.1% -6.8% +11.2% ➖ noise
8 datafusion:vortex-compact -4.9% -2.8% -2.1% +11.2% ➖ noise
8 datafusion:vortex-file-compressed -6.6% -2.8% -3.9% +11.2% ➖ noise
8 duckdb:duckdb -1.5% -2.8% +1.4% +11.2% ➖ noise
8 duckdb:vortex-compact -12.3% -2.8% -9.8% +11.2% ➖ noise
8 duckdb:vortex-file-compressed -8.0% -2.8% -5.3% +11.2% ➖ noise
9 datafusion:vortex-compact -12.2% -2.6% -9.9% +11.2% ➖ noise
9 datafusion:vortex-file-compressed -12.7% -2.6% -10.4% +11.2% ✅ faster
9 duckdb:duckdb -1.2% -2.6% +1.4% +11.2% ➖ noise
9 duckdb:vortex-compact -9.6% -2.6% -7.3% +11.2% ➖ noise
9 duckdb:vortex-file-compressed -13.2% -2.6% -10.9% +11.2% ✅ faster
10 datafusion:vortex-compact -8.7% -4.8% -4.1% +11.2% ➖ noise
10 datafusion:vortex-file-compressed -8.4% -4.8% -3.7% +11.2% ➖ noise
10 duckdb:duckdb -5.7% -4.8% -0.9% +11.6% ➖ noise
10 duckdb:vortex-compact -9.8% -4.8% -5.2% +11.2% ➖ noise
10 duckdb:vortex-file-compressed -14.5% -4.8% -10.1% +14.2% ➖ noise
11 datafusion:vortex-compact -12.5% -3.4% -9.3% +11.2% ➖ noise
11 datafusion:vortex-file-compressed -9.4% -3.4% -6.2% +11.2% ➖ noise
11 duckdb:duckdb -5.4% -3.4% -2.0% +11.2% ➖ noise
11 duckdb:vortex-compact -7.6% -3.4% -4.3% +11.4% ➖ noise
11 duckdb:vortex-file-compressed -10.3% -3.4% -7.1% +11.2% ➖ noise
12 datafusion:vortex-compact -11.8% -8.4% -3.7% +11.2% ➖ noise
12 datafusion:vortex-file-compressed -14.9% -8.4% -7.2% +13.7% ➖ noise
12 duckdb:duckdb -0.7% -8.4% +8.4% +13.7% ➖ noise
12 duckdb:vortex-compact -9.4% -8.4% -1.1% +14.4% ➖ noise
12 duckdb:vortex-file-compressed -5.6% -8.4% +3.0% +11.9% ➖ noise
13 datafusion:vortex-compact -6.9% -2.5% -4.6% +11.2% ➖ noise
13 datafusion:vortex-file-compressed -2.6% -2.5% -0.2% +11.2% ➖ noise
13 duckdb:duckdb -10.2% -2.5% -8.0% +11.2% ➖ noise
13 duckdb:vortex-compact -8.6% -2.5% -6.2% +11.2% ➖ noise
13 duckdb:vortex-file-compressed -15.2% -2.5% -13.0% +11.2% ✅ faster
14 datafusion:vortex-compact -11.1% -1.9% -9.4% +11.2% ➖ noise
14 datafusion:vortex-file-compressed -7.6% -1.9% -5.9% +11.2% ➖ noise
14 duckdb:duckdb -4.7% -1.9% -2.8% +11.2% ➖ noise
14 duckdb:vortex-compact -10.4% -1.9% -8.7% +11.2% ➖ noise
14 duckdb:vortex-file-compressed -6.1% -1.9% -4.3% +16.9% ➖ noise
15 datafusion:vortex-compact -14.6% +3.8% -17.7% +11.2% ✅ faster
15 datafusion:vortex-file-compressed -1.8% +3.8% -5.4% +12.6% ➖ noise
15 duckdb:duckdb -12.0% +3.8% -15.2% +18.6% ➖ noise
15 duckdb:vortex-compact -8.0% +3.8% -11.3% +15.8% ➖ noise
15 duckdb:vortex-file-compressed -7.5% +3.8% -10.9% +14.2% ➖ noise
16 datafusion:vortex-compact -6.0% +0.2% -6.2% +11.2% ➖ noise
16 datafusion:vortex-file-compressed -10.1% +0.2% -10.3% +11.2% ✅ faster
16 duckdb:duckdb -16.7% +0.2% -16.9% +16.1% ✅ faster
16 duckdb:vortex-compact -7.9% +0.2% -8.1% +12.6% ➖ noise
16 duckdb:vortex-file-compressed -8.8% +0.2% -9.0% +11.2% ➖ noise
17 datafusion:vortex-compact -9.8% +1.7% -11.3% +11.2% ✅ faster
17 datafusion:vortex-file-compressed -11.6% +1.7% -13.1% +11.2% ✅ faster
17 duckdb:duckdb -17.0% +1.7% -18.4% +12.4% ✅ faster
17 duckdb:vortex-compact -9.2% +1.7% -10.7% +12.2% ➖ noise
17 duckdb:vortex-file-compressed -6.5% +1.7% -8.1% +11.2% ➖ noise
18 datafusion:vortex-compact -11.8% -2.4% -9.7% +11.2% ➖ noise
18 datafusion:vortex-file-compressed -7.9% -2.4% -5.7% +11.2% ➖ noise
18 duckdb:duckdb -8.1% -2.4% -5.9% +11.3% ➖ noise
18 duckdb:vortex-compact -5.2% -2.4% -3.0% +11.2% ➖ noise
18 duckdb:vortex-file-compressed -14.1% -2.4% -12.0% +11.2% ✅ faster
19 datafusion:vortex-compact -8.5% -3.0% -5.6% +11.2% ➖ noise
19 datafusion:vortex-file-compressed -11.7% -3.0% -8.9% +11.2% ➖ noise
19 duckdb:duckdb -13.8% -3.0% -11.1% +12.0% ✅ faster
19 duckdb:vortex-compact -10.4% -3.0% -7.6% +11.2% ➖ noise
19 duckdb:vortex-file-compressed -10.3% -3.0% -7.5% +11.2% ➖ noise
20 datafusion:vortex-compact -9.8% -4.7% -5.4% +11.2% ➖ noise
20 datafusion:vortex-file-compressed -13.8% -4.7% -9.6% +11.2% ➖ noise
20 duckdb:duckdb -9.6% -4.7% -5.1% +11.8% ➖ noise
20 duckdb:vortex-compact -11.5% -4.7% -7.1% +11.2% ➖ noise
20 duckdb:vortex-file-compressed -7.9% -4.7% -3.4% +12.7% ➖ noise
21 datafusion:vortex-compact -5.6% -6.5% +1.0% +11.2% ➖ noise
21 datafusion:vortex-file-compressed -12.4% -6.5% -6.2% +11.2% ➖ noise
21 duckdb:duckdb -10.0% -6.5% -3.7% +15.3% ➖ noise
21 duckdb:vortex-compact -7.4% -6.5% -1.0% +12.3% ➖ noise
21 duckdb:vortex-file-compressed -11.0% -6.5% -4.8% +14.7% ➖ noise
22 datafusion:vortex-compact -11.2% -2.2% -9.2% +14.0% ➖ noise
22 datafusion:vortex-file-compressed -9.1% -2.2% -7.1% +13.5% ➖ noise
22 duckdb:duckdb -16.9% -2.2% -15.0% +14.3% ✅ faster
22 duckdb:vortex-compact -15.1% -2.2% -13.3% +12.0% ✅ faster
22 duckdb:vortex-file-compressed -10.3% -2.2% -8.3% +13.3% ➖ noise
23 datafusion:vortex-compact -12.3% -6.9% -5.8% +11.2% ➖ noise
23 datafusion:vortex-file-compressed -11.8% -6.9% -5.3% +11.2% ➖ noise
23 duckdb:duckdb -6.4% -6.9% +0.5% +18.2% ➖ noise
23 duckdb:vortex-compact -8.4% -6.9% -1.6% +12.0% ➖ noise
23 duckdb:vortex-file-compressed -13.9% -6.9% -7.5% +11.2% ➖ noise
24 datafusion:vortex-compact -8.3% -10.9% +3.0% +11.2% ➖ noise
24 datafusion:vortex-file-compressed -10.1% -10.9% +0.9% +11.2% ➖ noise
24 duckdb:duckdb -12.8% -10.9% -2.1% +11.2% ➖ noise
24 duckdb:vortex-compact -13.6% -10.9% -3.0% +11.2% ➖ noise
24 duckdb:vortex-file-compressed -5.8% -10.9% +5.8% +15.0% ➖ noise
25 datafusion:vortex-compact -8.5% -8.2% -0.3% +11.2% ➖ noise
25 datafusion:vortex-file-compressed -11.9% -8.2% -4.1% +11.2% ➖ noise
25 duckdb:duckdb -4.3% -8.2% +4.2% +13.1% ➖ noise
25 duckdb:vortex-compact -8.2% -8.2% -0.0% +11.2% ➖ noise
25 duckdb:vortex-file-compressed -5.2% -8.2% +3.3% +11.2% ➖ noise
26 datafusion:vortex-compact -10.7% -3.1% -7.8% +11.2% ➖ noise
26 datafusion:vortex-file-compressed -9.2% -3.1% -6.2% +11.7% ➖ noise
26 duckdb:duckdb -15.6% -3.1% -12.9% +15.0% ➖ noise
26 duckdb:vortex-compact -4.8% -3.1% -1.7% +11.8% ➖ noise
26 duckdb:vortex-file-compressed -0.7% -3.1% +2.6% +12.4% ➖ noise
27 datafusion:vortex-compact -5.7% -6.2% +0.6% +11.2% ➖ noise
27 datafusion:vortex-file-compressed -8.7% -6.2% -2.6% +11.2% ➖ noise
27 duckdb:duckdb -19.9% -6.2% -14.5% +19.0% ➖ noise
27 duckdb:vortex-compact -5.5% -6.2% +0.8% +11.2% ➖ noise
27 duckdb:vortex-file-compressed -11.2% -6.2% -5.3% +11.2% ➖ noise
28 datafusion:vortex-compact -3.0% -7.4% +4.8% +11.2% ➖ noise
28 datafusion:vortex-file-compressed -12.9% -7.4% -5.9% +11.2% ➖ noise
28 duckdb:duckdb -3.0% -7.4% +4.8% +11.2% ➖ noise
28 duckdb:vortex-compact -6.4% -7.4% +1.1% +11.2% ➖ noise
28 duckdb:vortex-file-compressed -3.7% -7.4% +4.1% +11.2% ➖ noise
29 datafusion:vortex-compact -4.0% -10.4% +7.2% +11.2% ➖ noise
29 datafusion:vortex-file-compressed -7.0% -10.4% +3.8% +11.2% ➖ noise
29 duckdb:duckdb -7.7% -10.4% +3.1% +11.2% ➖ noise
29 duckdb:vortex-compact -9.7% -10.4% +0.8% +11.2% ➖ noise
29 duckdb:vortex-file-compressed -11.9% -10.4% -1.6% +13.5% ➖ noise
30 datafusion:vortex-compact -2.4% -6.4% +4.3% +11.2% ➖ noise
30 datafusion:vortex-file-compressed +1.5% -6.4% +8.4% +11.7% ➖ noise
30 duckdb:duckdb -9.8% -6.4% -3.7% +11.2% ➖ noise
30 duckdb:vortex-compact -11.9% -6.4% -6.0% +11.6% ➖ noise
30 duckdb:vortex-file-compressed -12.9% -6.4% -6.9% +12.5% ➖ noise
31 datafusion:vortex-compact -3.2% -6.0% +3.0% +11.2% ➖ noise
31 datafusion:vortex-file-compressed -4.1% -6.0% +2.0% +11.2% ➖ noise
31 duckdb:duckdb -10.2% -6.0% -4.5% +13.6% ➖ noise
31 duckdb:vortex-compact -16.7% -6.0% -11.4% +13.6% ➖ noise
31 duckdb:vortex-file-compressed -7.8% -6.0% -1.9% +11.2% ➖ noise
32 datafusion:vortex-compact -3.9% -3.5% -0.4% +11.2% ➖ noise
32 datafusion:vortex-file-compressed +8.1% -3.5% +12.1% +11.2% 🚨 regression
32 duckdb:duckdb -15.3% -3.5% -12.2% +15.0% ➖ noise
32 duckdb:vortex-compact -5.6% -3.5% -2.1% +11.2% ➖ noise
32 duckdb:vortex-file-compressed -12.8% -3.5% -9.6% +11.5% ➖ noise
33 datafusion:vortex-compact +1.7% -3.6% +5.5% +11.2% ➖ noise
33 datafusion:vortex-file-compressed -0.9% -3.6% +2.8% +11.2% ➖ noise
33 duckdb:duckdb -4.9% -3.6% -1.3% +11.2% ➖ noise
33 duckdb:vortex-compact -10.8% -3.6% -7.5% +11.2% ➖ noise
33 duckdb:vortex-file-compressed -15.2% -3.6% -12.0% +11.2% ✅ faster
34 datafusion:vortex-compact -4.2% -5.4% +1.3% +11.2% ➖ noise
34 datafusion:vortex-file-compressed -0.6% -5.4% +5.1% +11.2% ➖ noise
34 duckdb:duckdb -10.3% -5.4% -5.1% +11.2% ➖ noise
34 duckdb:vortex-compact -7.2% -5.4% -1.9% +12.0% ➖ noise
34 duckdb:vortex-file-compressed -7.0% -5.4% -1.6% +11.2% ➖ noise
35 datafusion:vortex-compact -7.8% -6.6% -1.2% +11.2% ➖ noise
35 datafusion:vortex-file-compressed -5.3% -6.6% +1.4% +11.2% ➖ noise
35 duckdb:duckdb -12.0% -6.6% -5.8% +11.2% ➖ noise
35 duckdb:vortex-compact -12.6% -6.6% -6.4% +11.2% ➖ noise
35 duckdb:vortex-file-compressed -7.0% -6.6% -0.4% +13.3% ➖ noise
36 datafusion:vortex-compact -9.6% -12.5% +3.4% +11.2% ➖ noise
36 datafusion:vortex-file-compressed -13.6% -12.5% -1.2% +11.2% ➖ noise
36 duckdb:duckdb -15.8% -12.5% -3.8% +11.2% ➖ noise
36 duckdb:vortex-compact -5.5% -12.5% +8.0% +11.2% ➖ noise
36 duckdb:vortex-file-compressed -7.4% -12.5% +5.9% +11.4% ➖ noise
37 datafusion:vortex-compact -8.8% -6.1% -2.9% +11.2% ➖ noise
37 datafusion:vortex-file-compressed -14.0% -6.1% -8.4% +13.4% ➖ noise
37 duckdb:duckdb -10.3% -6.1% -4.5% +15.9% ➖ noise
37 duckdb:vortex-compact -4.8% -6.1% +1.4% +11.4% ➖ noise
37 duckdb:vortex-file-compressed -11.6% -6.1% -5.8% +12.3% ➖ noise
38 datafusion:vortex-compact -9.6% -7.0% -2.8% +11.2% ➖ noise
38 datafusion:vortex-file-compressed -9.4% -7.0% -2.6% +11.2% ➖ noise
38 duckdb:duckdb -5.6% -7.0% +1.5% +14.1% ➖ noise
38 duckdb:vortex-compact -14.3% -7.0% -7.8% +12.1% ➖ noise
38 duckdb:vortex-file-compressed -3.8% -7.0% +3.5% +11.2% ➖ noise
39 datafusion:vortex-compact -8.6% +2.1% -10.5% +15.1% ➖ noise
39 datafusion:vortex-file-compressed -11.8% +2.1% -13.7% +15.5% ✅ faster
39 duckdb:duckdb -4.4% +2.1% -6.4% +23.8% ➖ noise
39 duckdb:vortex-compact -19.4% +2.1% -21.1% +23.5% ✅ faster
39 duckdb:vortex-file-compressed -7.2% +2.1% -9.1% +23.0% ➖ noise
40 datafusion:vortex-compact -8.6% -3.3% -5.5% +11.2% ➖ noise
40 datafusion:vortex-file-compressed -13.7% -3.3% -10.8% +11.2% ✅ faster
40 duckdb:duckdb -9.5% -3.3% -6.4% +16.1% ➖ noise
40 duckdb:vortex-compact -8.6% -3.3% -5.5% +13.1% ➖ noise
40 duckdb:vortex-file-compressed -8.0% -3.3% -4.8% +11.2% ➖ noise
41 datafusion:vortex-compact -5.2% -8.6% +3.8% +11.2% ➖ noise
41 datafusion:vortex-file-compressed -6.0% -8.6% +2.9% +13.1% ➖ noise
41 duckdb:duckdb -18.0% -8.6% -10.3% +12.9% ➖ noise
41 duckdb:vortex-compact -5.0% -8.6% +3.9% +11.2% ➖ noise
41 duckdb:vortex-file-compressed -8.7% -8.6% -0.1% +12.6% ➖ noise
42 datafusion:vortex-compact -8.0% -3.4% -4.7% +11.2% ➖ noise
42 datafusion:vortex-file-compressed -9.3% -3.4% -6.1% +11.2% ➖ noise
42 duckdb:duckdb -18.3% -3.4% -15.4% +16.5% ✅ faster
42 duckdb:vortex-compact -9.5% -3.4% -6.3% +12.2% ➖ noise
42 duckdb:vortex-file-compressed -7.2% -3.4% -4.0% +13.7% ➖ noise
43 datafusion:vortex-compact -7.1% -6.8% -0.3% +11.2% ➖ noise
43 datafusion:vortex-file-compressed -7.9% -6.8% -1.1% +11.2% ➖ noise
43 duckdb:duckdb -9.6% -6.8% -2.9% +11.9% ➖ noise
43 duckdb:vortex-compact -8.0% -6.8% -1.2% +11.9% ➖ noise
43 duckdb:vortex-file-compressed -12.0% -6.8% -5.6% +11.2% ➖ noise
44 datafusion:vortex-compact -7.6% -10.2% +2.9% +11.2% ➖ noise
44 datafusion:vortex-file-compressed -6.8% -10.2% +3.8% +11.2% ➖ noise
44 duckdb:duckdb -14.1% -10.2% -4.4% +12.8% ➖ noise
44 duckdb:vortex-compact -6.3% -10.2% +4.4% +12.7% ➖ noise
44 duckdb:vortex-file-compressed -11.5% -10.2% -1.4% +11.6% ➖ noise
45 datafusion:vortex-compact -9.2% -4.5% -4.9% +11.2% ➖ noise
45 datafusion:vortex-file-compressed -7.4% -4.5% -3.0% +11.2% ➖ noise
45 duckdb:duckdb -1.1% -4.5% +3.6% +11.2% ➖ noise
45 duckdb:vortex-compact -9.1% -4.5% -4.8% +18.1% ➖ noise
45 duckdb:vortex-file-compressed -12.0% -4.5% -7.9% +11.2% ➖ noise
46 datafusion:vortex-compact -6.1% -8.2% +2.3% +11.2% ➖ noise
46 datafusion:vortex-file-compressed -7.6% -8.2% +0.7% +11.2% ➖ noise
46 duckdb:duckdb -13.5% -8.2% -5.8% +11.2% ➖ noise
46 duckdb:vortex-compact -5.3% -8.2% +3.1% +11.2% ➖ noise
46 duckdb:vortex-file-compressed -7.6% -8.2% +0.7% +11.2% ➖ noise
47 datafusion:vortex-compact -12.9% -7.5% -5.7% +11.2% ➖ noise
47 datafusion:vortex-file-compressed -7.6% -7.5% -0.0% +11.2% ➖ noise
47 duckdb:duckdb -12.5% -7.5% -5.4% +11.2% ➖ noise
47 duckdb:vortex-compact -7.4% -7.5% +0.1% +11.2% ➖ noise
47 duckdb:vortex-file-compressed -8.5% -7.5% -1.0% +11.2% ➖ noise
48 datafusion:vortex-compact -3.0% -9.1% +6.7% +11.2% ➖ noise
48 datafusion:vortex-file-compressed -10.3% -9.1% -1.4% +11.2% ➖ noise
48 duckdb:duckdb -7.5% -9.1% +1.7% +11.2% ➖ noise
48 duckdb:vortex-compact -4.8% -9.1% +4.7% +11.2% ➖ noise
48 duckdb:vortex-file-compressed -5.1% -9.1% +4.4% +12.0% ➖ noise
49 datafusion:vortex-compact -6.4% -4.5% -2.0% +11.2% ➖ noise
49 datafusion:vortex-file-compressed -13.6% -4.5% -9.5% +11.2% ➖ noise
49 duckdb:duckdb -9.9% -4.5% -5.7% +15.7% ➖ noise
49 duckdb:vortex-compact -4.2% -4.5% +0.4% +12.2% ➖ noise
49 duckdb:vortex-file-compressed -12.7% -4.5% -8.5% +13.4% ➖ noise
50 datafusion:vortex-compact -7.0% -7.5% +0.6% +11.2% ➖ noise
50 datafusion:vortex-file-compressed -14.0% -7.5% -7.0% +14.3% ➖ noise
50 duckdb:duckdb -12.2% -7.5% -5.0% +11.2% ➖ noise
50 duckdb:vortex-compact -8.3% -7.5% -0.8% +11.2% ➖ noise
50 duckdb:vortex-file-compressed -11.7% -7.5% -4.5% +11.2% ➖ noise
51 datafusion:vortex-compact -8.2% -17.7% +11.6% +11.2% 🚨 regression
51 datafusion:vortex-file-compressed -13.2% -17.7% +5.5% +12.0% ➖ noise
51 duckdb:duckdb -5.7% -17.7% +14.6% +12.0% 🚨 regression
51 duckdb:vortex-compact -6.6% -17.7% +13.5% +26.0% ➖ noise
51 duckdb:vortex-file-compressed -9.0% -17.7% +10.6% +17.3% ➖ noise
52 datafusion:vortex-compact -9.0% -7.7% -1.5% +14.8% ➖ noise
52 datafusion:vortex-file-compressed -11.3% -7.7% -3.9% +12.2% ➖ noise
52 duckdb:duckdb -7.6% -7.7% +0.1% +14.3% ➖ noise
52 duckdb:vortex-compact -6.6% -7.7% +1.2% +13.8% ➖ noise
52 duckdb:vortex-file-compressed -16.6% -7.7% -9.7% +20.9% ➖ noise
53 datafusion:vortex-compact -10.5% -4.5% -6.3% +11.2% ➖ noise
53 datafusion:vortex-file-compressed -18.2% -4.5% -14.4% +11.2% ✅ faster
53 duckdb:duckdb -7.0% -4.5% -2.6% +11.2% ➖ noise
53 duckdb:vortex-compact -5.8% -4.5% -1.4% +11.2% ➖ noise
53 duckdb:vortex-file-compressed -11.5% -4.5% -7.4% +12.2% ➖ noise
54 datafusion:vortex-compact -7.6% -9.3% +1.9% +11.2% ➖ noise
54 datafusion:vortex-file-compressed -7.6% -9.3% +1.9% +11.2% ➖ noise
54 duckdb:duckdb -8.5% -9.3% +0.8% +11.2% ➖ noise
54 duckdb:vortex-compact -6.3% -9.3% +3.3% +11.2% ➖ noise
54 duckdb:vortex-file-compressed -13.0% -9.3% -4.1% +11.2% ➖ noise
55 datafusion:vortex-compact -6.1% -5.3% -0.8% +11.2% ➖ noise
55 datafusion:vortex-file-compressed -11.5% -5.3% -6.6% +13.6% ➖ noise
55 duckdb:duckdb -11.9% -5.3% -7.0% +17.1% ➖ noise
55 duckdb:vortex-compact -9.0% -5.3% -3.9% +13.2% ➖ noise
55 duckdb:vortex-file-compressed -14.9% -5.3% -10.1% +11.2% ✅ faster
56 datafusion:vortex-compact -3.3% -7.1% +4.0% +16.3% ➖ noise
56 datafusion:vortex-file-compressed -12.9% -7.1% -6.2% +11.2% ➖ noise
56 duckdb:duckdb -2.1% -7.1% +5.3% +11.2% ➖ noise
56 duckdb:vortex-compact -17.1% -7.1% -10.8% +11.2% ✅ faster
56 duckdb:vortex-file-compressed -11.6% -7.1% -4.9% +11.2% ➖ noise
57 datafusion:vortex-compact -8.7% -3.7% -5.1% +11.7% ➖ noise
57 datafusion:vortex-file-compressed -8.5% -3.7% -4.9% +11.2% ➖ noise
57 duckdb:duckdb -11.7% -3.7% -8.2% +11.2% ➖ noise
57 duckdb:vortex-compact -5.4% -3.7% -1.7% +13.7% ➖ noise
57 duckdb:vortex-file-compressed -9.7% -3.7% -6.2% +14.1% ➖ noise
58 datafusion:vortex-compact -4.8% -4.4% -0.4% +11.2% ➖ noise
58 datafusion:vortex-file-compressed -9.9% -4.4% -5.8% +13.3% ➖ noise
58 duckdb:duckdb -14.2% -4.4% -10.3% +18.3% ➖ noise
58 duckdb:vortex-compact -18.1% -4.4% -14.4% +24.7% ➖ noise
58 duckdb:vortex-file-compressed -11.5% -4.4% -7.4% +20.4% ➖ noise
59 datafusion:vortex-compact -4.2% -4.0% -0.2% +11.2% ➖ noise
59 datafusion:vortex-file-compressed -17.0% -4.0% -13.5% +11.7% ✅ faster
59 duckdb:duckdb -9.0% -4.0% -5.2% +11.2% ➖ noise
59 duckdb:vortex-compact -3.1% -4.0% +1.0% +11.2% ➖ noise
59 duckdb:vortex-file-compressed -10.0% -4.0% -6.3% +11.2% ➖ noise
60 datafusion:vortex-compact +0.5% -3.3% +4.0% +11.2% ➖ noise
60 datafusion:vortex-file-compressed -14.6% -3.3% -11.7% +12.0% ✅ faster
60 duckdb:duckdb -11.1% -3.3% -8.1% +11.2% ➖ noise
60 duckdb:vortex-compact -9.1% -3.3% -6.0% +11.2% ➖ noise
60 duckdb:vortex-file-compressed -17.3% -3.3% -14.5% +13.1% ✅ faster
61 datafusion:vortex-compact -1.9% -7.2% +5.7% +11.2% ➖ noise
61 datafusion:vortex-file-compressed -8.4% -7.2% -1.3% +11.2% ➖ noise
61 duckdb:duckdb -7.0% -7.2% +0.2% +11.2% ➖ noise
61 duckdb:vortex-compact -3.5% -7.2% +3.9% +13.2% ➖ noise
61 duckdb:vortex-file-compressed -7.2% -7.2% -0.1% +14.4% ➖ noise
62 datafusion:vortex-compact -4.8% -5.8% +1.0% +12.9% ➖ noise
62 datafusion:vortex-file-compressed -11.4% -5.8% -5.9% +11.3% ➖ noise
62 duckdb:duckdb -9.8% -5.8% -4.3% +25.5% ➖ noise
62 duckdb:vortex-compact -10.3% -5.8% -4.8% +22.6% ➖ noise
62 duckdb:vortex-file-compressed -9.1% -5.8% -3.5% +21.8% ➖ noise
63 datafusion:vortex-compact -7.9% -8.8% +1.0% +11.2% ➖ noise
63 datafusion:vortex-file-compressed -13.0% -8.8% -4.5% +11.2% ➖ noise
63 duckdb:duckdb -8.9% -8.8% -0.0% +11.2% ➖ noise
63 duckdb:vortex-compact -10.4% -8.8% -1.7% +11.2% ➖ noise
63 duckdb:vortex-file-compressed -11.3% -8.8% -2.7% +11.2% ➖ noise
64 datafusion:vortex-compact -7.8% -7.3% -0.5% +11.2% ➖ noise
64 datafusion:vortex-file-compressed -12.0% -7.3% -5.1% +11.2% ➖ noise
64 duckdb:duckdb -11.2% -7.3% -4.2% +11.2% ➖ noise
64 duckdb:vortex-compact -7.2% -7.3% +0.1% +11.2% ➖ noise
64 duckdb:vortex-file-compressed -12.7% -7.3% -5.8% +11.2% ➖ noise
65 datafusion:vortex-compact -8.2% -8.9% +0.8% +11.2% ➖ noise
65 datafusion:vortex-file-compressed -15.3% -8.9% -7.0% +11.3% ➖ noise
65 duckdb:duckdb -6.0% -8.9% +3.1% +13.7% ➖ noise
65 duckdb:vortex-compact -8.9% -8.9% -0.1% +14.6% ➖ noise
65 duckdb:vortex-file-compressed -5.4% -8.9% +3.8% +11.6% ➖ noise
66 datafusion:vortex-compact +1.7% -5.2% +7.2% +11.3% ➖ noise
66 datafusion:vortex-file-compressed -12.3% -5.2% -7.5% +11.2% ➖ noise
66 duckdb:duckdb -8.8% -5.2% -3.8% +11.2% ➖ noise
66 duckdb:vortex-compact -9.3% -5.2% -4.3% +11.2% ➖ noise
66 duckdb:vortex-file-compressed -2.5% -5.2% +2.8% +13.6% ➖ noise
67 datafusion:vortex-compact -9.0% -9.5% +0.5% +11.2% ➖ noise
67 datafusion:vortex-file-compressed -13.3% -9.5% -4.3% +11.2% ➖ noise
67 duckdb:duckdb -11.1% -9.5% -1.8% +11.2% ➖ noise
67 duckdb:vortex-compact -10.4% -9.5% -1.0% +11.2% ➖ noise
67 duckdb:vortex-file-compressed -12.7% -9.5% -3.5% +11.2% ➖ noise
68 datafusion:vortex-compact -12.3% -6.9% -5.8% +11.2% ➖ noise
68 datafusion:vortex-file-compressed -10.7% -6.9% -4.1% +11.2% ➖ noise
68 duckdb:duckdb -6.6% -6.9% +0.3% +13.1% ➖ noise
68 duckdb:vortex-compact -12.4% -6.9% -6.0% +11.2% ➖ noise
68 duckdb:vortex-file-compressed -8.5% -6.9% -1.8% +13.5% ➖ noise
69 datafusion:vortex-compact -4.4% -5.3% +0.9% +11.2% ➖ noise
69 datafusion:vortex-file-compressed -10.2% -5.3% -5.1% +11.2% ➖ noise
69 duckdb:duckdb -8.7% -5.3% -3.6% +12.5% ➖ noise
69 duckdb:vortex-compact -6.5% -5.3% -1.2% +11.2% ➖ noise
69 duckdb:vortex-file-compressed -9.4% -5.3% -4.3% +11.2% ➖ noise
70 datafusion:vortex-compact -9.6% -4.4% -5.4% +11.2% ➖ noise
70 datafusion:vortex-file-compressed -9.8% -4.4% -5.7% +11.2% ➖ noise
70 duckdb:duckdb -10.9% -4.4% -6.8% +16.0% ➖ noise
70 duckdb:vortex-compact -3.6% -4.4% +0.8% +11.2% ➖ noise
70 duckdb:vortex-file-compressed -5.9% -4.4% -1.6% +11.2% ➖ noise
71 datafusion:vortex-compact -11.0% -0.4% -10.6% +11.2% ✅ faster
71 datafusion:vortex-file-compressed -1.5% -0.4% -1.0% +11.2% ➖ noise
71 duckdb:duckdb -15.6% -0.4% -15.2% +11.2% ✅ faster
71 duckdb:vortex-compact -3.4% -0.4% -3.0% +12.5% ➖ noise
71 duckdb:vortex-file-compressed -11.3% -0.4% -10.9% +14.8% ➖ noise
72 datafusion:vortex-compact -16.6% -4.5% -12.7% +11.2% ✅ faster
72 datafusion:vortex-file-compressed -15.1% -4.5% -11.1% +11.2% ✅ faster
72 duckdb:duckdb -7.3% -4.5% -2.9% +11.6% ➖ noise
72 duckdb:vortex-compact -2.4% -4.5% +2.2% +11.2% ➖ noise
72 duckdb:vortex-file-compressed -6.2% -4.5% -1.8% +11.2% ➖ noise
73 datafusion:vortex-compact -9.1% -1.0% -8.2% +17.0% ➖ noise
73 datafusion:vortex-file-compressed -3.7% -1.0% -2.8% +17.0% ➖ noise
73 duckdb:duckdb -16.7% -1.0% -15.8% +12.9% ✅ faster
73 duckdb:vortex-compact -9.2% -1.0% -8.3% +11.2% ➖ noise
73 duckdb:vortex-file-compressed -8.4% -1.0% -7.5% +11.2% ➖ noise
74 datafusion:vortex-compact -15.2% -8.4% -7.5% +11.2% ➖ noise
74 datafusion:vortex-file-compressed -13.5% -8.4% -5.6% +11.2% ➖ noise
74 duckdb:duckdb -9.0% -8.4% -0.7% +11.2% ➖ noise
74 duckdb:vortex-compact -11.4% -8.4% -3.3% +11.2% ➖ noise
74 duckdb:vortex-file-compressed -6.4% -8.4% +2.1% +14.0% ➖ noise
75 datafusion:vortex-compact -10.0% -7.5% -2.7% +11.2% ➖ noise
75 datafusion:vortex-file-compressed -11.1% -7.5% -3.9% +11.2% ➖ noise
75 duckdb:duckdb -8.5% -7.5% -1.1% +11.2% ➖ noise
75 duckdb:vortex-compact -13.4% -7.5% -6.4% +12.6% ➖ noise
75 duckdb:vortex-file-compressed -9.0% -7.5% -1.6% +11.2% ➖ noise
76 datafusion:vortex-compact -10.6% -12.0% +1.6% +11.2% ➖ noise
76 datafusion:vortex-file-compressed -6.8% -12.0% +6.0% +12.2% ➖ noise
76 duckdb:duckdb +1.0% -12.0% +14.8% +16.9% ➖ noise
76 duckdb:vortex-compact -20.4% -12.0% -9.5% +13.5% ➖ noise
76 duckdb:vortex-file-compressed -26.2% -12.0% -16.1% +19.8% ➖ noise
77 datafusion:vortex-compact -8.2% -6.6% -1.7% +11.2% ➖ noise
77 datafusion:vortex-file-compressed -12.9% -6.6% -6.7% +11.2% ➖ noise
77 duckdb:duckdb -4.6% -6.6% +2.2% +11.2% ➖ noise
77 duckdb:vortex-compact -7.4% -6.6% -0.9% +11.2% ➖ noise
77 duckdb:vortex-file-compressed -17.0% -6.6% -11.2% +13.9% ➖ noise
78 datafusion:vortex-compact -8.1% -10.2% +2.4% +11.2% ➖ noise
78 datafusion:vortex-file-compressed -15.9% -10.2% -6.3% +11.2% ➖ noise
78 duckdb:duckdb -7.8% -10.2% +2.7% +11.2% ➖ noise
78 duckdb:vortex-compact -8.9% -10.2% +1.5% +11.2% ➖ noise
78 duckdb:vortex-file-compressed -11.6% -10.2% -1.5% +14.3% ➖ noise
79 datafusion:vortex-compact -10.4% -8.9% -1.7% +11.2% ➖ noise
79 datafusion:vortex-file-compressed -13.1% -8.9% -4.7% +11.2% ➖ noise
79 duckdb:duckdb -12.1% -8.9% -3.5% +11.2% ➖ noise
79 duckdb:vortex-compact -7.8% -8.9% +1.2% +13.8% ➖ noise
79 duckdb:vortex-file-compressed -6.2% -8.9% +3.0% +15.2% ➖ noise
80 datafusion:vortex-compact -12.8% -8.7% -4.5% +11.2% ➖ noise
80 datafusion:vortex-file-compressed -10.1% -8.7% -1.6% +11.2% ➖ noise
80 duckdb:duckdb -9.9% -8.7% -1.3% +15.3% ➖ noise
80 duckdb:vortex-compact -14.4% -8.7% -6.3% +11.2% ➖ noise
80 duckdb:vortex-file-compressed -13.7% -8.7% -5.5% +11.2% ➖ noise
81 datafusion:vortex-compact -11.9% -5.3% -6.9% +14.2% ➖ noise
81 datafusion:vortex-file-compressed -6.8% -5.3% -1.5% +15.8% ➖ noise
81 duckdb:duckdb -2.3% -5.3% +3.2% +11.2% ➖ noise
81 duckdb:vortex-compact -11.6% -5.3% -6.6% +12.7% ➖ noise
81 duckdb:vortex-file-compressed -11.3% -5.3% -6.3% +13.7% ➖ noise
82 datafusion:vortex-compact -9.0% -1.9% -7.3% +11.2% ➖ noise
82 datafusion:vortex-file-compressed -8.5% -1.9% -6.7% +12.9% ➖ noise
82 duckdb:duckdb -6.1% -1.9% -4.4% +11.2% ➖ noise
82 duckdb:vortex-compact -9.7% -1.9% -8.0% +11.2% ➖ noise
82 duckdb:vortex-file-compressed -12.7% -1.9% -11.0% +11.8% ✅ faster
83 datafusion:vortex-compact -7.7% -4.3% -3.6% +11.2% ➖ noise
83 datafusion:vortex-file-compressed -9.5% -4.3% -5.4% +11.2% ➖ noise
83 duckdb:duckdb -8.4% -4.3% -4.2% +11.2% ➖ noise
83 duckdb:vortex-compact -2.9% -4.3% +1.4% +11.2% ➖ noise
83 duckdb:vortex-file-compressed -9.4% -4.3% -5.3% +11.2% ➖ noise
84 datafusion:vortex-compact -14.0% -2.5% -11.9% +11.2% ✅ faster
84 datafusion:vortex-file-compressed -15.0% -2.5% -12.9% +11.2% ✅ faster
84 duckdb:duckdb -8.2% -2.5% -5.9% +11.2% ➖ noise
84 duckdb:vortex-compact -16.0% -2.5% -13.8% +11.2% ✅ faster
84 duckdb:vortex-file-compressed -7.2% -2.5% -4.8% +11.2% ➖ noise
85 datafusion:vortex-compact -8.5% -7.7% -0.9% +11.2% ➖ noise
85 datafusion:vortex-file-compressed -6.9% -7.7% +0.9% +11.2% ➖ noise
85 duckdb:duckdb -11.3% -7.7% -4.0% +17.1% ➖ noise
85 duckdb:vortex-compact -8.9% -7.7% -1.3% +11.2% ➖ noise
85 duckdb:vortex-file-compressed -9.6% -7.7% -2.1% +11.2% ➖ noise
86 datafusion:vortex-compact -10.8% -9.8% -1.1% +12.1% ➖ noise
86 datafusion:vortex-file-compressed -3.3% -9.8% +7.3% +11.2% ➖ noise
86 duckdb:duckdb -6.2% -9.8% +4.1% +17.5% ➖ noise
86 duckdb:vortex-compact -9.4% -9.8% +0.5% +17.6% ➖ noise
86 duckdb:vortex-file-compressed -14.7% -9.8% -5.4% +13.4% ➖ noise
87 datafusion:vortex-compact -11.7% -7.2% -4.8% +11.2% ➖ noise
87 datafusion:vortex-file-compressed -8.5% -7.2% -1.4% +11.2% ➖ noise
87 duckdb:duckdb -5.1% -7.2% +2.3% +11.5% ➖ noise
87 duckdb:vortex-compact -10.0% -7.2% -3.0% +11.2% ➖ noise
87 duckdb:vortex-file-compressed -9.9% -7.2% -2.9% +11.9% ➖ noise
88 datafusion:vortex-compact -8.8% -7.0% -2.0% +11.2% ➖ noise
88 datafusion:vortex-file-compressed -11.8% -7.0% -5.2% +11.2% ➖ noise
88 duckdb:duckdb -5.7% -7.0% +1.3% +11.2% ➖ noise
88 duckdb:vortex-compact -6.6% -7.0% +0.4% +11.2% ➖ noise
88 duckdb:vortex-file-compressed -8.1% -7.0% -1.2% +11.2% ➖ noise
89 datafusion:vortex-compact -13.0% -12.4% -0.7% +15.6% ➖ noise
89 datafusion:vortex-file-compressed -15.2% -12.4% -3.2% +15.8% ➖ noise
89 duckdb:duckdb -7.5% -12.4% +5.6% +39.5% ➖ noise
89 duckdb:vortex-compact -6.8% -12.4% +6.4% +15.0% ➖ noise
89 duckdb:vortex-file-compressed -7.2% -12.4% +6.0% +18.2% ➖ noise
90 datafusion:vortex-compact -9.4% -11.0% +1.9% +11.2% ➖ noise
90 datafusion:vortex-file-compressed -8.6% -11.0% +2.7% +11.2% ➖ noise
90 duckdb:duckdb -9.9% -11.0% +1.3% +11.2% ➖ noise
90 duckdb:vortex-compact -8.3% -11.0% +3.1% +12.4% ➖ noise
90 duckdb:vortex-file-compressed -8.8% -11.0% +2.5% +11.2% ➖ noise
91 datafusion:vortex-compact -12.4% -3.6% -9.1% +11.2% ➖ noise
91 datafusion:vortex-file-compressed -11.3% -3.6% -8.0% +11.2% ➖ noise
91 duckdb:duckdb -12.0% -3.6% -8.7% +15.6% ➖ noise
91 duckdb:vortex-compact -8.8% -3.6% -5.4% +11.2% ➖ noise
91 duckdb:vortex-file-compressed -12.1% -3.6% -8.8% +11.2% ➖ noise
92 datafusion:vortex-compact -9.5% -15.3% +6.8% +11.2% ➖ noise
92 datafusion:vortex-file-compressed -6.1% -15.3% +10.9% +11.2% ➖ noise
92 duckdb:duckdb -11.2% -15.3% +4.8% +12.7% ➖ noise
92 duckdb:vortex-compact -13.4% -15.3% +2.2% +12.4% ➖ noise
92 duckdb:vortex-file-compressed -8.3% -15.3% +8.3% +14.6% ➖ noise
93 datafusion:vortex-compact -10.3% -9.3% -1.2% +15.1% ➖ noise
93 datafusion:vortex-file-compressed -12.7% -9.3% -3.7% +16.5% ➖ noise
93 duckdb:duckdb -21.9% -9.3% -14.0% +21.0% ➖ noise
93 duckdb:vortex-compact -9.7% -9.3% -0.4% +20.0% ➖ noise
93 duckdb:vortex-file-compressed -13.6% -9.3% -4.7% +18.9% ➖ noise
94 datafusion:vortex-compact -12.1% -7.6% -4.8% +11.2% ➖ noise
94 datafusion:vortex-file-compressed -8.8% -7.6% -1.3% +11.2% ➖ noise
94 duckdb:duckdb -2.0% -7.6% +6.1% +16.9% ➖ noise
94 duckdb:vortex-compact -14.9% -7.6% -7.8% +15.8% ➖ noise
94 duckdb:vortex-file-compressed -14.1% -7.6% -7.0% +11.2% ➖ noise
95 datafusion:vortex-compact -8.8% -15.4% +7.8% +11.2% ➖ noise
95 datafusion:vortex-file-compressed -6.2% -15.4% +10.9% +11.2% ➖ noise
95 duckdb:duckdb -15.6% -15.4% -0.2% +19.2% ➖ noise
95 duckdb:vortex-compact -13.1% -15.4% +2.7% +16.4% ➖ noise
95 duckdb:vortex-file-compressed -2.1% -15.4% +15.8% +13.0% 🚨 regression
96 datafusion:vortex-compact -3.9% -11.0% +8.0% +11.2% ➖ noise
96 datafusion:vortex-file-compressed -10.5% -11.0% +0.5% +12.2% ➖ noise
96 duckdb:duckdb -10.3% -11.0% +0.7% +16.9% ➖ noise
96 duckdb:vortex-compact -11.0% -11.0% +0.0% +12.2% ➖ noise
96 duckdb:vortex-file-compressed -11.7% -11.0% -0.8% +12.0% ➖ noise
97 datafusion:vortex-compact -7.5% -10.2% +3.0% +11.2% ➖ noise
97 datafusion:vortex-file-compressed -12.9% -10.2% -3.0% +11.3% ➖ noise
97 duckdb:duckdb -16.4% -10.2% -6.9% +22.0% ➖ noise
97 duckdb:vortex-compact -8.6% -10.2% +1.8% +14.8% ➖ noise
97 duckdb:vortex-file-compressed -15.2% -10.2% -5.5% +12.3% ➖ noise
98 datafusion:vortex-compact -13.0% -3.0% -10.4% +15.1% ➖ noise
98 datafusion:vortex-file-compressed -19.2% -3.0% -16.7% +11.2% ✅ faster
98 duckdb:duckdb -9.6% -3.0% -6.8% +16.9% ➖ noise
98 duckdb:vortex-compact -14.4% -3.0% -11.8% +14.2% ➖ noise
98 duckdb:vortex-file-compressed -18.3% -3.0% -15.8% +12.8% ✅ faster
99 datafusion:vortex-compact -4.0% -15.8% +14.0% +21.6% ➖ noise
99 datafusion:vortex-file-compressed -17.3% -15.8% -1.8% +20.4% ➖ noise
99 duckdb:duckdb -5.7% -15.8% +12.0% +34.0% ➖ noise
99 duckdb:vortex-compact -6.1% -15.8% +11.5% +20.6% ➖ noise
99 duckdb:vortex-file-compressed -6.8% -15.8% +10.7% +30.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Vortex (geomean): 0.986x ➖
Parquet (geomean): 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish -1.5%


datafusion / vortex-file-compressed (0.979x ➖, 2↑ 1↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 407871792 406811136 1.00
tpch_q02/datafusion:vortex-file-compressed 114472048 117240232 0.98
tpch_q03/datafusion:vortex-file-compressed 201851172 204041758 0.99
tpch_q04/datafusion:vortex-file-compressed 99554025 101562818 0.98
tpch_q05/datafusion:vortex-file-compressed 376559641 393795607 0.96
tpch_q06/datafusion:vortex-file-compressed 40179749 41937258 0.96
tpch_q07/datafusion:vortex-file-compressed 559006033 614691866 0.91
tpch_q08/datafusion:vortex-file-compressed 373764228 383437584 0.97
tpch_q09/datafusion:vortex-file-compressed 660827655 684787555 0.97
tpch_q10/datafusion:vortex-file-compressed 🚀 231264756 259333981 0.89
tpch_q11/datafusion:vortex-file-compressed 87826557 88832864 0.99
tpch_q12/datafusion:vortex-file-compressed 108327721 109045919 0.99
tpch_q13/datafusion:vortex-file-compressed 221413315 226542508 0.98
tpch_q14/datafusion:vortex-file-compressed 58270187 57518713 1.01
tpch_q15/datafusion:vortex-file-compressed 107555517 107630282 1.00
tpch_q16/datafusion:vortex-file-compressed 75745033 79489450 0.95
tpch_q17/datafusion:vortex-file-compressed 644752844 682806456 0.94
tpch_q18/datafusion:vortex-file-compressed 878748907 891839024 0.99
tpch_q19/datafusion:vortex-file-compressed 🚨 134642549 101792202 1.32
tpch_q20/datafusion:vortex-file-compressed 🚀 167983157 194499595 0.86
tpch_q21/datafusion:vortex-file-compressed 656801367 686803145 0.96
tpch_q22/datafusion:vortex-file-compressed 61301174 61377849 1.00
datafusion / vortex-compact (0.971x ➖, 3↑ 2↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 443476709 452271283 0.98
tpch_q02/datafusion:vortex-compact 118124183 125682303 0.94
tpch_q03/datafusion:vortex-compact 216324451 231399191 0.93
tpch_q04/datafusion:vortex-compact 🚀 120660951 143333501 0.84
tpch_q05/datafusion:vortex-compact 390040405 429051756 0.91
tpch_q06/datafusion:vortex-compact 64636376 64596047 1.00
tpch_q07/datafusion:vortex-compact 585672509 611652760 0.96
tpch_q08/datafusion:vortex-compact 385667782 394104206 0.98
tpch_q09/datafusion:vortex-compact 681777810 709359205 0.96
tpch_q10/datafusion:vortex-compact 277095926 281579377 0.98
tpch_q11/datafusion:vortex-compact 🚀 89813272 112626212 0.80
tpch_q12/datafusion:vortex-compact 🚀 168179652 205708714 0.82
tpch_q13/datafusion:vortex-compact 270184673 292611673 0.92
tpch_q14/datafusion:vortex-compact 74608509 81674930 0.91
tpch_q15/datafusion:vortex-compact 165829185 171571903 0.97
tpch_q16/datafusion:vortex-compact 82457699 84172832 0.98
tpch_q17/datafusion:vortex-compact 🚨 716473471 644010984 1.11
tpch_q18/datafusion:vortex-compact 885035023 883694525 1.00
tpch_q19/datafusion:vortex-compact 🚨 220265181 141707167 1.55
tpch_q20/datafusion:vortex-compact 198415113 195339243 1.02
tpch_q21/datafusion:vortex-compact 696666928 699974288 1.00
tpch_q22/datafusion:vortex-compact 71347129 71911030 0.99
datafusion / parquet (0.973x ➖, 1↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 412568334 450798500 0.92
tpch_q02/datafusion:parquet 186598117 192918350 0.97
tpch_q03/datafusion:parquet 293927360 302511615 0.97
tpch_q04/datafusion:parquet 132548023 145035660 0.91
tpch_q05/datafusion:parquet 442750502 457565938 0.97
tpch_q06/datafusion:parquet 124933499 127709669 0.98
tpch_q07/datafusion:parquet 631139602 639711494 0.99
tpch_q08/datafusion:parquet 482762641 498846213 0.97
tpch_q09/datafusion:parquet 751780820 771239729 0.97
tpch_q10/datafusion:parquet 507885367 505086927 1.01
tpch_q11/datafusion:parquet 129892903 131170617 0.99
tpch_q12/datafusion:parquet 208795180 210322606 0.99
tpch_q13/datafusion:parquet 339966142 337742128 1.01
tpch_q14/datafusion:parquet 159862174 153564563 1.04
tpch_q15/datafusion:parquet 245947191 239015291 1.03
tpch_q16/datafusion:parquet 132910576 136478728 0.97
tpch_q17/datafusion:parquet 678585747 682796226 0.99
tpch_q18/datafusion:parquet 879269735 895402657 0.98
tpch_q19/datafusion:parquet 276411880 279916414 0.99
tpch_q20/datafusion:parquet 305105264 327864235 0.93
tpch_q21/datafusion:parquet 🚀 733952890 848973791 0.86
tpch_q22/datafusion:parquet 213646388 216056684 0.99
datafusion / arrow (0.958x ➖, 3↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 599074562 601281940 1.00
tpch_q02/datafusion:arrow 161037088 166490095 0.97
tpch_q03/datafusion:arrow 455068981 481412738 0.95
tpch_q04/datafusion:arrow 341117533 364790716 0.94
tpch_q05/datafusion:arrow 898201763 959883485 0.94
tpch_q06/datafusion:arrow 271223353 278733017 0.97
tpch_q07/datafusion:arrow 1119132356 1143687092 0.98
tpch_q08/datafusion:arrow 1109555169 1129075395 0.98
tpch_q09/datafusion:arrow 1317448292 1336646532 0.99
tpch_q10/datafusion:arrow 🚀 600933119 670428690 0.90
tpch_q11/datafusion:arrow 🚀 150112888 172859831 0.87
tpch_q12/datafusion:arrow 663500487 677232690 0.98
tpch_q13/datafusion:arrow 523079687 540816132 0.97
tpch_q14/datafusion:arrow 307093765 329833838 0.93
tpch_q15/datafusion:arrow 🚀 651434250 729382499 0.89
tpch_q16/datafusion:arrow 103928824 111814560 0.93
tpch_q17/datafusion:arrow 1301258472 1354201716 0.96
tpch_q18/datafusion:arrow 1796136928 1904377900 0.94
tpch_q19/datafusion:arrow 503630869 492919320 1.02
tpch_q20/datafusion:arrow 489721464 475534711 1.03
tpch_q21/datafusion:arrow 2798927727 2873218385 0.97
tpch_q22/datafusion:arrow 140458243 141957598 0.99
duckdb / vortex-file-compressed (0.998x ➖, 0↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 174838898 176420001 0.99
tpch_q02/duckdb:vortex-file-compressed 53772509 51025356 1.05
tpch_q03/duckdb:vortex-file-compressed 125677058 125828377 1.00
tpch_q04/duckdb:vortex-file-compressed 146055982 150007150 0.97
tpch_q05/duckdb:vortex-file-compressed 129366396 132552259 0.98
tpch_q06/duckdb:vortex-file-compressed 47945876 50165937 0.96
tpch_q07/duckdb:vortex-file-compressed 147487263 147801446 1.00
tpch_q08/duckdb:vortex-file-compressed 175881075 171369412 1.03
tpch_q09/duckdb:vortex-file-compressed 335807119 334830738 1.00
tpch_q10/duckdb:vortex-file-compressed 150777935 152652055 0.99
tpch_q11/duckdb:vortex-file-compressed 35750793 35065137 1.02
tpch_q12/duckdb:vortex-file-compressed 91108058 88212799 1.03
tpch_q13/duckdb:vortex-file-compressed 246623062 248821040 0.99
tpch_q14/duckdb:vortex-file-compressed 67307979 69665318 0.97
tpch_q15/duckdb:vortex-file-compressed 96449434 97527172 0.99
tpch_q16/duckdb:vortex-file-compressed 77780386 78285758 0.99
tpch_q17/duckdb:vortex-file-compressed 102335918 102304588 1.00
tpch_q18/duckdb:vortex-file-compressed 280200549 280888062 1.00
tpch_q19/duckdb:vortex-file-compressed 90939522 89940043 1.01
tpch_q20/duckdb:vortex-file-compressed 166996182 166313412 1.00
tpch_q21/duckdb:vortex-file-compressed 557207072 556048147 1.00
tpch_q22/duckdb:vortex-file-compressed 77035278 77325352 1.00
duckdb / vortex-compact (0.995x ➖, 0↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 228768092 229485609 1.00
tpch_q02/duckdb:vortex-compact 59014057 58553960 1.01
tpch_q03/duckdb:vortex-compact 139540094 141006800 0.99
tpch_q04/duckdb:vortex-compact 174586460 176866636 0.99
tpch_q05/duckdb:vortex-compact 146255559 148606041 0.98
tpch_q06/duckdb:vortex-compact 86260646 85937052 1.00
tpch_q07/duckdb:vortex-compact 203927274 207752850 0.98
tpch_q08/duckdb:vortex-compact 190070775 190865699 1.00
tpch_q09/duckdb:vortex-compact 359835208 362869414 0.99
tpch_q10/duckdb:vortex-compact 185181647 186561128 0.99
tpch_q11/duckdb:vortex-compact 41815518 42371628 0.99
tpch_q12/duckdb:vortex-compact 207849075 209343964 0.99
tpch_q13/duckdb:vortex-compact 295373660 295648527 1.00
tpch_q14/duckdb:vortex-compact 102239782 103319360 0.99
tpch_q15/duckdb:vortex-compact 119526833 120945002 0.99
tpch_q16/duckdb:vortex-compact 85039088 85563587 0.99
tpch_q17/duckdb:vortex-compact 115577375 117310160 0.99
tpch_q18/duckdb:vortex-compact 298464802 290051163 1.03
tpch_q19/duckdb:vortex-compact 116248981 115278865 1.01
tpch_q20/duckdb:vortex-compact 207753593 208454445 1.00
tpch_q21/duckdb:vortex-compact 628191497 630954558 1.00
tpch_q22/duckdb:vortex-compact 90408868 90195830 1.00
duckdb / parquet (1.002x ➖, 0↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 278841206 262088844 1.06
tpch_q02/duckdb:parquet 97469881 95694452 1.02
tpch_q03/duckdb:parquet 213540034 210994881 1.01
tpch_q04/duckdb:parquet 134534364 131148249 1.03
tpch_q05/duckdb:parquet 220172795 218615408 1.01
tpch_q06/duckdb:parquet 67040604 69158391 0.97
tpch_q07/duckdb:parquet 179073712 178539378 1.00
tpch_q08/duckdb:parquet 250762544 253964871 0.99
tpch_q09/duckdb:parquet 454249069 457988086 0.99
tpch_q10/duckdb:parquet 606565051 609761121 0.99
tpch_q11/duckdb:parquet 40421890 40519958 1.00
tpch_q12/duckdb:parquet 125009529 128548490 0.97
tpch_q13/duckdb:parquet 439225181 408572042 1.08
tpch_q14/duckdb:parquet 174544378 176881131 0.99
tpch_q15/duckdb:parquet 98100570 98836021 0.99
tpch_q16/duckdb:parquet 164413549 155639796 1.06
tpch_q17/duckdb:parquet 176956390 177891173 0.99
tpch_q18/duckdb:parquet 348841235 350874212 0.99
tpch_q19/duckdb:parquet 277834900 285658284 0.97
tpch_q20/duckdb:parquet 224250612 231005048 0.97
tpch_q21/duckdb:parquet 565453684 571109595 0.99
tpch_q22/duckdb:parquet 288556240 293479894 0.98
duckdb / duckdb (0.999x ➖, 0↑ 1↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 115954508 117821551 0.98
tpch_q02/duckdb:duckdb 46927515 45453413 1.03
tpch_q03/duckdb:duckdb 95668224 96887652 0.99
tpch_q04/duckdb:duckdb 131656099 131174243 1.00
tpch_q05/duckdb:duckdb 107880002 108085878 1.00
tpch_q06/duckdb:duckdb 38507126 39332524 0.98
tpch_q07/duckdb:duckdb 85268738 85792544 0.99
tpch_q08/duckdb:duckdb 108700691 110142557 0.99
tpch_q09/duckdb:duckdb 277558557 277852212 1.00
tpch_q10/duckdb:duckdb 206103286 201125679 1.02
tpch_q11/duckdb:duckdb 15069363 15881741 0.95
tpch_q12/duckdb:duckdb 83562528 82609754 1.01
tpch_q13/duckdb:duckdb 249216532 251875864 0.99
tpch_q14/duckdb:duckdb 69797848 71338753 0.98
tpch_q15/duckdb:duckdb 78565132 79259543 0.99
tpch_q16/duckdb:duckdb 73324183 73122922 1.00
tpch_q17/duckdb:duckdb 84219849 84293671 1.00
tpch_q18/duckdb:duckdb 213817990 213344955 1.00
tpch_q19/duckdb:duckdb 114389056 115057004 0.99
tpch_q20/duckdb:duckdb 111295417 111488921 1.00
tpch_q21/duckdb:duckdb 298961819 306915832 0.97
tpch_q22/duckdb:duckdb 🚨 70963441 63836878 1.11
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -0.4% -1.3% +1.0% +10.0% ➖ noise
1 datafusion:vortex-compact -1.9% -1.3% -0.6% +10.9% ➖ noise
1 datafusion:vortex-file-compressed +0.3% -1.3% +1.6% +10.0% ➖ noise
1 duckdb:duckdb -1.6% -1.3% -0.3% +10.0% ➖ noise
1 duckdb:vortex-compact -0.3% -1.3% +1.0% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.9% -1.3% +0.4% +10.0% ➖ noise
2 datafusion:arrow -3.3% -0.7% -2.6% +10.0% ➖ noise
2 datafusion:vortex-compact -6.0% -0.7% -5.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -2.4% -0.7% -1.6% +10.0% ➖ noise
2 duckdb:duckdb +3.2% -0.7% +4.0% +12.1% ➖ noise
2 duckdb:vortex-compact +0.8% -0.7% +1.5% +11.9% ➖ noise
2 duckdb:vortex-file-compressed +5.4% -0.7% +6.2% +12.2% ➖ noise
3 datafusion:arrow -5.5% -0.8% -4.7% +10.0% ➖ noise
3 datafusion:vortex-compact -6.5% -0.8% -5.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -1.1% -0.8% -0.2% +10.0% ➖ noise
3 duckdb:duckdb -1.3% -0.8% -0.4% +10.0% ➖ noise
3 duckdb:vortex-compact -1.0% -0.8% -0.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.1% -0.8% +0.7% +10.0% ➖ noise
4 datafusion:arrow -6.5% -3.2% -3.4% +10.0% ➖ noise
4 datafusion:vortex-compact -15.8% -3.2% -13.1% +11.3% ✅ faster
4 datafusion:vortex-file-compressed -2.0% -3.2% +1.2% +10.0% ➖ noise
4 duckdb:duckdb +0.4% -3.2% +3.7% +10.0% ➖ noise
4 duckdb:vortex-compact -1.3% -3.2% +1.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.6% -3.2% +0.6% +10.0% ➖ noise
5 datafusion:arrow -6.4% -1.3% -5.2% +10.0% ➖ noise
5 datafusion:vortex-compact -9.1% -1.3% -7.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -4.4% -1.3% -3.1% +10.0% ➖ noise
5 duckdb:duckdb -0.2% -1.3% +1.1% +10.0% ➖ noise
5 duckdb:vortex-compact -1.6% -1.3% -0.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.4% -1.3% -1.1% +10.0% ➖ noise
6 datafusion:arrow -2.7% -2.6% -0.1% +10.0% ➖ noise
6 datafusion:vortex-compact +0.1% -2.6% +2.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -4.2% -2.6% -1.6% +10.0% ➖ noise
6 duckdb:duckdb -2.1% -2.6% +0.5% +15.8% ➖ noise
6 duckdb:vortex-compact +0.4% -2.6% +3.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -4.4% -2.6% -1.9% +11.9% ➖ noise
7 datafusion:arrow -2.1% -0.5% -1.6% +10.0% ➖ noise
7 datafusion:vortex-compact -4.2% -0.5% -3.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -9.1% -0.5% -8.6% +10.0% ➖ noise
7 duckdb:duckdb -0.6% -0.5% -0.1% +10.4% ➖ noise
7 duckdb:vortex-compact -1.8% -0.5% -1.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.2% -0.5% +0.3% +10.0% ➖ noise
8 datafusion:arrow -1.7% -2.2% +0.5% +10.0% ➖ noise
8 datafusion:vortex-compact -2.1% -2.2% +0.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -2.5% -2.2% -0.3% +10.0% ➖ noise
8 duckdb:duckdb -1.3% -2.2% +1.0% +10.0% ➖ noise
8 duckdb:vortex-compact -0.4% -2.2% +1.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.6% -2.2% +5.0% +10.0% ➖ noise
9 datafusion:arrow -1.4% -1.7% +0.2% +10.0% ➖ noise
9 datafusion:vortex-compact -3.9% -1.7% -2.3% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -3.5% -1.7% -1.9% +10.0% ➖ noise
9 duckdb:duckdb -0.1% -1.7% +1.6% +10.0% ➖ noise
9 duckdb:vortex-compact -0.8% -1.7% +0.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.3% -1.7% +2.0% +10.0% ➖ noise
10 datafusion:arrow -10.4% +0.0% -10.4% +10.0% ✅ faster
10 datafusion:vortex-compact -1.6% +0.0% -1.6% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -10.8% +0.0% -10.8% +10.0% ✅ faster
10 duckdb:duckdb +2.5% +0.0% +2.5% +10.0% ➖ noise
10 duckdb:vortex-compact -0.7% +0.0% -0.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.2% +0.0% -1.2% +10.0% ➖ noise
11 datafusion:arrow -13.2% -0.6% -12.6% +10.2% ✅ faster
11 datafusion:vortex-compact -20.3% -0.6% -19.8% +13.3% ✅ faster
11 datafusion:vortex-file-compressed -1.1% -0.6% -0.5% +11.1% ➖ noise
11 duckdb:duckdb -5.1% -0.6% -4.5% +18.8% ➖ noise
11 duckdb:vortex-compact -1.3% -0.6% -0.7% +12.0% ➖ noise
11 duckdb:vortex-file-compressed +2.0% -0.6% +2.6% +12.7% ➖ noise
12 datafusion:arrow -2.0% -1.7% -0.3% +54.1% ➖ noise
12 datafusion:vortex-compact -18.2% -1.7% -16.8% +10.0% ✅ faster
12 datafusion:vortex-file-compressed -0.7% -1.7% +1.1% +10.0% ➖ noise
12 duckdb:duckdb +1.2% -1.7% +2.9% +10.0% ➖ noise
12 duckdb:vortex-compact -0.7% -1.7% +1.0% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +3.3% -1.7% +5.1% +10.0% ➖ noise
13 datafusion:arrow -3.3% +4.0% -7.0% +11.4% ➖ noise
13 datafusion:vortex-compact -7.7% +4.0% -11.2% +10.0% ✅ faster
13 datafusion:vortex-file-compressed -2.3% +4.0% -6.0% +10.0% ➖ noise
13 duckdb:duckdb -1.1% +4.0% -4.9% +10.0% ➖ noise
13 duckdb:vortex-compact -0.1% +4.0% -4.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.9% +4.0% -4.7% +10.0% ➖ noise
14 datafusion:arrow -6.9% +1.4% -8.1% +10.0% ➖ noise
14 datafusion:vortex-compact -8.7% +1.4% -9.9% +10.0% ✅ faster
14 datafusion:vortex-file-compressed +1.3% +1.4% -0.0% +12.9% ➖ noise
14 duckdb:duckdb -2.2% +1.4% -3.5% +10.0% ➖ noise
14 duckdb:vortex-compact -1.0% +1.4% -2.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -3.4% +1.4% -4.7% +10.4% ➖ noise
15 datafusion:arrow -10.7% +1.1% -11.6% +10.0% ✅ faster
15 datafusion:vortex-compact -3.3% +1.1% -4.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.1% +1.1% -1.1% +10.0% ➖ noise
15 duckdb:duckdb -0.9% +1.1% -1.9% +10.0% ➖ noise
15 duckdb:vortex-compact -1.2% +1.1% -2.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.1% +1.1% -2.1% +10.0% ➖ noise
16 datafusion:arrow -7.1% +1.4% -8.4% +10.7% ➖ noise
16 datafusion:vortex-compact -2.0% +1.4% -3.4% +11.4% ➖ noise
16 datafusion:vortex-file-compressed -4.7% +1.4% -6.1% +10.7% ➖ noise
16 duckdb:duckdb +0.3% +1.4% -1.1% +10.4% ➖ noise
16 duckdb:vortex-compact -0.6% +1.4% -2.0% +10.8% ➖ noise
16 duckdb:vortex-file-compressed -0.6% +1.4% -2.0% +12.1% ➖ noise
17 datafusion:arrow -3.9% -0.6% -3.4% +10.0% ➖ noise
17 datafusion:vortex-compact +11.3% -0.6% +11.9% +10.0% 🚨 regression
17 datafusion:vortex-file-compressed -5.6% -0.6% -5.0% +10.0% ➖ noise
17 duckdb:duckdb -0.1% -0.6% +0.5% +10.0% ➖ noise
17 duckdb:vortex-compact -1.5% -0.6% -0.9% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +0.0% -0.6% +0.6% +10.0% ➖ noise
18 datafusion:arrow -5.7% -1.2% -4.5% +10.1% ➖ noise
18 datafusion:vortex-compact +0.2% -1.2% +1.4% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -1.5% -1.2% -0.3% +10.0% ➖ noise
18 duckdb:duckdb +0.2% -1.2% +1.4% +10.0% ➖ noise
18 duckdb:vortex-compact +2.9% -1.2% +4.1% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.2% -1.2% +1.0% +10.0% ➖ noise
19 datafusion:arrow +2.2% -2.0% +4.3% +10.0% ➖ noise
19 datafusion:vortex-compact +55.4% -2.0% +58.6% +10.0% 🚨 regression
19 datafusion:vortex-file-compressed +32.3% -2.0% +35.0% +10.0% 🚨 regression
19 duckdb:duckdb -0.6% -2.0% +1.4% +10.0% ➖ noise
19 duckdb:vortex-compact +0.8% -2.0% +2.9% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +1.1% -2.0% +3.2% +10.0% ➖ noise
20 datafusion:arrow +3.0% -5.0% +8.4% +10.0% ➖ noise
20 datafusion:vortex-compact +1.6% -5.0% +6.9% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -13.6% -5.0% -9.1% +10.0% ✅ faster
20 duckdb:duckdb -0.2% -5.0% +5.0% +10.0% ➖ noise
20 duckdb:vortex-compact -0.3% -5.0% +4.9% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +0.4% -5.0% +5.6% +10.0% ➖ noise
21 datafusion:arrow -2.6% -7.5% +5.3% +10.0% ➖ noise
21 datafusion:vortex-compact -0.5% -7.5% +7.6% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -4.4% -7.5% +3.4% +10.0% ➖ noise
21 duckdb:duckdb -2.6% -7.5% +5.3% +10.0% ➖ noise
21 duckdb:vortex-compact -0.4% -7.5% +7.6% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +0.2% -7.5% +8.3% +10.0% ➖ noise
22 datafusion:arrow -1.1% -1.4% +0.3% +10.0% ➖ noise
22 datafusion:vortex-compact -0.8% -1.4% +0.6% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -0.1% -1.4% +1.3% +10.0% ➖ noise
22 duckdb:duckdb +11.2% -1.4% +12.7% +11.7% 🚨 regression
22 duckdb:vortex-compact +0.2% -1.4% +1.7% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -0.4% -1.4% +1.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -9.9%
Vortex (geomean): 0.986x ➖
Parquet (geomean): 1.094x ➖
Shifts: Parquet (control) +9.4% · Median polish +2.4%


datafusion / vortex-file-compressed (0.924x ➖, 3↑ 2↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 207698888 622982634 0.33
tpch_q02/datafusion:vortex-file-compressed 542817496 648527941 0.84
tpch_q03/datafusion:vortex-file-compressed 466408476 441850000 1.06
tpch_q04/datafusion:vortex-file-compressed 289750633 259925490 1.11
tpch_q05/datafusion:vortex-file-compressed 🚀 486797583 702859623 0.69
tpch_q06/datafusion:vortex-file-compressed 336717314 301957261 1.12
tpch_q07/datafusion:vortex-file-compressed 518012096 423654608 1.22
tpch_q08/datafusion:vortex-file-compressed 771200112 694415443 1.11
tpch_q09/datafusion:vortex-file-compressed 451681254 536082247 0.84
tpch_q10/datafusion:vortex-file-compressed 633769156 498559626 1.27
tpch_q11/datafusion:vortex-file-compressed 403272317 408643159 0.99
tpch_q12/datafusion:vortex-file-compressed 539974210 477363314 1.13
tpch_q13/datafusion:vortex-file-compressed 228172418 295773135 0.77
tpch_q14/datafusion:vortex-file-compressed 221684503 286011375 0.78
tpch_q15/datafusion:vortex-file-compressed 🚀 355784714 611139819 0.58
tpch_q16/datafusion:vortex-file-compressed 203485444 261909182 0.78
tpch_q17/datafusion:vortex-file-compressed 333130095 434140857 0.77
tpch_q18/datafusion:vortex-file-compressed 🚨 391764570 300825689 1.30
tpch_q19/datafusion:vortex-file-compressed 400387553 395594008 1.01
tpch_q20/datafusion:vortex-file-compressed 443472471 460760498 0.96
tpch_q21/datafusion:vortex-file-compressed 548802348 446577217 1.23
tpch_q22/datafusion:vortex-file-compressed 🚨 173248288 131267901 1.32
datafusion / vortex-compact (1.081x ➖, 1↑ 5↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 259528588 232648548 1.12
tpch_q02/datafusion:vortex-compact 553865023 513263176 1.08
tpch_q03/datafusion:vortex-compact 402969382 393545058 1.02
tpch_q04/datafusion:vortex-compact 303173377 262293301 1.16
tpch_q05/datafusion:vortex-compact 408145595 384596871 1.06
tpch_q06/datafusion:vortex-compact 🚨 447935293 338714412 1.32
tpch_q07/datafusion:vortex-compact 642285406 501107054 1.28
tpch_q08/datafusion:vortex-compact 639451994 533116046 1.20
tpch_q09/datafusion:vortex-compact 🚨 645975054 338451256 1.91
tpch_q10/datafusion:vortex-compact 🚨 653404299 446405097 1.46
tpch_q11/datafusion:vortex-compact 🚨 482615498 296685910 1.63
tpch_q12/datafusion:vortex-compact 623035284 684504820 0.91
tpch_q13/datafusion:vortex-compact 215843850 232057182 0.93
tpch_q14/datafusion:vortex-compact 317972798 334303965 0.95
tpch_q15/datafusion:vortex-compact 🚨 602874782 451149622 1.34
tpch_q16/datafusion:vortex-compact 237527896 185909658 1.28
tpch_q17/datafusion:vortex-compact 508903169 544798270 0.93
tpch_q18/datafusion:vortex-compact 302784360 423799968 0.71
tpch_q19/datafusion:vortex-compact 🚀 440739601 764838070 0.58
tpch_q20/datafusion:vortex-compact 463695094 470400540 0.99
tpch_q21/datafusion:vortex-compact 591829353 591573956 1.00
tpch_q22/datafusion:vortex-compact 118093940 155648471 0.76
datafusion / parquet (1.056x ➖, 0↑ 2↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 232897897 230405436 1.01
tpch_q02/datafusion:parquet 447317834 414702311 1.08
tpch_q03/datafusion:parquet 334515724 297679040 1.12
tpch_q04/datafusion:parquet 144949055 144561279 1.00
tpch_q05/datafusion:parquet 🚨 644590033 475846315 1.35
tpch_q06/datafusion:parquet 135758160 143019567 0.95
tpch_q07/datafusion:parquet 461785651 478743273 0.96
tpch_q08/datafusion:parquet 575715837 622221085 0.93
tpch_q09/datafusion:parquet 485931743 601144583 0.81
tpch_q10/datafusion:parquet 512176374 562554520 0.91
tpch_q11/datafusion:parquet 325401005 354656517 0.92
tpch_q12/datafusion:parquet 236268238 233078413 1.01
tpch_q13/datafusion:parquet 438265236 433992810 1.01
tpch_q14/datafusion:parquet 167649940 157376318 1.07
tpch_q15/datafusion:parquet 314175433 307465400 1.02
tpch_q16/datafusion:parquet 186402919 177974891 1.05
tpch_q17/datafusion:parquet 392020483 392306898 1.00
tpch_q18/datafusion:parquet 452859082 433220042 1.05
tpch_q19/datafusion:parquet 402091275 335307134 1.20
tpch_q20/datafusion:parquet 🚨 490340429 319053825 1.54
tpch_q21/datafusion:parquet 677285672 544205943 1.24
tpch_q22/datafusion:parquet 170016188 137483162 1.24
duckdb / vortex-file-compressed (0.980x ➖, 1↑ 3↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 425006753 309933657 1.37
tpch_q02/duckdb:vortex-file-compressed 928838051 1050314968 0.88
tpch_q03/duckdb:vortex-file-compressed 🚨 919468296 698348974 1.32
tpch_q04/duckdb:vortex-file-compressed 416190065 473215633 0.88
tpch_q05/duckdb:vortex-file-compressed 1137403476 950668778 1.20
tpch_q06/duckdb:vortex-file-compressed 418118965 458189316 0.91
tpch_q07/duckdb:vortex-file-compressed 717543618 854165782 0.84
tpch_q08/duckdb:vortex-file-compressed 1215842722 1265211476 0.96
tpch_q09/duckdb:vortex-file-compressed 956417863 936348330 1.02
tpch_q10/duckdb:vortex-file-compressed 861627508 1048888225 0.82
tpch_q11/duckdb:vortex-file-compressed 629166225 503398097 1.25
tpch_q12/duckdb:vortex-file-compressed 524539463 565082095 0.93
tpch_q13/duckdb:vortex-file-compressed 449704686 497180111 0.90
tpch_q14/duckdb:vortex-file-compressed 647238283 719204928 0.90
tpch_q15/duckdb:vortex-file-compressed 🚀 363873097 650408666 0.56
tpch_q16/duckdb:vortex-file-compressed 424959695 596145010 0.71
tpch_q17/duckdb:vortex-file-compressed 644464616 785680297 0.82
tpch_q18/duckdb:vortex-file-compressed 634155362 568948553 1.11
tpch_q19/duckdb:vortex-file-compressed 490085230 545047431 0.90
tpch_q20/duckdb:vortex-file-compressed 1032036319 840223718 1.23
tpch_q21/duckdb:vortex-file-compressed 🚨 1678900587 1090596527 1.54
tpch_q22/duckdb:vortex-file-compressed 385308207 362298409 1.06
duckdb / vortex-compact (0.965x ➖, 1↑ 2↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 309100587 415729309 0.74
tpch_q02/duckdb:vortex-compact 1166776045 1213314203 0.96
tpch_q03/duckdb:vortex-compact 653046147 777984732 0.84
tpch_q04/duckdb:vortex-compact 🚀 328089095 502849422 0.65
tpch_q05/duckdb:vortex-compact 965033806 1094482811 0.88
tpch_q06/duckdb:vortex-compact 513209414 615166315 0.83
tpch_q07/duckdb:vortex-compact 🚨 1264010972 970600717 1.30
tpch_q08/duckdb:vortex-compact 1159399997 1008774887 1.15
tpch_q09/duckdb:vortex-compact 927566561 952900379 0.97
tpch_q10/duckdb:vortex-compact 614982016 695477901 0.88
tpch_q11/duckdb:vortex-compact 535092038 594288358 0.90
tpch_q12/duckdb:vortex-compact 491818291 520965282 0.94
tpch_q13/duckdb:vortex-compact 482323532 523716882 0.92
tpch_q14/duckdb:vortex-compact 457652995 492516500 0.93
tpch_q15/duckdb:vortex-compact 🚨 636977803 313206031 2.03
tpch_q16/duckdb:vortex-compact 383800473 372093986 1.03
tpch_q17/duckdb:vortex-compact 656871613 693369709 0.95
tpch_q18/duckdb:vortex-compact 621202723 638950813 0.97
tpch_q19/duckdb:vortex-compact 509631227 583362023 0.87
tpch_q20/duckdb:vortex-compact 983561170 994045869 0.99
tpch_q21/duckdb:vortex-compact 1129604669 1127995694 1.00
tpch_q22/duckdb:vortex-compact 392163029 389510241 1.01
duckdb / parquet (1.134x ➖, 0↑ 6↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 840285903 511724505 1.64
tpch_q02/duckdb:parquet 1365568683 1322298490 1.03
tpch_q03/duckdb:parquet 🚨 1407481408 1052039596 1.34
tpch_q04/duckdb:parquet 🚨 896335804 659825055 1.36
tpch_q05/duckdb:parquet 1895026699 1491426377 1.27
tpch_q06/duckdb:parquet 395401217 411091088 0.96
tpch_q07/duckdb:parquet 1347382103 1529033261 0.88
tpch_q08/duckdb:parquet 1757020282 1607416014 1.09
tpch_q09/duckdb:parquet 1528843210 1501582180 1.02
tpch_q10/duckdb:parquet 🚨 1819774363 1169841655 1.56
tpch_q11/duckdb:parquet 843361227 954746388 0.88
tpch_q12/duckdb:parquet 622883454 779036147 0.80
tpch_q13/duckdb:parquet 960701697 842743673 1.14
tpch_q14/duckdb:parquet 🚨 878962198 587460064 1.50
tpch_q15/duckdb:parquet 630012294 678246453 0.93
tpch_q16/duckdb:parquet 628327821 540244458 1.16
tpch_q17/duckdb:parquet 830367267 943960980 0.88
tpch_q18/duckdb:parquet 976301000 892151269 1.09
tpch_q19/duckdb:parquet 1270649718 1227653864 1.04
tpch_q20/duckdb:parquet 1521174398 1173560143 1.30
tpch_q21/duckdb:parquet 1403757594 1174774129 1.19
tpch_q22/duckdb:parquet 🚨 691123988 506145463 1.37
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +11.6% +28.8% -13.4% +227.6% ➖ noise
1 datafusion:vortex-file-compressed -66.7% +28.8% -74.1% +184.2% ✅ faster
1 duckdb:vortex-compact -25.6% +28.8% -42.3% +70.1% ✅ faster
1 duckdb:vortex-file-compressed +37.1% +28.8% +6.4% +61.4% ➖ noise
2 datafusion:vortex-compact +7.9% +5.5% +2.2% +43.7% ➖ noise
2 datafusion:vortex-file-compressed -16.3% +5.5% -20.7% +53.7% ➖ noise
2 duckdb:vortex-compact -3.8% +5.5% -8.9% +43.7% ➖ noise
2 duckdb:vortex-file-compressed -11.6% +5.5% -16.2% +43.7% ➖ noise
3 datafusion:vortex-compact +2.4% +22.6% -16.5% +111.4% ➖ noise
3 datafusion:vortex-file-compressed +5.6% +22.6% -13.9% +112.4% ➖ noise
3 duckdb:vortex-compact -16.1% +22.6% -31.5% +58.2% ➖ noise
3 duckdb:vortex-file-compressed +31.7% +22.6% +7.4% +73.7% ➖ noise
4 datafusion:vortex-compact +15.6% +16.7% -1.0% +73.5% ➖ noise
4 datafusion:vortex-file-compressed +11.5% +16.7% -4.5% +43.7% ➖ noise
4 duckdb:vortex-compact -34.8% +16.7% -44.1% +45.3% ✅ faster
4 duckdb:vortex-file-compressed -12.1% +16.7% -24.6% +44.6% ➖ noise
5 datafusion:vortex-compact +6.1% +31.2% -19.1% +43.7% ➖ noise
5 datafusion:vortex-file-compressed -30.7% +31.2% -47.2% +43.7% ✅ faster
5 duckdb:vortex-compact -11.8% +31.2% -32.8% +44.5% ✅ faster
5 duckdb:vortex-file-compressed +19.6% +31.2% -8.8% +43.7% ➖ noise
6 datafusion:vortex-compact +32.2% -4.4% +38.4% +87.8% ➖ noise
6 datafusion:vortex-file-compressed +11.5% -4.4% +16.7% +45.0% ➖ noise
6 duckdb:vortex-compact -16.6% -4.4% -12.7% +43.7% ➖ noise
6 duckdb:vortex-file-compressed -8.7% -4.4% -4.5% +43.7% ➖ noise
7 datafusion:vortex-compact +28.2% -7.8% +39.0% +59.8% ➖ noise
7 datafusion:vortex-file-compressed +22.3% -7.8% +32.6% +43.7% ➖ noise
7 duckdb:vortex-compact +30.2% -7.8% +41.3% +43.7% ➖ noise
7 duckdb:vortex-file-compressed -16.0% -7.8% -8.9% +43.7% ➖ noise
8 datafusion:vortex-compact +19.9% +0.6% +19.3% +89.2% ➖ noise
8 datafusion:vortex-file-compressed +11.1% +0.6% +10.4% +43.7% ➖ noise
8 duckdb:vortex-compact +14.9% +0.6% +14.3% +43.7% ➖ noise
8 duckdb:vortex-file-compressed -3.9% +0.6% -4.4% +43.7% ➖ noise
9 datafusion:vortex-compact +90.9% -9.3% +110.4% +43.7% 🚨 regression
9 datafusion:vortex-file-compressed -15.7% -9.3% -7.1% +43.7% ➖ noise
9 duckdb:vortex-compact -2.7% -9.3% +7.3% +43.7% ➖ noise
9 duckdb:vortex-file-compressed +2.1% -9.3% +12.6% +43.7% ➖ noise
10 datafusion:vortex-compact +46.4% +19.0% +23.0% +46.5% ➖ noise
10 datafusion:vortex-file-compressed +27.1% +19.0% +6.8% +43.7% ➖ noise
10 duckdb:vortex-compact -11.6% +19.0% -25.7% +43.7% ➖ noise
10 duckdb:vortex-file-compressed -17.9% +19.0% -31.0% +55.5% ➖ noise
11 datafusion:vortex-compact +62.7% -10.0% +80.7% +43.7% 🚨 regression
11 datafusion:vortex-file-compressed -1.3% -10.0% +9.6% +44.9% ➖ noise
11 duckdb:vortex-compact -10.0% -10.0% +0.0% +51.1% ➖ noise
11 duckdb:vortex-file-compressed +25.0% -10.0% +38.8% +102.0% ➖ noise
12 datafusion:vortex-compact -9.0% -10.0% +1.1% +45.6% ➖ noise
12 datafusion:vortex-file-compressed +13.1% -10.0% +25.6% +43.7% ➖ noise
12 duckdb:vortex-compact -5.6% -10.0% +4.9% +44.8% ➖ noise
12 duckdb:vortex-file-compressed -7.2% -10.0% +3.1% +78.4% ➖ noise
13 datafusion:vortex-compact -7.0% +7.3% -13.3% +78.2% ➖ noise
13 datafusion:vortex-file-compressed -22.9% +7.3% -28.1% +114.5% ➖ noise
13 duckdb:vortex-compact -7.9% +7.3% -14.2% +94.1% ➖ noise
13 duckdb:vortex-file-compressed -9.5% +7.3% -15.7% +46.3% ➖ noise
14 datafusion:vortex-compact -4.9% +26.2% -24.7% +56.3% ➖ noise
14 datafusion:vortex-file-compressed -22.5% +26.2% -38.6% +53.9% ✅ faster
14 duckdb:vortex-compact -7.1% +26.2% -26.4% +62.9% ➖ noise
14 duckdb:vortex-file-compressed -10.0% +26.2% -28.7% +66.8% ➖ noise
15 datafusion:vortex-compact +33.6% -2.6% +37.2% +47.6% ➖ noise
15 datafusion:vortex-file-compressed -41.8% -2.6% -40.2% +45.1% ✅ faster
15 duckdb:vortex-compact +103.4% -2.6% +108.7% +89.6% 🚨 regression
15 duckdb:vortex-file-compressed -44.1% -2.6% -42.6% +69.7% ✅ faster
16 datafusion:vortex-compact +27.8% +10.4% +15.8% +48.7% ➖ noise
16 datafusion:vortex-file-compressed -22.3% +10.4% -29.6% +44.4% ➖ noise
16 duckdb:vortex-compact +3.1% +10.4% -6.5% +43.7% ➖ noise
16 duckdb:vortex-file-compressed -28.7% +10.4% -35.4% +48.1% ✅ faster
17 datafusion:vortex-compact -6.6% -6.2% -0.4% +74.6% ➖ noise
17 datafusion:vortex-file-compressed -23.3% -6.2% -18.2% +43.7% ➖ noise
17 duckdb:vortex-compact -5.3% -6.2% +1.0% +43.7% ➖ noise
17 duckdb:vortex-file-compressed -18.0% -6.2% -12.5% +43.7% ➖ noise
18 datafusion:vortex-compact -28.6% +7.0% -33.2% +43.7% ✅ faster
18 datafusion:vortex-file-compressed +30.2% +7.0% +21.8% +44.0% ➖ noise
18 duckdb:vortex-compact -2.8% +7.0% -9.1% +43.7% ➖ noise
18 duckdb:vortex-file-compressed +11.5% +7.0% +4.2% +43.7% ➖ noise
19 datafusion:vortex-compact -42.4% +11.4% -48.3% +71.7% ✅ faster
19 datafusion:vortex-file-compressed +1.2% +11.4% -9.2% +43.7% ➖ noise
19 duckdb:vortex-compact -12.6% +11.4% -21.6% +66.1% ➖ noise
19 duckdb:vortex-file-compressed -10.1% +11.4% -19.3% +54.4% ➖ noise
20 datafusion:vortex-compact -1.4% +41.1% -30.2% +43.7% ➖ noise
20 datafusion:vortex-file-compressed -3.8% +41.1% -31.8% +43.7% ✅ faster
20 duckdb:vortex-compact -1.1% +41.1% -29.9% +46.2% ➖ noise
20 duckdb:vortex-file-compressed +22.8% +41.1% -13.0% +43.7% ➖ noise
21 datafusion:vortex-compact +0.0% +21.9% -18.0% +43.7% ➖ noise
21 datafusion:vortex-file-compressed +22.9% +21.9% +0.8% +43.7% ➖ noise
21 duckdb:vortex-compact +0.1% +21.9% -17.9% +43.7% ➖ noise
21 duckdb:vortex-file-compressed +53.9% +21.9% +26.2% +47.6% ➖ noise
22 datafusion:vortex-compact -24.1% +29.9% -41.6% +43.7% ✅ faster
22 datafusion:vortex-file-compressed +32.0% +29.9% +1.6% +43.7% ➖ noise
22 duckdb:vortex-compact +0.7% +29.9% -22.5% +71.8% ➖ noise
22 duckdb:vortex-file-compressed +6.4% +29.9% -18.2% +43.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.4%
Vortex (geomean): 1.100x ➖
Parquet (geomean): 1.044x ➖
Shifts: Parquet (control) +4.4% · Median polish +6.1%


datafusion / vortex-file-compressed (1.174x ➖, 0↑ 2↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 32645079 28560451 1.14
fineweb_q01/datafusion:vortex-file-compressed 🚨 873463876 530149798 1.65
fineweb_q02/datafusion:vortex-file-compressed 571996653 552475356 1.04
fineweb_q03/datafusion:vortex-file-compressed 1518059565 1358423489 1.12
fineweb_q04/datafusion:vortex-file-compressed 1397575162 1369538746 1.02
fineweb_q05/datafusion:vortex-file-compressed 1392488481 1348144663 1.03
fineweb_q06/datafusion:vortex-file-compressed 🚨 2165275715 1472372502 1.47
fineweb_q07/datafusion:vortex-file-compressed 1504211294 1349851387 1.11
fineweb_q08/datafusion:vortex-file-compressed 621497376 550763403 1.13
datafusion / vortex-compact (1.311x ❌, 0↑ 5↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 34556618 34272323 1.01
fineweb_q01/datafusion:vortex-compact 🚨 1005638938 510798364 1.97
fineweb_q02/datafusion:vortex-compact 🚨 1228989710 649587557 1.89
fineweb_q03/datafusion:vortex-compact 1899264232 1920712720 0.99
fineweb_q04/datafusion:vortex-compact 2284343205 2239343709 1.02
fineweb_q05/datafusion:vortex-compact 1723057412 1708929068 1.01
fineweb_q06/datafusion:vortex-compact 🚨 1964444589 1448323163 1.36
fineweb_q07/datafusion:vortex-compact 🚨 1788944560 1290327909 1.39
fineweb_q08/datafusion:vortex-compact 🚨 642696647 402248675 1.60
datafusion / parquet (1.077x ➖, 0↑ 1↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 1633524579 1191566115 1.37
fineweb_q01/datafusion:parquet 2336909231 1911443731 1.22
fineweb_q02/datafusion:parquet 2033229397 1883189836 1.08
fineweb_q03/datafusion:parquet 1958832818 1933163368 1.01
fineweb_q04/datafusion:parquet 1808881046 1974308728 0.92
fineweb_q05/datafusion:parquet 1913710118 2108486472 0.91
fineweb_q06/datafusion:parquet 2502045402 2456372858 1.02
fineweb_q07/datafusion:parquet 2153069233 1971748558 1.09
fineweb_q08/datafusion:parquet 2266429967 1978597759 1.15
duckdb / vortex-file-compressed (0.933x ➖, 1↑ 1↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 159409890 112247510 1.42
fineweb_q01/duckdb:vortex-file-compressed 862121201 910922394 0.95
fineweb_q02/duckdb:vortex-file-compressed 550295019 588485704 0.94
fineweb_q03/duckdb:vortex-file-compressed 1577777231 1444105154 1.09
fineweb_q04/duckdb:vortex-file-compressed 1497958018 1557317036 0.96
fineweb_q05/duckdb:vortex-file-compressed 1561846888 1642416523 0.95
fineweb_q06/duckdb:vortex-file-compressed 1649931489 1833511513 0.90
fineweb_q07/duckdb:vortex-file-compressed 1515233566 1783762062 0.85
fineweb_q08/duckdb:vortex-file-compressed 🚀 638586723 1139907786 0.56
duckdb / vortex-compact (1.018x ➖, 0↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 122920877 111174553 1.11
fineweb_q01/duckdb:vortex-compact 713445773 677962990 1.05
fineweb_q02/duckdb:vortex-compact 856384071 770832262 1.11
fineweb_q03/duckdb:vortex-compact 1598771105 1867865445 0.86
fineweb_q04/duckdb:vortex-compact 1814381765 1681482438 1.08
fineweb_q05/duckdb:vortex-compact 1527462013 1510708535 1.01
fineweb_q06/duckdb:vortex-compact 1478136459 1749474892 0.84
fineweb_q07/duckdb:vortex-compact 1363981516 1442758312 0.95
fineweb_q08/duckdb:vortex-compact 942263103 772828317 1.22
duckdb / parquet (1.012x ➖, 0↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1318688863 1250729409 1.05
fineweb_q01/duckdb:parquet 1871734893 1778999258 1.05
fineweb_q02/duckdb:parquet 1656450215 1854946219 0.89
fineweb_q03/duckdb:parquet 4661136965 4542625505 1.03
fineweb_q04/duckdb:parquet 2266484067 2084990780 1.09
fineweb_q05/duckdb:parquet 3355163611 3065318353 1.09
fineweb_q06/duckdb:parquet 3691380325 3698989151 1.00
fineweb_q07/duckdb:parquet 4428654137 4320719212 1.02
fineweb_q08/duckdb:parquet 1126669517 1249207437 0.90
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +0.8% +20.2% -16.1% +177.1% ➖ noise
0 datafusion:vortex-file-compressed +14.3% +20.2% -4.9% +189.6% ➖ noise
0 duckdb:vortex-compact +10.6% +20.2% -8.0% +64.3% ➖ noise
0 duckdb:vortex-file-compressed +42.0% +20.2% +18.1% +83.2% ➖ noise
1 datafusion:vortex-compact +96.9% +13.4% +73.6% +91.9% ➖ noise
1 datafusion:vortex-file-compressed +64.8% +13.4% +45.3% +72.3% ➖ noise
1 duckdb:vortex-compact +5.2% +13.4% -7.2% +59.2% ➖ noise
1 duckdb:vortex-file-compressed -5.4% +13.4% -16.6% +46.9% ➖ noise
2 datafusion:vortex-compact +89.2% -1.8% +92.7% +30.0% 🚨 regression
2 datafusion:vortex-file-compressed +3.5% -1.8% +5.4% +48.7% ➖ noise
2 duckdb:vortex-compact +11.1% -1.8% +13.1% +149.1% ➖ noise
2 duckdb:vortex-file-compressed -6.5% -1.8% -4.8% +81.2% ➖ noise
3 datafusion:vortex-compact -1.1% +2.0% -3.0% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +11.8% +2.0% +9.6% +30.0% ➖ noise
3 duckdb:vortex-compact -14.4% +2.0% -16.1% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +9.3% +2.0% +7.1% +30.0% ➖ noise
4 datafusion:vortex-compact +2.0% -0.2% +2.2% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +2.0% -0.2% +2.3% +30.0% ➖ noise
4 duckdb:vortex-compact +7.9% -0.2% +8.1% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -3.8% -0.2% -3.6% +31.2% ➖ noise
5 datafusion:vortex-compact +0.8% -0.3% +1.2% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +3.3% -0.3% +3.6% +30.0% ➖ noise
5 duckdb:vortex-compact +1.1% -0.3% +1.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -4.9% -0.3% -4.6% +30.4% ➖ noise
6 datafusion:vortex-compact +35.6% +0.8% +34.5% +30.6% 🚨 regression
6 datafusion:vortex-file-compressed +47.1% +0.8% +45.9% +30.0% 🚨 regression
6 duckdb:vortex-compact -15.5% +0.8% -16.2% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -10.0% +0.8% -10.7% +30.0% ➖ noise
7 datafusion:vortex-compact +38.6% +5.8% +31.0% +30.0% 🚨 regression
7 datafusion:vortex-file-compressed +11.4% +5.8% +5.3% +30.0% ➖ noise
7 duckdb:vortex-compact -5.5% +5.8% -10.6% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -15.1% +5.8% -19.7% +30.3% ➖ noise
8 datafusion:vortex-compact +59.8% +1.6% +57.2% +39.4% 🚨 regression
8 datafusion:vortex-file-compressed +12.8% +1.6% +11.0% +30.0% ➖ noise
8 duckdb:vortex-compact +21.9% +1.6% +20.0% +50.4% ➖ noise
8 duckdb:vortex-file-compressed -44.0% +1.6% -44.9% +69.4% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: Random Access

Vortex (geomean): 0.862x ✅
Parquet (geomean): 1.008x ➖


unknown / unknown (0.953x ➖, 9↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 2276916 2463464 0.92
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1295247 1342247 0.96
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11968317956 11502143107 1.04
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11486348858 11389084283 1.01
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8784277 8898045 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6520628 6775320 0.96
random-access/feature-vectors/uniform/lance-tokio-local-disk 1492640 1513031 0.99
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2400721 2459666 0.98
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11407956947 11429008424 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11392872946 11435022812 1.00
random-access/feature-vectors/uniform/vortex-tokio-local-disk 12985798 14177850 0.92
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 13024047 14375571 0.91
random-access/lance-tokio-local-disk 766699 746374 1.03
random-access/lance-tokio-local-disk-footer 1425583 1366156 1.04
random-access/nested-lists/correlated/lance-tokio-local-disk 269712 274328 0.98
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 718523 742896 0.97
random-access/nested-lists/correlated/parquet-tokio-local-disk 139336975 136283037 1.02
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 140482417 137247805 1.02
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 707945 873084 0.81
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 713327 853789 0.84
random-access/nested-lists/uniform/lance-tokio-local-disk 1163684 1180420 0.99
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1657742 1697773 0.98
random-access/nested-lists/uniform/parquet-tokio-local-disk 143245896 141132035 1.01
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 142957678 141168402 1.01
random-access/nested-lists/uniform/vortex-tokio-local-disk 🚀 2362200 2653533 0.89
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2494618 2767745 0.90
random-access/nested-structs/correlated/lance-tokio-local-disk 433187 439509 0.99
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 646291 652848 0.99
random-access/nested-structs/correlated/parquet-tokio-local-disk 26398813 26900802 0.98
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 26195132 26980049 0.97
random-access/nested-structs/correlated/vortex-tokio-local-disk 914478 881134 1.04
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 910116 916034 0.99
random-access/nested-structs/uniform/lance-tokio-local-disk 2807899 2855678 0.98
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3049141 3107327 0.98
random-access/nested-structs/uniform/parquet-tokio-local-disk 26244512 26955654 0.97
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 27089371 27432071 0.99
random-access/nested-structs/uniform/vortex-tokio-local-disk 1781309 1820814 0.98
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1765816 1860022 0.95
random-access/parquet-tokio-local-disk 185980731 183442728 1.01
random-access/parquet-tokio-local-disk-footer 187045306 182361035 1.03
random-access/taxi/correlated/lance-tokio-local-disk 998324 969165 1.03
random-access/taxi/correlated/lance-tokio-local-disk-footer 1745245 1664554 1.05
random-access/taxi/correlated/parquet-tokio-local-disk 283459738 277007869 1.02
random-access/taxi/correlated/parquet-tokio-local-disk-footer 277030717 272575785 1.02
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1761429 2456181 0.72
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1787205 2516736 0.71
random-access/taxi/uniform/lance-tokio-local-disk 8891429 8441512 1.05
random-access/taxi/uniform/lance-tokio-local-disk-footer 9437877 9171018 1.03
random-access/taxi/uniform/parquet-tokio-local-disk 294296446 288689865 1.02
random-access/taxi/uniform/parquet-tokio-local-disk-footer 296430101 290425954 1.02
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4653602 5590863 0.83
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4628709 5663300 0.82
random-access/vortex-tokio-local-disk 🚀 1286846 1813963 0.71
random-access/vortex-tokio-local-disk-footer 🚀 1277184 1851421 0.69

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 0.972x ➖
Parquet (geomean): 0.975x ➖
Shifts: Parquet (control) -2.5% · Median polish -2.1%


duckdb / vortex-file-compressed (0.964x ➖, 0↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10846377 11542425 0.94
statpopgen_q01/duckdb:vortex-file-compressed 19402819 19802560 0.98
statpopgen_q02/duckdb:vortex-file-compressed 1298805371 1342413659 0.97
statpopgen_q03/duckdb:vortex-file-compressed 2977876966 3181912563 0.94
statpopgen_q04/duckdb:vortex-file-compressed 3007959484 3146723564 0.96
statpopgen_q05/duckdb:vortex-file-compressed 1363071247 1442207212 0.95
statpopgen_q06/duckdb:vortex-file-compressed 2044559305 2087148759 0.98
statpopgen_q07/duckdb:vortex-file-compressed 259780618 262363931 0.99
statpopgen_q08/duckdb:vortex-file-compressed 271400263 276722222 0.98
statpopgen_q09/duckdb:vortex-file-compressed 2785929426 2922360862 0.95
statpopgen_q10/duckdb:vortex-file-compressed 4624706020 4720591104 0.98
duckdb / vortex-compact (0.980x ➖, 0↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10763249 11174371 0.96
statpopgen_q01/duckdb:vortex-compact 165590190 168419250 0.98
statpopgen_q02/duckdb:vortex-compact 1803914027 1833662386 0.98
statpopgen_q03/duckdb:vortex-compact 3503784410 3578917359 0.98
statpopgen_q04/duckdb:vortex-compact 3513210520 3558099377 0.99
statpopgen_q05/duckdb:vortex-compact 1809903907 1907524064 0.95
statpopgen_q06/duckdb:vortex-compact 2660058557 2731285425 0.97
statpopgen_q07/duckdb:vortex-compact 976281355 992518420 0.98
statpopgen_q08/duckdb:vortex-compact 1011884016 1031704174 0.98
statpopgen_q09/duckdb:vortex-compact 3396068056 3376809467 1.01
statpopgen_q10/duckdb:vortex-compact 5452787000 5497855508 0.99
duckdb / parquet (0.975x ➖, 0↑ 0↓)
name PR 7847609 (ns) base e3b7310 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 316438882 325124598 0.97
statpopgen_q01/duckdb:parquet 402999109 411133785 0.98
statpopgen_q02/duckdb:parquet 974482790 1010232385 0.96
statpopgen_q03/duckdb:parquet 1506087591 1528298296 0.99
statpopgen_q04/duckdb:parquet 1507884600 1522735826 0.99
statpopgen_q05/duckdb:parquet 999914864 1021378378 0.98
statpopgen_q06/duckdb:parquet 1473498719 1516018296 0.97
statpopgen_q07/duckdb:parquet 1867015754 1913495071 0.98
statpopgen_q08/duckdb:parquet 1883714063 1931413233 0.98
statpopgen_q09/duckdb:parquet 1348493830 1409627210 0.96
statpopgen_q10/duckdb:parquet 2641263799 2726951804 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -3.7% -2.7% -1.0% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -6.0% -2.7% -3.5% +10.0% ➖ noise
1 duckdb:vortex-compact -1.7% -2.0% +0.3% +23.9% ➖ noise
1 duckdb:vortex-file-compressed -2.0% -2.0% -0.0% +216.9% ➖ noise
2 duckdb:vortex-compact -1.6% -3.5% +2.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -3.2% -3.5% +0.3% +10.0% ➖ noise
3 duckdb:vortex-compact -2.1% -1.5% -0.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -6.4% -1.5% -5.0% +10.0% ➖ noise
4 duckdb:vortex-compact -1.3% -1.0% -0.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -4.4% -1.0% -3.5% +10.0% ➖ noise
5 duckdb:vortex-compact -5.1% -2.1% -3.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -5.5% -2.1% -3.5% +10.0% ➖ noise
6 duckdb:vortex-compact -2.6% -2.8% +0.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.0% -2.8% +0.8% +10.0% ➖ noise
7 duckdb:vortex-compact -1.6% -2.4% +0.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.0% -2.4% +1.5% +10.0% ➖ noise
8 duckdb:vortex-compact -1.9% -2.5% +0.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.9% -2.5% +0.6% +10.0% ➖ noise
9 duckdb:vortex-compact +0.6% -4.3% +5.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -4.7% -4.3% -0.3% +10.0% ➖ noise
10 duckdb:vortex-compact -0.8% -3.1% +2.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.0% -3.1% +1.1% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.7%
Vortex (geomean): 1.059x ➖
Parquet (geomean): 1.043x ➖
Shifts: Parquet (control) +4.3% · Median polish +2.0%


datafusion / vortex-file-compressed (1.064x ➖, 0↑ 12↓)
name PR 7847609 (ns) base 19403db (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1972180 1905607 1.03
clickbench_q01/datafusion:vortex-file-compressed 13816810 13905117 0.99
clickbench_q02/datafusion:vortex-file-compressed 34597242 35733779 0.97
clickbench_q03/datafusion:vortex-file-compressed 38256166 37690192 1.02
clickbench_q04/datafusion:vortex-file-compressed 316494400 308263513 1.03
clickbench_q05/datafusion:vortex-file-compressed 330185626 322814279 1.02
clickbench_q06/datafusion:vortex-file-compressed 🚨 2254106 1994911 1.13
clickbench_q07/datafusion:vortex-file-compressed 18321511 18171906 1.01
clickbench_q08/datafusion:vortex-file-compressed 384048727 377588498 1.02
clickbench_q09/datafusion:vortex-file-compressed 594373562 567662039 1.05
clickbench_q10/datafusion:vortex-file-compressed 75193001 74604010 1.01
clickbench_q11/datafusion:vortex-file-compressed 88098678 85130212 1.03
clickbench_q12/datafusion:vortex-file-compressed 283170272 285259669 0.99
clickbench_q13/datafusion:vortex-file-compressed 430323502 425667954 1.01
clickbench_q14/datafusion:vortex-file-compressed 245681601 258703418 0.95
clickbench_q15/datafusion:vortex-file-compressed 368549394 364318419 1.01
clickbench_q16/datafusion:vortex-file-compressed 703726926 707703696 0.99
clickbench_q17/datafusion:vortex-file-compressed 721851741 697532660 1.03
clickbench_q18/datafusion:vortex-file-compressed 1410663777 1406387684 1.00
clickbench_q19/datafusion:vortex-file-compressed 24128938 23183987 1.04
clickbench_q20/datafusion:vortex-file-compressed 356993189 353153858 1.01
clickbench_q21/datafusion:vortex-file-compressed 414257985 411453651 1.01
clickbench_q22/datafusion:vortex-file-compressed 557644467 507854697 1.10
clickbench_q23/datafusion:vortex-file-compressed 🚨 1159208278 840644145 1.38
clickbench_q24/datafusion:vortex-file-compressed 51414615 47375090 1.09
clickbench_q25/datafusion:vortex-file-compressed 73933671 73971902 1.00
clickbench_q26/datafusion:vortex-file-compressed 47986009 48878275 0.98
clickbench_q27/datafusion:vortex-file-compressed 823298026 808506498 1.02
clickbench_q28/datafusion:vortex-file-compressed 6777116525 6860497883 0.99
clickbench_q29/datafusion:vortex-file-compressed 231943686 245657910 0.94
clickbench_q30/datafusion:vortex-file-compressed 254511330 232500620 1.09
clickbench_q31/datafusion:vortex-file-compressed 274102920 267900219 1.02
clickbench_q32/datafusion:vortex-file-compressed 1372195706 1254704729 1.09
clickbench_q33/datafusion:vortex-file-compressed 🚨 1681396527 1405471980 1.20
clickbench_q34/datafusion:vortex-file-compressed 🚨 1753755517 1430120582 1.23
clickbench_q35/datafusion:vortex-file-compressed 🚨 618617704 512347011 1.21
clickbench_q36/datafusion:vortex-file-compressed 🚨 90968361 81069679 1.12
clickbench_q37/datafusion:vortex-file-compressed 🚨 47190059 39328114 1.20
clickbench_q38/datafusion:vortex-file-compressed 🚨 27366985 22815280 1.20
clickbench_q39/datafusion:vortex-file-compressed 🚨 178098152 150509643 1.18
clickbench_q40/datafusion:vortex-file-compressed 🚨 22035460 19576540 1.13
clickbench_q41/datafusion:vortex-file-compressed 🚨 20661371 18150262 1.14
clickbench_q42/datafusion:vortex-file-compressed 🚨 23287831 18884192 1.23
datafusion / parquet (1.065x ➖, 0↑ 5↓)
name PR 7847609 (ns) base 19403db (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1957178 2040425 0.96
clickbench_q01/datafusion:parquet 20602753 20268681 1.02
clickbench_q02/datafusion:parquet 56403298 56716398 0.99
clickbench_q03/datafusion:parquet 45410691 46093018 0.99
clickbench_q04/datafusion:parquet 351740230 335265627 1.05
clickbench_q05/datafusion:parquet 390786110 360104397 1.09
clickbench_q06/datafusion:parquet 1790977 1818943 0.98
clickbench_q07/datafusion:parquet 25490061 25278051 1.01
clickbench_q08/datafusion:parquet 422691875 401729559 1.05
clickbench_q09/datafusion:parquet 671190417 639817386 1.05
clickbench_q10/datafusion:parquet 116389053 107101505 1.09
clickbench_q11/datafusion:parquet 136292956 134491396 1.01
clickbench_q12/datafusion:parquet 379485455 357989882 1.06
clickbench_q13/datafusion:parquet 524524302 500992567 1.05
clickbench_q14/datafusion:parquet 360837948 353870573 1.02
clickbench_q15/datafusion:parquet 382428628 381431374 1.00
clickbench_q16/datafusion:parquet 708948970 677901791 1.05
clickbench_q17/datafusion:parquet 🚨 946138236 669733438 1.41
clickbench_q18/datafusion:parquet 🚨 2487779530 1387626360 1.79
clickbench_q19/datafusion:parquet 🚨 41972473 31702064 1.32
clickbench_q20/datafusion:parquet 604368389 589551178 1.03
clickbench_q21/datafusion:parquet 665846034 645790575 1.03
clickbench_q22/datafusion:parquet 985638873 980993212 1.00
clickbench_q23/datafusion:parquet 3739705571 3575732936 1.05
clickbench_q24/datafusion:parquet 87606352 89550934 0.98
clickbench_q25/datafusion:parquet 141681732 142943025 0.99
clickbench_q26/datafusion:parquet 88997228 88837812 1.00
clickbench_q27/datafusion:parquet 1059742596 1046026333 1.01
clickbench_q28/datafusion:parquet 6465333593 6622067463 0.98
clickbench_q29/datafusion:parquet 249913402 242903059 1.03
clickbench_q30/datafusion:parquet 367313065 358178958 1.03
clickbench_q31/datafusion:parquet 397072722 387456316 1.02
clickbench_q32/datafusion:parquet 1320845170 1291029119 1.02
clickbench_q33/datafusion:parquet 🚨 2697322350 1556774352 1.73
clickbench_q34/datafusion:parquet 1563856651 1530736400 1.02
clickbench_q35/datafusion:parquet 550016978 526691129 1.04
clickbench_q36/datafusion:parquet 🚨 159749514 144898348 1.10
clickbench_q37/datafusion:parquet 61384922 61491140 1.00
clickbench_q38/datafusion:parquet 98079433 94231365 1.04
clickbench_q39/datafusion:parquet 288489687 274838736 1.05
clickbench_q40/datafusion:parquet 34587385 34935920 0.99
clickbench_q41/datafusion:parquet 31500927 29767083 1.06
clickbench_q42/datafusion:parquet 33568924 31544586 1.06
duckdb / vortex-file-compressed (1.054x ➖, 4↑ 14↓)
name PR 7847609 (ns) base 19403db (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 5746463 6096084 0.94
clickbench_q01/duckdb:vortex-file-compressed 15187533 14065830 1.08
clickbench_q02/duckdb:vortex-file-compressed 25840979 25207638 1.03
clickbench_q03/duckdb:vortex-file-compressed 30508007 30284358 1.01
clickbench_q04/duckdb:vortex-file-compressed 179816225 172252237 1.04
clickbench_q05/duckdb:vortex-file-compressed 203760322 197306285 1.03
clickbench_q06/duckdb:vortex-file-compressed 19297651 18718212 1.03
clickbench_q07/duckdb:vortex-file-compressed 15873833 16629156 0.95
clickbench_q08/duckdb:vortex-file-compressed 282807347 263481738 1.07
clickbench_q09/duckdb:vortex-file-compressed 384946699 378575425 1.02
clickbench_q10/duckdb:vortex-file-compressed 76939051 75393840 1.02
clickbench_q11/duckdb:vortex-file-compressed 89679556 86086739 1.04
clickbench_q12/duckdb:vortex-file-compressed 224160061 217599325 1.03
clickbench_q13/duckdb:vortex-file-compressed 🚨 483608850 436524721 1.11
clickbench_q14/duckdb:vortex-file-compressed 🚨 289817619 242486903 1.20
clickbench_q15/duckdb:vortex-file-compressed 🚨 253285047 213936850 1.18
clickbench_q16/duckdb:vortex-file-compressed 🚨 802301094 660502721 1.21
clickbench_q17/duckdb:vortex-file-compressed 🚨 723819614 508689003 1.42
clickbench_q18/duckdb:vortex-file-compressed 🚨 1419764014 1176402828 1.21
clickbench_q19/duckdb:vortex-file-compressed 23334009 21952413 1.06
clickbench_q20/duckdb:vortex-file-compressed 🚨 458750010 383241543 1.20
clickbench_q21/duckdb:vortex-file-compressed 🚨 474383077 410775766 1.15
clickbench_q22/duckdb:vortex-file-compressed 🚨 796798124 707152893 1.13
clickbench_q23/duckdb:vortex-file-compressed 🚨 1738371162 967181421 1.80
clickbench_q24/duckdb:vortex-file-compressed 58858400 57334885 1.03
clickbench_q25/duckdb:vortex-file-compressed 🚨 92878191 84257849 1.10
clickbench_q26/duckdb:vortex-file-compressed 51080714 50482041 1.01
clickbench_q27/duckdb:vortex-file-compressed 581870674 572457685 1.02
clickbench_q28/duckdb:vortex-file-compressed 3326715349 3350163771 0.99
clickbench_q29/duckdb:vortex-file-compressed 30160039 30379513 0.99
clickbench_q30/duckdb:vortex-file-compressed 212730895 211826049 1.00
clickbench_q31/duckdb:vortex-file-compressed 312020015 301503502 1.03
clickbench_q32/duckdb:vortex-file-compressed 🚨 1521824905 1366723606 1.11
clickbench_q33/duckdb:vortex-file-compressed 🚨 2064848666 1555517542 1.33
clickbench_q34/duckdb:vortex-file-compressed 🚨 2059543335 1504080798 1.37
clickbench_q35/duckdb:vortex-file-compressed 379223021 379624742 1.00
clickbench_q36/duckdb:vortex-file-compressed 🚀 29501755 36151746 0.82
clickbench_q37/duckdb:vortex-file-compressed 23026855 25135656 0.92
clickbench_q38/duckdb:vortex-file-compressed 25488469 28105803 0.91
clickbench_q39/duckdb:vortex-file-compressed 45419070 48320051 0.94
clickbench_q40/duckdb:vortex-file-compressed 🚀 21079238 26713836 0.79
clickbench_q41/duckdb:vortex-file-compressed 🚀 21194914 25680244 0.83
clickbench_q42/duckdb:vortex-file-compressed 🚀 19805725 26817585 0.74
duckdb / parquet (1.021x ➖, 0↑ 1↓)
name PR 7847609 (ns) base 19403db (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 262932076 240647739 1.09
clickbench_q01/duckdb:parquet 53233985 52078988 1.02
clickbench_q02/duckdb:parquet 72448372 67338670 1.08
clickbench_q03/duckdb:parquet 68303207 64925279 1.05
clickbench_q04/duckdb:parquet 219537696 207718471 1.06
clickbench_q05/duckdb:parquet 301612069 282969233 1.07
clickbench_q06/duckdb:parquet 60799756 61268350 0.99
clickbench_q07/duckdb:parquet 53801995 52291589 1.03
clickbench_q08/duckdb:parquet 275970718 275484324 1.00
clickbench_q09/duckdb:parquet 399836032 402762292 0.99
clickbench_q10/duckdb:parquet 96957313 97865854 0.99
clickbench_q11/duckdb:parquet 109041598 110470391 0.99
clickbench_q12/duckdb:parquet 300022210 303442404 0.99
clickbench_q13/duckdb:parquet 524166734 524054678 1.00
clickbench_q14/duckdb:parquet 341008712 338303091 1.01
clickbench_q15/duckdb:parquet 248275611 246372637 1.01
clickbench_q16/duckdb:parquet 653282452 618752364 1.06
clickbench_q17/duckdb:parquet 513760875 510955934 1.01
clickbench_q18/duckdb:parquet 1081484767 1055364943 1.02
clickbench_q19/duckdb:parquet 50859183 48473754 1.05
clickbench_q20/duckdb:parquet 450394719 432360140 1.04
clickbench_q21/duckdb:parquet 🚨 626441249 559035274 1.12
clickbench_q22/duckdb:parquet 991153712 921256878 1.08
clickbench_q23/duckdb:parquet 328810750 309587887 1.06
clickbench_q24/duckdb:parquet 78777163 77137996 1.02
clickbench_q25/duckdb:parquet 142786606 142075932 1.01
clickbench_q26/duckdb:parquet 52745340 52955597 1.00
clickbench_q27/duckdb:parquet 656708807 653511201 1.00
clickbench_q28/duckdb:parquet 4832942824 4853236265 1.00
clickbench_q29/duckdb:parquet 61716080 62029517 0.99
clickbench_q30/duckdb:parquet 307619509 305815179 1.01
clickbench_q31/duckdb:parquet 351560643 352332385 1.00
clickbench_q32/duckdb:parquet 1191106103 1181436889 1.01
clickbench_q33/duckdb:parquet 1224235015 1229156668 1.00
clickbench_q34/duckdb:parquet 1362499983 1292340366 1.05
clickbench_q35/duckdb:parquet 353886976 356021278 0.99
clickbench_q36/duckdb:parquet 65768001 65258760 1.01
clickbench_q37/duckdb:parquet 53016737 54899969 0.97
clickbench_q38/duckdb:parquet 59126515 57176636 1.03
clickbench_q39/duckdb:parquet 102701610 102240669 1.00
clickbench_q40/duckdb:parquet 55735886 56053713 0.99
clickbench_q41/duckdb:parquet 60489359 59310970 1.02
clickbench_q42/duckdb:parquet 51284113 49683471 1.03
duckdb / duckdb (0.933x ➖, 5↑ 0↓)
name PR 7847609 (ns) base 19403db (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚀 18105797 20373585 0.89
clickbench_q01/duckdb:duckdb 34334655 37721284 0.91
clickbench_q02/duckdb:duckdb 46334818 50395418 0.92
clickbench_q03/duckdb:duckdb 47385116 52510119 0.90
clickbench_q04/duckdb:duckdb 212129534 232833508 0.91
clickbench_q05/duckdb:duckdb 315877987 343172195 0.92
clickbench_q06/duckdb:duckdb 36131141 39968288 0.90
clickbench_q07/duckdb:duckdb 36270150 39825786 0.91
clickbench_q08/duckdb:duckdb 306288330 331498363 0.92
clickbench_q09/duckdb:duckdb 🚀 469599409 531029465 0.88
clickbench_q10/duckdb:duckdb 98711762 103938314 0.95
clickbench_q11/duckdb:duckdb 107517353 112117897 0.96
clickbench_q12/duckdb:duckdb 299716545 327944777 0.91
clickbench_q13/duckdb:duckdb 🚀 519410808 581833646 0.89
clickbench_q14/duckdb:duckdb 356784467 383698841 0.93
clickbench_q15/duckdb:duckdb 273731688 279831104 0.98
clickbench_q16/duckdb:duckdb 685174813 711834693 0.96
clickbench_q17/duckdb:duckdb 582947736 613590183 0.95
clickbench_q18/duckdb:duckdb 1293854168 1338645796 0.97
clickbench_q19/duckdb:duckdb 36086290 38035420 0.95
clickbench_q20/duckdb:duckdb 957951859 953718752 1.00
clickbench_q21/duckdb:duckdb 🚀 915480301 1128964607 0.81
clickbench_q22/duckdb:duckdb 1065461627 1098202787 0.97
clickbench_q23/duckdb:duckdb 258057303 262418059 0.98
clickbench_q24/duckdb:duckdb 61769481 64111861 0.96
clickbench_q25/duckdb:duckdb 122363218 125528431 0.97
clickbench_q26/duckdb:duckdb 55498193 59344166 0.94
clickbench_q27/duckdb:duckdb 🚀 929730446 1151641807 0.81
clickbench_q28/duckdb:duckdb 4729505479 4735066812 1.00
clickbench_q29/duckdb:duckdb 49685134 53009240 0.94
clickbench_q30/duckdb:duckdb 295720889 297806558 0.99
clickbench_q31/duckdb:duckdb 433328154 417560732 1.04
clickbench_q32/duckdb:duckdb 1427274328 1557976039 0.92
clickbench_q33/duckdb:duckdb 1867301638 2013960826 0.93
clickbench_q34/duckdb:duckdb 1956090669 2114167795 0.93
clickbench_q35/duckdb:duckdb 264505859 269440855 0.98
clickbench_q36/duckdb:duckdb 40308503 44638552 0.90
clickbench_q37/duckdb:duckdb 32330161 34992887 0.92
clickbench_q38/duckdb:duckdb 31545656 33515695 0.94
clickbench_q39/duckdb:duckdb 66918542 70804062 0.95
clickbench_q40/duckdb:duckdb 32030717 35195340 0.91
clickbench_q41/duckdb:duckdb 31252992 33165618 0.94
clickbench_q42/duckdb:duckdb 31884526 35013247 0.91
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +3.5% +2.4% +1.1% +503.5% ➖ noise
0 duckdb:duckdb -11.1% +2.4% -13.2% +260.0% ➖ noise
0 duckdb:vortex-file-compressed -5.7% +2.4% -7.9% +308.1% ➖ noise
1 datafusion:vortex-file-compressed -0.6% +1.9% -2.5% +28.0% ➖ noise
1 duckdb:duckdb -9.0% +1.9% -10.7% +59.6% ➖ noise
1 duckdb:vortex-file-compressed +8.0% +1.9% +5.9% +18.8% ➖ noise
2 datafusion:vortex-file-compressed -3.2% +3.4% -6.4% +33.6% ➖ noise
2 duckdb:duckdb -8.1% +3.4% -11.1% +21.1% ➖ noise
2 duckdb:vortex-file-compressed +2.5% +3.4% -0.9% +18.8% ➖ noise
3 datafusion:vortex-file-compressed +1.5% +1.8% -0.3% +173.9% ➖ noise
3 duckdb:duckdb -9.8% +1.8% -11.4% +53.1% ➖ noise
3 duckdb:vortex-file-compressed +0.7% +1.8% -1.0% +30.3% ➖ noise
4 datafusion:vortex-file-compressed +2.7% +5.3% -2.5% +18.8% ➖ noise
4 duckdb:duckdb -8.9% +5.3% -13.5% +18.8% ➖ noise
4 duckdb:vortex-file-compressed +4.4% +5.3% -0.9% +18.8% ➖ noise
5 datafusion:vortex-file-compressed +2.3% +7.5% -4.9% +18.8% ➖ noise
5 duckdb:duckdb -8.0% +7.5% -14.4% +18.8% ➖ noise
5 duckdb:vortex-file-compressed +3.3% +7.5% -4.0% +18.8% ➖ noise
6 datafusion:vortex-file-compressed +13.0% -1.2% +14.3% +36.9% ➖ noise
6 duckdb:duckdb -9.6% -1.2% -8.5% +28.4% ➖ noise
6 duckdb:vortex-file-compressed +3.1% -1.2% +4.3% +18.8% ➖ noise
7 datafusion:vortex-file-compressed +0.8% +1.9% -1.0% +18.8% ➖ noise
7 duckdb:duckdb -8.9% +1.9% -10.6% +18.8% ➖ noise
7 duckdb:vortex-file-compressed -4.5% +1.9% -6.3% +18.8% ➖ noise
8 datafusion:vortex-file-compressed +1.7% +2.7% -0.9% +18.8% ➖ noise
8 duckdb:duckdb -7.6% +2.7% -10.0% +18.8% ➖ noise
8 duckdb:vortex-file-compressed +7.3% +2.7% +4.5% +18.8% ➖ noise
9 datafusion:vortex-file-compressed +4.7% +2.0% +2.6% +18.8% ➖ noise
9 duckdb:duckdb -11.6% +2.0% -13.3% +18.8% ➖ noise
9 duckdb:vortex-file-compressed +1.7% +2.0% -0.4% +18.8% ➖ noise
10 datafusion:vortex-file-compressed +0.8% +3.8% -2.9% +18.8% ➖ noise
10 duckdb:duckdb -5.0% +3.8% -8.5% +18.8% ➖ noise
10 duckdb:vortex-file-compressed +2.0% +3.8% -1.6% +18.8% ➖ noise
11 datafusion:vortex-file-compressed +3.5% +0.0% +3.5% +18.8% ➖ noise
11 duckdb:duckdb -4.1% +0.0% -4.1% +18.8% ➖ noise
11 duckdb:vortex-file-compressed +4.2% +0.0% +4.2% +18.8% ➖ noise
12 datafusion:vortex-file-compressed -0.7% +2.4% -3.0% +18.8% ➖ noise
12 duckdb:duckdb -8.6% +2.4% -10.7% +18.8% ➖ noise
12 duckdb:vortex-file-compressed +3.0% +2.4% +0.6% +18.8% ➖ noise
13 datafusion:vortex-file-compressed +1.1% +2.3% -1.2% +18.8% ➖ noise
13 duckdb:duckdb -10.7% +2.3% -12.8% +18.8% ➖ noise
13 duckdb:vortex-file-compressed +10.8% +2.3% +8.3% +18.8% ➖ noise
14 datafusion:vortex-file-compressed -5.0% +1.4% -6.3% +18.8% ➖ noise
14 duckdb:duckdb -7.0% +1.4% -8.3% +18.8% ➖ noise
14 duckdb:vortex-file-compressed +19.5% +1.4% +17.9% +18.8% ➖ noise
15 datafusion:vortex-file-compressed +1.2% +0.5% +0.6% +18.8% ➖ noise
15 duckdb:duckdb -2.2% +0.5% -2.7% +18.8% ➖ noise
15 duckdb:vortex-file-compressed +18.4% +0.5% +17.8% +18.8% ➖ noise
16 datafusion:vortex-file-compressed -0.6% +5.1% -5.4% +18.8% ➖ noise
16 duckdb:duckdb -3.7% +5.1% -8.4% +18.8% ➖ noise
16 duckdb:vortex-file-compressed +21.5% +5.1% +15.6% +18.8% ➖ noise
17 datafusion:vortex-file-compressed +3.5% +19.2% -13.2% +18.8% ➖ noise
17 duckdb:duckdb -5.0% +19.2% -20.3% +18.8% ✅ faster
17 duckdb:vortex-file-compressed +42.3% +19.2% +19.4% +18.8% 🚨 regression
18 datafusion:vortex-file-compressed +0.3% +35.5% -26.0% +18.8% ✅ faster
18 duckdb:duckdb -3.3% +35.5% -28.7% +18.8% ✅ faster
18 duckdb:vortex-file-compressed +20.7% +35.5% -11.0% +18.8% ➖ noise
19 datafusion:vortex-file-compressed +4.1% +17.9% -11.7% +18.8% ➖ noise
19 duckdb:duckdb -5.1% +17.9% -19.5% +18.8% ✅ faster
19 duckdb:vortex-file-compressed +6.3% +17.9% -9.8% +25.4% ➖ noise
20 datafusion:vortex-file-compressed +1.1% +3.3% -2.2% +190.2% ➖ noise
20 duckdb:duckdb +0.4% +3.3% -2.8% +28.2% ➖ noise
20 duckdb:vortex-file-compressed +19.7% +3.3% +15.8% +18.8% ➖ noise
21 datafusion:vortex-file-compressed +0.7% +7.5% -6.3% +18.8% ➖ noise
21 duckdb:duckdb -18.9% +7.5% -24.6% +18.8% ✅ faster
21 duckdb:vortex-file-compressed +15.5% +7.5% +7.4% +18.8% ➖ noise
22 datafusion:vortex-file-compressed +9.8% +4.0% +5.6% +18.8% ➖ noise
22 duckdb:duckdb -3.0% +4.0% -6.7% +18.8% ➖ noise
22 duckdb:vortex-file-compressed +12.7% +4.0% +8.4% +20.5% ➖ noise
23 datafusion:vortex-file-compressed +37.9% +5.4% +30.8% +46.2% ➖ noise
23 duckdb:duckdb -1.7% +5.4% -6.7% +18.8% ➖ noise
23 duckdb:vortex-file-compressed +79.7% +5.4% +70.5% +55.0% 🚨 regression
24 datafusion:vortex-file-compressed +8.5% -0.0% +8.6% +18.8% ➖ noise
24 duckdb:duckdb -3.7% -0.0% -3.6% +18.8% ➖ noise
24 duckdb:vortex-file-compressed +2.7% -0.0% +2.7% +32.7% ➖ noise
25 datafusion:vortex-file-compressed -0.1% -0.2% +0.1% +18.8% ➖ noise
25 duckdb:duckdb -2.5% -0.2% -2.3% +18.8% ➖ noise
25 duckdb:vortex-file-compressed +10.2% -0.2% +10.4% +18.8% ➖ noise
26 datafusion:vortex-file-compressed -1.8% -0.1% -1.7% +18.8% ➖ noise
26 duckdb:duckdb -6.5% -0.1% -6.4% +18.8% ➖ noise
26 duckdb:vortex-file-compressed +1.2% -0.1% +1.3% +27.7% ➖ noise
27 datafusion:vortex-file-compressed +1.8% +0.9% +0.9% +18.8% ➖ noise
27 duckdb:duckdb -19.3% +0.9% -20.0% +18.8% ✅ faster
27 duckdb:vortex-file-compressed +1.6% +0.9% +0.7% +18.8% ➖ noise
28 datafusion:vortex-file-compressed -1.2% -1.4% +0.2% +18.8% ➖ noise
28 duckdb:duckdb -0.1% -1.4% +1.3% +18.8% ➖ noise
28 duckdb:vortex-file-compressed -0.7% -1.4% +0.7% +18.8% ➖ noise
29 datafusion:vortex-file-compressed -5.6% +1.2% -6.7% +18.8% ➖ noise
29 duckdb:duckdb -6.3% +1.2% -7.4% +18.8% ➖ noise
29 duckdb:vortex-file-compressed -0.7% +1.2% -1.9% +18.8% ➖ noise
30 datafusion:vortex-file-compressed +9.5% +1.6% +7.8% +18.8% ➖ noise
30 duckdb:duckdb -0.7% +1.6% -2.2% +18.8% ➖ noise
30 duckdb:vortex-file-compressed +0.4% +1.6% -1.1% +18.8% ➖ noise
31 datafusion:vortex-file-compressed +2.3% +1.1% +1.2% +18.8% ➖ noise
31 duckdb:duckdb +3.8% +1.1% +2.6% +18.8% ➖ noise
31 duckdb:vortex-file-compressed +3.5% +1.1% +2.3% +18.8% ➖ noise
32 datafusion:vortex-file-compressed +9.4% +1.6% +7.7% +18.8% ➖ noise
32 duckdb:duckdb -8.4% +1.6% -9.8% +18.8% ➖ noise
32 duckdb:vortex-file-compressed +11.3% +1.6% +9.6% +18.8% ➖ noise
33 datafusion:vortex-file-compressed +19.6% +31.4% -8.9% +18.8% ➖ noise
33 duckdb:duckdb -7.3% +31.4% -29.4% +18.8% ✅ faster
33 duckdb:vortex-file-compressed +32.7% +31.4% +1.0% +18.8% ➖ noise
34 datafusion:vortex-file-compressed +22.6% +3.8% +18.2% +18.8% ➖ noise
34 duckdb:duckdb -7.5% +3.8% -10.8% +18.8% ➖ noise
34 duckdb:vortex-file-compressed +36.9% +3.8% +31.9% +19.7% 🚨 regression
35 datafusion:vortex-file-compressed +20.7% +1.9% +18.5% +18.8% ➖ noise
35 duckdb:duckdb -1.8% +1.9% -3.6% +18.8% ➖ noise
35 duckdb:vortex-file-compressed -0.1% +1.9% -2.0% +18.8% ➖ noise
36 datafusion:vortex-file-compressed +12.2% +5.4% +6.5% +18.8% ➖ noise
36 duckdb:duckdb -9.7% +5.4% -14.3% +18.8% ➖ noise
36 duckdb:vortex-file-compressed -18.4% +5.4% -22.6% +18.8% ✅ faster
37 datafusion:vortex-file-compressed +20.0% -1.8% +22.2% +18.8% 🚨 regression
37 duckdb:duckdb -7.6% -1.8% -5.9% +18.8% ➖ noise
37 duckdb:vortex-file-compressed -8.4% -1.8% -6.7% +18.8% ➖ noise
38 datafusion:vortex-file-compressed +20.0% +3.7% +15.6% +18.8% ➖ noise
38 duckdb:duckdb -5.9% +3.7% -9.3% +18.8% ➖ noise
38 duckdb:vortex-file-compressed -9.3% +3.7% -12.6% +18.8% ➖ noise
39 datafusion:vortex-file-compressed +18.3% +2.7% +15.2% +18.8% ➖ noise
39 duckdb:duckdb -5.5% +2.7% -8.0% +18.8% ➖ noise
39 duckdb:vortex-file-compressed -6.0% +2.7% -8.5% +18.8% ➖ noise
40 datafusion:vortex-file-compressed +12.6% -0.8% +13.4% +18.8% ➖ noise
40 duckdb:duckdb -9.0% -0.8% -8.3% +18.8% ➖ noise
40 duckdb:vortex-file-compressed -21.1% -0.8% -20.5% +18.8% ✅ faster
41 datafusion:vortex-file-compressed +13.8% +3.9% +9.6% +18.8% ➖ noise
41 duckdb:duckdb -5.8% +3.9% -9.3% +18.8% ➖ noise
41 duckdb:vortex-file-compressed -17.5% +3.9% -20.6% +18.8% ✅ faster
42 datafusion:vortex-file-compressed +23.3% +4.8% +17.7% +18.8% ➖ noise
42 duckdb:duckdb -8.9% +4.8% -13.1% +18.8% ➖ noise
42 duckdb:vortex-file-compressed -26.1% +4.8% -29.5% +18.8% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +9.2%
Vortex (geomean): 1.124x ➖
Parquet (geomean): 1.028x ➖
Shifts: Parquet (control) +2.8% · Median polish +9.9%


datafusion / vortex-file-compressed (1.371x ❌, 0↑ 12↓)
name PR 7847609 (ns) base 19403db (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 804477024 718682374 1.12
tpch_q02/datafusion:vortex-file-compressed 1413013983 1631858706 0.87
tpch_q03/datafusion:vortex-file-compressed 1212983235 966918942 1.25
tpch_q04/datafusion:vortex-file-compressed 🚨 879192179 647116946 1.36
tpch_q05/datafusion:vortex-file-compressed 🚨 1398943707 953922902 1.47
tpch_q06/datafusion:vortex-file-compressed 🚨 786495526 595244730 1.32
tpch_q07/datafusion:vortex-file-compressed 🚨 1520937611 1077772606 1.41
tpch_q08/datafusion:vortex-file-compressed 1750154521 1508737409 1.16
tpch_q09/datafusion:vortex-file-compressed 1721506412 1381859634 1.25
tpch_q10/datafusion:vortex-file-compressed 🚨 2113408147 1033050514 2.05
tpch_q11/datafusion:vortex-file-compressed 🚨 1355973627 484377705 2.80
tpch_q12/datafusion:vortex-file-compressed 🚨 1705168277 926247822 1.84
tpch_q13/datafusion:vortex-file-compressed 🚨 686584457 441584441 1.55
tpch_q14/datafusion:vortex-file-compressed 🚨 819703949 584808971 1.40
tpch_q15/datafusion:vortex-file-compressed 🚨 1479044811 1131878700 1.31
tpch_q16/datafusion:vortex-file-compressed 🚨 721482999 336610146 2.14
tpch_q17/datafusion:vortex-file-compressed 1498684781 1230346870 1.22
tpch_q18/datafusion:vortex-file-compressed 1456030686 1267047861 1.15
tpch_q19/datafusion:vortex-file-compressed 818330022 928776253 0.88
tpch_q20/datafusion:vortex-file-compressed 1048301337 979392147 1.07
tpch_q21/datafusion:vortex-file-compressed 1980268384 1803763927 1.10
tpch_q22/datafusion:vortex-file-compressed 🚨 624891826 369328449 1.69
datafusion / vortex-compact (0.964x ➖, 4↑ 2↓)
name PR 7847609 (ns) base 19403db (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 712581282 762451673 0.93
tpch_q02/datafusion:vortex-compact 942461309 767885435 1.23
tpch_q03/datafusion:vortex-compact 967361440 820223271 1.18
tpch_q04/datafusion:vortex-compact 733293876 615398778 1.19
tpch_q05/datafusion:vortex-compact 1145217847 1081569100 1.06
tpch_q06/datafusion:vortex-compact 🚨 1073196120 606098924 1.77
tpch_q07/datafusion:vortex-compact 1492481892 1257938557 1.19
tpch_q08/datafusion:vortex-compact 🚀 1323149268 1932902606 0.68
tpch_q09/datafusion:vortex-compact 1434777815 1499420175 0.96
tpch_q10/datafusion:vortex-compact 1097195355 1170909982 0.94
tpch_q11/datafusion:vortex-compact 609388842 685427402 0.89
tpch_q12/datafusion:vortex-compact 865423143 1054877188 0.82
tpch_q13/datafusion:vortex-compact 399121072 438685204 0.91
tpch_q14/datafusion:vortex-compact 🚀 539429981 922212047 0.58
tpch_q15/datafusion:vortex-compact 1022511626 1119245944 0.91
tpch_q16/datafusion:vortex-compact 🚀 436489741 627806625 0.70
tpch_q17/datafusion:vortex-compact 1164776042 1329427893 0.88
tpch_q18/datafusion:vortex-compact 1251524559 1335690250 0.94
tpch_q19/datafusion:vortex-compact 🚨 1418913037 1069530135 1.33
tpch_q20/datafusion:vortex-compact 1774813015 1383513867 1.28
tpch_q21/datafusion:vortex-compact 2460933089 2223685228 1.11
tpch_q22/datafusion:vortex-compact 🚀 688939255 1303478552 0.53
datafusion / parquet (0.986x ➖, 4↑ 4↓)
name PR 7847609 (ns) base 19403db (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 832441185 1092912681 0.76
tpch_q02/datafusion:parquet 🚀 1175737797 1795213340 0.65
tpch_q03/datafusion:parquet 🚀 1020183510 1922057905 0.53
tpch_q04/datafusion:parquet 🚀 500224634 749054923 0.67
tpch_q05/datafusion:parquet 🚀 1355953340 1943690384 0.70
tpch_q06/datafusion:parquet 560029724 644498829 0.87
tpch_q07/datafusion:parquet 1900810435 2196788792 0.87
tpch_q08/datafusion:parquet 2647841947 2420252311 1.09
tpch_q09/datafusion:parquet 2090529456 2982409935 0.70
tpch_q10/datafusion:parquet 3255923387 3014412135 1.08
tpch_q11/datafusion:parquet 🚨 991162932 735421117 1.35
tpch_q12/datafusion:parquet 1030622406 881610798 1.17
tpch_q13/datafusion:parquet 798417062 887870809 0.90
tpch_q14/datafusion:parquet 889158948 796882152 1.12
tpch_q15/datafusion:parquet 1304991668 1220962768 1.07
tpch_q16/datafusion:parquet 797360817 823464490 0.97
tpch_q17/datafusion:parquet 1506790399 1446795060 1.04
tpch_q18/datafusion:parquet 1925496793 2025975634 0.95
tpch_q19/datafusion:parquet 1281777172 1092922763 1.17
tpch_q20/datafusion:parquet 🚨 2834309430 1852289564 1.53
tpch_q21/datafusion:parquet 🚨 3305786030 1984077471 1.67
tpch_q22/datafusion:parquet 🚨 2520684556 1279045665 1.97
duckdb / vortex-file-compressed (1.101x ➖, 0↑ 7↓)
name PR 7847609 (ns) base 19403db (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 638148909 701084809 0.91
tpch_q02/duckdb:vortex-file-compressed 🚨 1717543750 1188147705 1.45
tpch_q03/duckdb:vortex-file-compressed 954392297 1059820007 0.90
tpch_q04/duckdb:vortex-file-compressed 827495633 730658767 1.13
tpch_q05/duckdb:vortex-file-compressed 1140666371 1218372461 0.94
tpch_q06/duckdb:vortex-file-compressed 957267049 858777147 1.11
tpch_q07/duckdb:vortex-file-compressed 1087001919 1092840758 0.99
tpch_q08/duckdb:vortex-file-compressed 1828522036 1490666076 1.23
tpch_q09/duckdb:vortex-file-compressed 🚨 2093677073 1526727250 1.37
tpch_q10/duckdb:vortex-file-compressed 1348627224 1731492536 0.78
tpch_q11/duckdb:vortex-file-compressed 807491212 735839925 1.10
tpch_q12/duckdb:vortex-file-compressed 🚨 989550467 760801829 1.30
tpch_q13/duckdb:vortex-file-compressed 1092561885 1237379379 0.88
tpch_q14/duckdb:vortex-file-compressed 1054574014 877317770 1.20
tpch_q15/duckdb:vortex-file-compressed 🚨 716248863 550923844 1.30
tpch_q16/duckdb:vortex-file-compressed 490371964 548734882 0.89
tpch_q17/duckdb:vortex-file-compressed 912503598 1286289471 0.71
tpch_q18/duckdb:vortex-file-compressed 🚨 1478552302 1062029598 1.39
tpch_q19/duckdb:vortex-file-compressed 🚨 1187485687 797016666 1.49
tpch_q20/duckdb:vortex-file-compressed 1642889697 1267126035 1.30
tpch_q21/duckdb:vortex-file-compressed 2380069078 2376343796 1.00
tpch_q22/duckdb:vortex-file-compressed 🚨 743905144 551629487 1.35
duckdb / vortex-compact (1.096x ➖, 0↑ 4↓)
name PR 7847609 (ns) base 19403db (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 739323798 622913652 1.19
tpch_q02/duckdb:vortex-compact 1070942741 1235707571 0.87
tpch_q03/duckdb:vortex-compact 891815678 978022726 0.91
tpch_q04/duckdb:vortex-compact 703123517 737952936 0.95
tpch_q05/duckdb:vortex-compact 1309332197 1293163891 1.01
tpch_q06/duckdb:vortex-compact 851113172 730942030 1.16
tpch_q07/duckdb:vortex-compact 🚨 1523886791 1150668164 1.32
tpch_q08/duckdb:vortex-compact 1451098644 1515836963 0.96
tpch_q09/duckdb:vortex-compact 🚨 1813551404 1387682107 1.31
tpch_q10/duckdb:vortex-compact 1616388801 1310617047 1.23
tpch_q11/duckdb:vortex-compact 715099663 701525577 1.02
tpch_q12/duckdb:vortex-compact 🚨 1078914518 690403003 1.56
tpch_q13/duckdb:vortex-compact 955365332 1033246434 0.92
tpch_q14/duckdb:vortex-compact 944728288 876420851 1.08
tpch_q15/duckdb:vortex-compact 604756826 551023837 1.10
tpch_q16/duckdb:vortex-compact 🚨 511959369 370104576 1.38
tpch_q17/duckdb:vortex-compact 899820475 1042466540 0.86
tpch_q18/duckdb:vortex-compact 962353783 1043719392 0.92
tpch_q19/duckdb:vortex-compact 940042327 975027293 0.96
tpch_q20/duckdb:vortex-compact 1654658834 1320459043 1.25
tpch_q21/duckdb:vortex-compact 2158109968 1820165132 1.19
tpch_q22/duckdb:vortex-compact 695144102 549318727 1.27
duckdb / parquet (1.073x ➖, 1↑ 4↓)
name PR 7847609 (ns) base 19403db (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 995530827 1323600014 0.75
tpch_q02/duckdb:parquet 1589874676 1677922772 0.95
tpch_q03/duckdb:parquet 2273563252 2128797733 1.07
tpch_q04/duckdb:parquet 1273447160 1010773241 1.26
tpch_q05/duckdb:parquet 2579620273 2475527021 1.04
tpch_q06/duckdb:parquet 1173662281 1358608747 0.86
tpch_q07/duckdb:parquet 2265895989 2080696154 1.09
tpch_q08/duckdb:parquet 🚨 3160052552 2196712792 1.44
tpch_q09/duckdb:parquet 🚨 3485479879 2551284539 1.37
tpch_q10/duckdb:parquet 4442800657 3851675093 1.15
tpch_q11/duckdb:parquet 🚨 1136444139 871781992 1.30
tpch_q12/duckdb:parquet 1166344794 1311130238 0.89
tpch_q13/duckdb:parquet 1677027262 1473425103 1.14
tpch_q14/duckdb:parquet 1479594448 1281754899 1.15
tpch_q15/duckdb:parquet 1048153634 938456511 1.12
tpch_q16/duckdb:parquet 🚀 757817208 1207606986 0.63
tpch_q17/duckdb:parquet 1406960131 1697084064 0.83
tpch_q18/duckdb:parquet 🚨 1883340279 1242636381 1.52
tpch_q19/duckdb:parquet 1945197863 1628978467 1.19
tpch_q20/duckdb:parquet 1852431651 1595465778 1.16
tpch_q21/duckdb:parquet 2255250475 2007035836 1.12
tpch_q22/duckdb:parquet 1041833124 989100222 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -6.5% -24.3% +23.5% +90.4% ➖ noise
1 datafusion:vortex-file-compressed +11.9% -24.3% +47.9% +127.6% ➖ noise
1 duckdb:vortex-compact +18.7% -24.3% +56.8% +79.4% ➖ noise
1 duckdb:vortex-file-compressed -9.0% -24.3% +20.3% +68.6% ➖ noise
2 datafusion:vortex-compact +22.7% -21.2% +55.8% +75.6% ➖ noise
2 datafusion:vortex-file-compressed -13.4% -21.2% +9.9% +68.6% ➖ noise
2 duckdb:vortex-compact -13.3% -21.2% +10.0% +90.7% ➖ noise
2 duckdb:vortex-file-compressed +44.6% -21.2% +83.5% +93.4% ➖ noise
3 datafusion:vortex-compact +17.9% -24.7% +56.6% +85.5% ➖ noise
3 datafusion:vortex-file-compressed +25.4% -24.7% +66.6% +98.3% ➖ noise
3 duckdb:vortex-compact -8.8% -24.7% +21.1% +73.4% ➖ noise
3 duckdb:vortex-file-compressed -9.9% -24.7% +19.6% +87.2% ➖ noise
4 datafusion:vortex-compact +19.2% -8.3% +29.9% +68.6% ➖ noise
4 datafusion:vortex-file-compressed +35.9% -8.3% +48.1% +68.6% ➖ noise
4 duckdb:vortex-compact -4.7% -8.3% +3.9% +68.6% ➖ noise
4 duckdb:vortex-file-compressed +13.3% -8.3% +23.5% +68.6% ➖ noise
5 datafusion:vortex-compact +5.9% -14.7% +24.2% +68.6% ➖ noise
5 datafusion:vortex-file-compressed +46.7% -14.7% +72.0% +68.6% 🚨 regression
5 duckdb:vortex-compact +1.3% -14.7% +18.8% +68.6% ➖ noise
5 duckdb:vortex-file-compressed -6.4% -14.7% +9.8% +68.6% ➖ noise
6 datafusion:vortex-compact +77.1% -13.4% +104.4% +68.6% 🚨 regression
6 datafusion:vortex-file-compressed +32.1% -13.4% +52.5% +68.6% ➖ noise
6 duckdb:vortex-compact +16.4% -13.4% +34.4% +68.6% ➖ noise
6 duckdb:vortex-file-compressed +11.5% -13.4% +28.7% +68.6% ➖ noise
7 datafusion:vortex-compact +18.6% -2.9% +22.2% +68.6% ➖ noise
7 datafusion:vortex-file-compressed +41.1% -2.9% +45.4% +68.6% ➖ noise
7 duckdb:vortex-compact +32.4% -2.9% +36.4% +68.6% ➖ noise
7 duckdb:vortex-file-compressed -0.5% -2.9% +2.5% +68.6% ➖ noise
8 datafusion:vortex-compact -31.5% +25.5% -45.4% +81.2% ✅ faster
8 datafusion:vortex-file-compressed +16.0% +25.5% -7.5% +68.6% ➖ noise
8 duckdb:vortex-compact -4.3% +25.5% -23.7% +68.6% ➖ noise
8 duckdb:vortex-file-compressed +22.7% +25.5% -2.2% +68.6% ➖ noise
9 datafusion:vortex-compact -4.3% -2.1% -2.2% +68.6% ➖ noise
9 datafusion:vortex-file-compressed +24.6% -2.1% +27.3% +68.6% ➖ noise
9 duckdb:vortex-compact +30.7% -2.1% +33.5% +68.6% ➖ noise
9 duckdb:vortex-file-compressed +37.1% -2.1% +40.1% +68.6% ➖ noise
10 datafusion:vortex-compact -6.3% +11.6% -16.0% +68.6% ➖ noise
10 datafusion:vortex-file-compressed +104.6% +11.6% +83.3% +68.6% 🚨 regression
10 duckdb:vortex-compact +23.3% +11.6% +10.5% +68.6% ➖ noise
10 duckdb:vortex-file-compressed -22.1% +11.6% -30.2% +68.6% ➖ noise
11 datafusion:vortex-compact -11.1% +32.5% -32.9% +68.6% ➖ noise
11 datafusion:vortex-file-compressed +179.9% +32.5% +111.2% +68.6% 🚨 regression
11 duckdb:vortex-compact +1.9% +32.5% -23.1% +68.6% ➖ noise
11 duckdb:vortex-file-compressed +9.7% +32.5% -17.2% +68.6% ➖ noise
12 datafusion:vortex-compact -18.0% +2.0% -19.6% +68.6% ➖ noise
12 datafusion:vortex-file-compressed +84.1% +2.0% +80.5% +68.6% 🚨 regression
12 duckdb:vortex-compact +56.3% +2.0% +53.2% +68.6% ➖ noise
12 duckdb:vortex-file-compressed +30.1% +2.0% +27.5% +69.3% ➖ noise
13 datafusion:vortex-compact -9.0% +1.2% -10.1% +68.6% ➖ noise
13 datafusion:vortex-file-compressed +55.5% +1.2% +53.7% +68.6% ➖ noise
13 duckdb:vortex-compact -7.5% +1.2% -8.6% +92.8% ➖ noise
13 duckdb:vortex-file-compressed -11.7% +1.2% -12.7% +121.3% ➖ noise
14 datafusion:vortex-compact -41.5% +13.5% -48.5% +68.6% ✅ faster
14 datafusion:vortex-file-compressed +40.2% +13.5% +23.5% +68.6% ➖ noise
14 duckdb:vortex-compact +7.8% +13.5% -5.0% +68.6% ➖ noise
14 duckdb:vortex-file-compressed +20.2% +13.5% +5.9% +68.6% ➖ noise
15 datafusion:vortex-compact -8.6% +9.3% -16.4% +68.6% ➖ noise
15 datafusion:vortex-file-compressed +30.7% +9.3% +19.6% +68.6% ➖ noise
15 duckdb:vortex-compact +9.8% +9.3% +0.5% +95.1% ➖ noise
15 duckdb:vortex-file-compressed +30.0% +9.3% +19.0% +68.6% ➖ noise
16 datafusion:vortex-compact -30.5% -22.0% -10.8% +68.6% ➖ noise
16 datafusion:vortex-file-compressed +114.3% -22.0% +175.0% +68.6% 🚨 regression
16 duckdb:vortex-compact +38.3% -22.0% +77.5% +81.2% ➖ noise
16 duckdb:vortex-file-compressed -10.6% -22.0% +14.6% +68.6% ➖ noise
17 datafusion:vortex-compact -12.4% -7.1% -5.7% +68.6% ➖ noise
17 datafusion:vortex-file-compressed +21.8% -7.1% +31.1% +68.6% ➖ noise
17 duckdb:vortex-compact -13.7% -7.1% -7.1% +68.6% ➖ noise
17 duckdb:vortex-file-compressed -29.1% -7.1% -23.7% +68.6% ➖ noise
18 datafusion:vortex-compact -6.3% +20.0% -21.9% +68.6% ➖ noise
18 datafusion:vortex-file-compressed +14.9% +20.0% -4.3% +68.6% ➖ noise
18 duckdb:vortex-compact -7.8% +20.0% -23.2% +68.6% ➖ noise
18 duckdb:vortex-file-compressed +39.2% +20.0% +16.0% +68.6% ➖ noise
19 datafusion:vortex-compact +32.7% +18.3% +12.1% +68.6% ➖ noise
19 datafusion:vortex-file-compressed -11.9% +18.3% -25.5% +68.6% ➖ noise
19 duckdb:vortex-compact -3.6% +18.3% -18.5% +68.6% ➖ noise
19 duckdb:vortex-file-compressed +49.0% +18.3% +25.9% +68.6% ➖ noise
20 datafusion:vortex-compact +28.3% +33.3% -3.8% +68.6% ➖ noise
20 datafusion:vortex-file-compressed +7.0% +33.3% -19.7% +68.6% ➖ noise
20 duckdb:vortex-compact +25.3% +33.3% -6.0% +68.6% ➖ noise
20 duckdb:vortex-file-compressed +29.7% +33.3% -2.7% +68.6% ➖ noise
21 datafusion:vortex-compact +10.7% +36.8% -19.1% +68.6% ➖ noise
21 datafusion:vortex-file-compressed +9.8% +36.8% -19.8% +68.6% ➖ noise
21 duckdb:vortex-compact +18.6% +36.8% -13.3% +68.6% ➖ noise
21 duckdb:vortex-file-compressed +0.2% +36.8% -26.8% +68.6% ➖ noise
22 datafusion:vortex-compact -47.1% +44.1% -63.3% +68.6% ✅ faster
22 datafusion:vortex-file-compressed +69.2% +44.1% +17.4% +68.6% ➖ noise
22 duckdb:vortex-compact +26.5% +44.1% -12.2% +68.6% ➖ noise
22 duckdb:vortex-file-compressed +34.9% +44.1% -6.4% +68.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: Compression

Vortex (geomean): 1.043x ➖
Parquet (geomean): 1.031x ➖


unknown / unknown (1.042x ➖, 0↑ 17↓)
name PR 7847609 (ns) base 19403db (ns) ratio (PR/base)
compress time/Arade 1270709980 1269907901 1.00
compress time/Bimbo 7701605592 7701526998 1.00
compress time/CMSprovider 3260435823 3049820066 1.07
compress time/Euro2016 456003363 445134466 1.02
compress time/Food 418632685 417185306 1.00
compress time/HashTags 🚨 1010196277 831912189 1.21
compress time/TPC-H l_comment canonical 1376060756 1370272531 1.00
compress time/TPC-H l_comment chunked 1411075312 1360859289 1.04
compress time/taxi 756288363 752681656 1.00
compress time/wide table cols=100 chunks=1 rows=1000 🚨 17035005 11013692 1.55
compress time/wide table cols=100 chunks=50 rows=1000 🚨 18374527 11997004 1.53
compress time/wide table cols=1000 chunks=1 rows=1000 🚨 166429928 127211602 1.31
compress time/wide table cols=1000 chunks=50 rows=1000 🚨 167636455 129641631 1.29
compress time/wide table cols=10000 chunks=1 rows=1000 🚨 1646066539 1303740113 1.26
compress time/wide table cols=10000 chunks=50 rows=1000 🚨 1636699795 1277291507 1.28
decompress time/Arade 30696076 31805231 0.97
decompress time/Bimbo 110854546 104860904 1.06
decompress time/CMSprovider 86249895 86287804 1.00
decompress time/Euro2016 22406553 21817969 1.03
decompress time/Food 9156786 8669691 1.06
decompress time/HashTags 94128889 88403997 1.06
decompress time/TPC-H l_comment canonical 45062577 43738392 1.03
decompress time/TPC-H l_comment chunked 45510644 44137595 1.03
decompress time/taxi 20370639 20599074 0.99
decompress time/wide table cols=100 chunks=1 rows=1000 2868649 2817106 1.02
decompress time/wide table cols=100 chunks=50 rows=1000 2898009 2664995 1.09
decompress time/wide table cols=1000 chunks=1 rows=1000 36478594 34772076 1.05
decompress time/wide table cols=1000 chunks=50 rows=1000 36128817 34397775 1.05
decompress time/wide table cols=10000 chunks=1 rows=1000 1512874609 1415585238 1.07
decompress time/wide table cols=10000 chunks=50 rows=1000 1513452673 1420057386 1.07
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3054657626 3143771050 0.97
parquet_rs-zstd compress time/Bimbo 17448131896 18093522334 0.96
parquet_rs-zstd compress time/CMSprovider 7877307320 7916091048 1.00
parquet_rs-zstd compress time/Euro2016 1419164629 1355464766 1.05
parquet_rs-zstd compress time/Food 973747946 958899002 1.02
parquet_rs-zstd compress time/HashTags 🚨 2765141491 2484591346 1.11
parquet_rs-zstd compress time/TPC-H l_comment canonical 3138893517 3146916815 1.00
parquet_rs-zstd compress time/TPC-H l_comment chunked 3179383901 3133761106 1.01
parquet_rs-zstd compress time/taxi 1512664241 1556590259 0.97
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6922410 7028640 0.98
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 7259398 6943398 1.05
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 92307947 90934772 1.02
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 87996214 91073464 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 965681178 976045072 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 938583801 971456045 0.97
parquet_rs-zstd decompress time/Arade 654270771 665534827 0.98
parquet_rs-zstd decompress time/Bimbo 1833113319 1767963763 1.04
parquet_rs-zstd decompress time/CMSprovider 2006371291 1961558559 1.02
parquet_rs-zstd decompress time/Euro2016 393307983 391593700 1.00
parquet_rs-zstd decompress time/Food 225635477 222889528 1.01
parquet_rs-zstd decompress time/HashTags 🚨 732578970 633866607 1.16
parquet_rs-zstd decompress time/TPC-H l_comment canonical 575649057 569130285 1.01
parquet_rs-zstd decompress time/TPC-H l_comment chunked 576950981 576241806 1.00
parquet_rs-zstd decompress time/taxi 252696016 250786682 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2783584 2754354 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2714224 2747228 0.99
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 33137824 32522835 1.02
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 31897774 32969317 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 379993006 393792021 0.96
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 379156717 377977877 1.00
vortex-file-compressed size/Arade 143600332 143600332 1.00
vortex-file-compressed size/Bimbo 510400068 510400068 1.00
vortex-file-compressed size/CMSprovider 448304012 448304012 1.00
vortex-file-compressed size/Euro2016 164456772 164458188 1.00
vortex-file-compressed size/Food 44206904 44206912 1.00
vortex-file-compressed size/HashTags 195864500 195864476 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179481888 179481896 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179481888 179481896 1.00
vortex-file-compressed size/taxi 51040172 51040172 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884416 884416 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884416 884416 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829616 8829616 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829616 8829616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317616 88317616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317616 88317616 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.03
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.04
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.07
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.98
vortex:parquet-zstd ratio compress time/Food 0 0 0.99
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.09
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.02
vortex:parquet-zstd ratio compress time/taxi 0 0 1.03
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚨 2 1 1.57
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚨 2 1 1.46
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 🚨 1 1 1.29
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 🚨 1 1 1.34
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 🚨 1 1 1.28
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 🚨 1 1 1.33
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.98
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.02
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 0.98
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.02
vortex:parquet-zstd ratio decompress time/Food 0 0 1.04
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.92
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.03
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 🚨 1 0 1.10
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.09
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 3 3 1.11
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 3 3 1.06
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs marked this pull request as ready for review March 19, 2026 16:15
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 20, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 20, 2026
@joseph-isaacs joseph-isaacs enabled auto-merge (squash) March 20, 2026 14:29
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 1, 2026
Resolve conflicts in alp_rd array/mod keeping BufferMut optimization
from this branch while adopting develop's structural changes
(Arc<Array>, require_child!, Validity::from_mask).

Signed-off-by: Joe Isaacs <joe@spiraldb.com>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 1, 2026
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 1, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 1, 2026
@joseph-isaacs joseph-isaacs requested a review from robert3005 April 1, 2026 12:31
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@connortsui20 connortsui20 added the action/benchmark Trigger full benchmarks to run on this PR label Apr 1, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 1, 2026
@connortsui20
Copy link
Copy Markdown
Contributor

this looks fine to me, but I think it would be better if someone more familiar with this encoding reviewed this?

@connortsui20 connortsui20 requested a review from danking April 1, 2026 16:41
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 1, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants