Skip to content

[Experiment] Random IO ideas#6985

Draft
AdamGS wants to merge 7 commits intodevelopfrom
adam/codex-try-io
Draft

[Experiment] Random IO ideas#6985
AdamGS wants to merge 7 commits intodevelopfrom
adam/codex-try-io

Conversation

@AdamGS
Copy link
Contributor

@AdamGS AdamGS commented Mar 16, 2026

This is a mostly codex-driven experiment to play around with some general ideas I had and never got around to diving into, at least locally I've reached a point where perf looks interesting enough that I want to actually run benchmarks.

While I wat for benchmarks to run, some initial numbers from f3c23a6, running clickbench with datafusion against develop (using GNU time):

  • peak RSS is down (16.5 GB vs 21.1GB)
  • Minor page faults down (~2.2 million vs 2.9 million).
  • Voluntary context switches (not sure how to interpret this number, it also a bit noisy): Down to 317 vs 9,422

@AdamGS AdamGS added do not merge Pull requests that are not intended to merge action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Mar 16, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 16, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done cbaab6f 1 Explore Profiling Data
Previous Runs (16)
Status Commit Job Attempt Link
🟢 Done d4979d2 1 Explore Profiling Data
🟢 Done f477ab1 1 Explore Profiling Data
🟢 Done 07292e5 1 Explore Profiling Data
🟢 Done 24baf98 2 Explore Profiling Data
🟢 Done 24baf98 1 Explore Profiling Data
🟢 Done 3732c5a 1 Explore Profiling Data
🟢 Done 139e226 1 Explore Profiling Data
🟢 Done 3a5dc76 1 Explore Profiling Data
🟢 Done ba17eee 1 Explore Profiling Data
🟢 Done a1adc57 1 Explore Profiling Data
🟢 Done b613478 2 Explore Profiling Data
🟢 Done b613478 1 Explore Profiling Data
🟢 Done 86c286b 2 Explore Profiling Data
🟢 Done 86c286b 1 Explore Profiling Data
🟢 Done f3c23a6 2 Explore Profiling Data
🟢 Done f3c23a6 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.920x ➖


datafusion / vortex-file-compressed (0.920x ➖, 4↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 113992022 123342978 0.92
polarsignals_q01/datafusion:vortex-file-compressed 🚀 325636839 380301620 0.86
polarsignals_q02/datafusion:vortex-file-compressed 🚀 21018984 24772586 0.85
polarsignals_q03/datafusion:vortex-file-compressed 🚀 328291405 376665449 0.87
polarsignals_q04/datafusion:vortex-file-compressed 11711575 12651812 0.93
polarsignals_q05/datafusion:vortex-file-compressed 16363099 17086845 0.96
polarsignals_q06/datafusion:vortex-file-compressed 21138605 21023098 1.01
polarsignals_q07/datafusion:vortex-file-compressed 12895547 13554803 0.95
polarsignals_q08/datafusion:vortex-file-compressed 🚀 386759560 475433216 0.81
polarsignals_q09/datafusion:vortex-file-compressed 12064194 11252492 1.07

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.6%
Vortex (geomean): 1.069x ➖
Parquet (geomean): 1.044x ➖
Shifts: Parquet (control) +4.4% · Median polish +6.1%


datafusion / vortex-file-compressed (1.056x ➖, 0↑ 2↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 49996124 51753589 0.97
tpch_q02/datafusion:vortex-file-compressed 53532631 50205363 1.07
tpch_q03/datafusion:vortex-file-compressed 🚨 34370665 27234877 1.26
tpch_q04/datafusion:vortex-file-compressed 19394845 18522106 1.05
tpch_q05/datafusion:vortex-file-compressed 79384276 74394774 1.07
tpch_q06/datafusion:vortex-file-compressed 🚨 11143479 10029032 1.11
tpch_q07/datafusion:vortex-file-compressed 93039067 91171136 1.02
tpch_q08/datafusion:vortex-file-compressed 70129825 66039472 1.06
tpch_q09/datafusion:vortex-file-compressed 92974214 85187546 1.09
tpch_q10/datafusion:vortex-file-compressed 81050070 74195835 1.09
tpch_q11/datafusion:vortex-file-compressed 20244730 19159203 1.06
tpch_q12/datafusion:vortex-file-compressed 34866492 33121877 1.05
tpch_q13/datafusion:vortex-file-compressed 27544394 26557507 1.04
tpch_q14/datafusion:vortex-file-compressed 29380831 27062265 1.09
tpch_q15/datafusion:vortex-file-compressed 25339380 24434636 1.04
tpch_q16/datafusion:vortex-file-compressed 35952758 33675288 1.07
tpch_q17/datafusion:vortex-file-compressed 77191070 72581255 1.06
tpch_q18/datafusion:vortex-file-compressed 104562237 99466518 1.05
tpch_q19/datafusion:vortex-file-compressed 34540138 37500934 0.92
tpch_q20/datafusion:vortex-file-compressed 51247553 51337188 1.00
tpch_q21/datafusion:vortex-file-compressed 100494204 93588786 1.07
tpch_q22/datafusion:vortex-file-compressed 15656708 15201153 1.03
datafusion / vortex-compact (1.050x ➖, 0↑ 3↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 65558652 58450545 1.12
tpch_q02/datafusion:vortex-compact 54814085 52545642 1.04
tpch_q03/datafusion:vortex-compact 32850221 31043195 1.06
tpch_q04/datafusion:vortex-compact 23321698 23388238 1.00
tpch_q05/datafusion:vortex-compact 85535191 81290279 1.05
tpch_q06/datafusion:vortex-compact 13917614 14305795 0.97
tpch_q07/datafusion:vortex-compact 94851878 93035547 1.02
tpch_q08/datafusion:vortex-compact 73087245 71278712 1.03
tpch_q09/datafusion:vortex-compact 97243700 95420677 1.02
tpch_q10/datafusion:vortex-compact 83506865 79933711 1.04
tpch_q11/datafusion:vortex-compact 🚨 22671288 20057431 1.13
tpch_q12/datafusion:vortex-compact 43319853 43802021 0.99
tpch_q13/datafusion:vortex-compact 37102338 36386822 1.02
tpch_q14/datafusion:vortex-compact 33431090 32346086 1.03
tpch_q15/datafusion:vortex-compact 34815305 32001615 1.09
tpch_q16/datafusion:vortex-compact 42388061 39040985 1.09
tpch_q17/datafusion:vortex-compact 84887399 77562074 1.09
tpch_q18/datafusion:vortex-compact 109746678 107329213 1.02
tpch_q19/datafusion:vortex-compact 48619837 45769076 1.06
tpch_q20/datafusion:vortex-compact 59137460 53948720 1.10
tpch_q21/datafusion:vortex-compact 108989970 106894882 1.02
tpch_q22/datafusion:vortex-compact 🚨 17079201 15321798 1.11
datafusion / parquet (1.012x ➖, 3↑ 1↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 150105532 146501213 1.02
tpch_q02/datafusion:parquet 84961132 81160107 1.05
tpch_q03/datafusion:parquet 83737597 81478315 1.03
tpch_q04/datafusion:parquet 56691243 54001033 1.05
tpch_q05/datafusion:parquet 162078117 158842819 1.02
tpch_q06/datafusion:parquet 🚀 36723696 44927140 0.82
tpch_q07/datafusion:parquet 185239028 177287297 1.04
tpch_q08/datafusion:parquet 🚨 172992396 155538484 1.11
tpch_q09/datafusion:parquet 216015358 209714529 1.03
tpch_q10/datafusion:parquet 191940052 188964735 1.02
tpch_q11/datafusion:parquet 63905344 59990961 1.07
tpch_q12/datafusion:parquet 🚀 110091359 125382674 0.88
tpch_q13/datafusion:parquet 207422079 197114693 1.05
tpch_q14/datafusion:parquet 80775532 83386918 0.97
tpch_q15/datafusion:parquet 🚀 67878723 76878651 0.88
tpch_q16/datafusion:parquet 57669069 53864689 1.07
tpch_q17/datafusion:parquet 181101652 167432245 1.08
tpch_q18/datafusion:parquet 237880622 227460527 1.05
tpch_q19/datafusion:parquet 92948797 101033512 0.92
tpch_q20/datafusion:parquet 121218990 116310435 1.04
tpch_q21/datafusion:parquet 195373321 183886344 1.06
tpch_q22/datafusion:parquet 42158984 39188628 1.08
datafusion / arrow (1.093x ➖, 0↑ 11↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 63042609 64294286 0.98
tpch_q02/datafusion:arrow 24066812 22881834 1.05
tpch_q03/datafusion:arrow 39545847 37269541 1.06
tpch_q04/datafusion:arrow 🚨 34051877 30425262 1.12
tpch_q05/datafusion:arrow 98416822 92529484 1.06
tpch_q06/datafusion:arrow 🚨 23979500 21787810 1.10
tpch_q07/datafusion:arrow 🚨 201721191 171491641 1.18
tpch_q08/datafusion:arrow 🚨 56575734 46415767 1.22
tpch_q09/datafusion:arrow 🚨 84418758 74879772 1.13
tpch_q10/datafusion:arrow 🚨 63205453 56612750 1.12
tpch_q11/datafusion:arrow 13068948 12045899 1.08
tpch_q12/datafusion:arrow 🚨 64005397 55696233 1.15
tpch_q13/datafusion:arrow 51633517 50552337 1.02
tpch_q14/datafusion:arrow 🚨 28305134 25371497 1.12
tpch_q15/datafusion:arrow 54264303 49590298 1.09
tpch_q16/datafusion:arrow 🚨 25519007 23089460 1.11
tpch_q17/datafusion:arrow 81301821 77145394 1.05
tpch_q18/datafusion:arrow 168777517 159619161 1.06
tpch_q19/datafusion:arrow 44240065 46253625 0.96
tpch_q20/datafusion:arrow 🚨 46818343 40289348 1.16
tpch_q21/datafusion:arrow 🚨 271017243 225163431 1.20
tpch_q22/datafusion:arrow 22315806 20956095 1.06
duckdb / vortex-file-compressed (1.080x ➖, 0↑ 7↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 34020225 32882644 1.03
tpch_q02/duckdb:vortex-file-compressed 29203968 27462197 1.06
tpch_q03/duckdb:vortex-file-compressed 30674325 28284106 1.08
tpch_q04/duckdb:vortex-file-compressed 30209771 29934362 1.01
tpch_q05/duckdb:vortex-file-compressed 🚨 36104916 31971275 1.13
tpch_q06/duckdb:vortex-file-compressed 🚨 12941746 10943073 1.18
tpch_q07/duckdb:vortex-file-compressed 38501295 37172906 1.04
tpch_q08/duckdb:vortex-file-compressed 41423010 39826424 1.04
tpch_q09/duckdb:vortex-file-compressed 77928843 78109694 1.00
tpch_q10/duckdb:vortex-file-compressed 36656169 35883100 1.02
tpch_q11/duckdb:vortex-file-compressed 16213591 16200013 1.00
tpch_q12/duckdb:vortex-file-compressed 🚨 25726185 22236471 1.16
tpch_q13/duckdb:vortex-file-compressed 🚨 41917375 36101675 1.16
tpch_q14/duckdb:vortex-file-compressed 🚨 25025304 21168584 1.18
tpch_q15/duckdb:vortex-file-compressed 16896934 16125108 1.05
tpch_q16/duckdb:vortex-file-compressed 31836272 29432244 1.08
tpch_q17/duckdb:vortex-file-compressed 26091328 24242000 1.08
tpch_q18/duckdb:vortex-file-compressed 48833216 45876502 1.06
tpch_q19/duckdb:vortex-file-compressed 🚨 37551353 33029193 1.14
tpch_q20/duckdb:vortex-file-compressed 36067918 33393752 1.08
tpch_q21/duckdb:vortex-file-compressed 106539113 98969777 1.08
tpch_q22/duckdb:vortex-file-compressed 🚨 20135254 17851271 1.13
duckdb / vortex-compact (1.092x ➖, 0↑ 9↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 41080218 38568218 1.07
tpch_q02/duckdb:vortex-compact 38997757 36451891 1.07
tpch_q03/duckdb:vortex-compact 🚨 34342103 31120652 1.10
tpch_q04/duckdb:vortex-compact 35713930 34241957 1.04
tpch_q05/duckdb:vortex-compact 39009379 37319541 1.05
tpch_q06/duckdb:vortex-compact 🚨 17532220 14484773 1.21
tpch_q07/duckdb:vortex-compact 44502140 41311037 1.08
tpch_q08/duckdb:vortex-compact 47758521 44137531 1.08
tpch_q09/duckdb:vortex-compact 🚨 99811834 88201067 1.13
tpch_q10/duckdb:vortex-compact 43682137 40477172 1.08
tpch_q11/duckdb:vortex-compact 21205591 20344062 1.04
tpch_q12/duckdb:vortex-compact 39285811 36880863 1.07
tpch_q13/duckdb:vortex-compact 47926174 45945252 1.04
tpch_q14/duckdb:vortex-compact 🚨 33019875 28582382 1.16
tpch_q15/duckdb:vortex-compact 20990341 19348008 1.08
tpch_q16/duckdb:vortex-compact 🚨 39805449 35818936 1.11
tpch_q17/duckdb:vortex-compact 33392922 31747534 1.05
tpch_q18/duckdb:vortex-compact 51246988 49012008 1.05
tpch_q19/duckdb:vortex-compact 🚨 43391163 36879611 1.18
tpch_q20/duckdb:vortex-compact 🚨 48776883 43649954 1.12
tpch_q21/duckdb:vortex-compact 🚨 123923871 110782658 1.12
tpch_q22/duckdb:vortex-compact 🚨 23200115 20564528 1.13
duckdb / parquet (1.077x ➖, 1↑ 6↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 122281132 76732487 1.59
tpch_q02/duckdb:parquet 41521675 39184459 1.06
tpch_q03/duckdb:parquet 71825667 69123509 1.04
tpch_q04/duckdb:parquet 🚨 57740918 47946138 1.20
tpch_q05/duckdb:parquet 68858426 66104969 1.04
tpch_q06/duckdb:parquet 🚀 20659499 27718297 0.75
tpch_q07/duckdb:parquet 71198516 66559725 1.07
tpch_q08/duckdb:parquet 83301034 80652604 1.03
tpch_q09/duckdb:parquet 🚨 160744643 130256632 1.23
tpch_q10/duckdb:parquet 🚨 144548414 129405287 1.12
tpch_q11/duckdb:parquet 23261272 22029450 1.06
tpch_q12/duckdb:parquet 46604830 48621012 0.96
tpch_q13/duckdb:parquet 284291788 260312802 1.09
tpch_q14/duckdb:parquet 48892657 50911067 0.96
tpch_q15/duckdb:parquet 🚨 30840666 23811293 1.30
tpch_q16/duckdb:parquet 56269200 54803751 1.03
tpch_q17/duckdb:parquet 60474427 58066217 1.04
tpch_q18/duckdb:parquet 123492531 119224643 1.04
tpch_q19/duckdb:parquet 🚨 82468193 67310332 1.23
tpch_q20/duckdb:parquet 64391033 62904823 1.02
tpch_q21/duckdb:parquet 184126177 176025966 1.05
tpch_q22/duckdb:parquet 52963727 51490042 1.03
duckdb / duckdb (1.061x ➖, 0↑ 4↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16137477 16268773 0.99
tpch_q02/duckdb:duckdb 12819665 11945351 1.07
tpch_q03/duckdb:duckdb 19415015 18829008 1.03
tpch_q04/duckdb:duckdb 🚨 20705174 18642908 1.11
tpch_q05/duckdb:duckdb 19570633 19365811 1.01
tpch_q06/duckdb:duckdb 5664198 5244936 1.08
tpch_q07/duckdb:duckdb 22589472 21300183 1.06
tpch_q08/duckdb:duckdb 21668829 20142546 1.08
tpch_q09/duckdb:duckdb 53804601 52063905 1.03
tpch_q10/duckdb:duckdb 46546259 43831454 1.06
tpch_q11/duckdb:duckdb 6339639 5997744 1.06
tpch_q12/duckdb:duckdb 🚨 15198153 13458265 1.13
tpch_q13/duckdb:duckdb 39413621 37008633 1.06
tpch_q14/duckdb:duckdb 🚨 17984187 16046306 1.12
tpch_q15/duckdb:duckdb 11834148 11962727 0.99
tpch_q16/duckdb:duckdb 24279368 23142933 1.05
tpch_q17/duckdb:duckdb 13976183 13160480 1.06
tpch_q18/duckdb:duckdb 39692197 36874236 1.08
tpch_q19/duckdb:duckdb 🚨 30838283 25563279 1.21
tpch_q20/duckdb:duckdb 22763274 22924615 0.99
tpch_q21/duckdb:duckdb 58542208 54600047 1.07
tpch_q22/duckdb:duckdb 24764798 24282747 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -1.9% +27.8% -23.3% +29.6% ✅ faster
1 datafusion:vortex-compact +12.2% +27.8% -12.2% +27.7% ➖ noise
1 datafusion:vortex-file-compressed -3.4% +27.8% -24.4% +31.3% ✅ faster
1 duckdb:duckdb -0.8% +27.8% -22.4% +27.5% ✅ faster
1 duckdb:vortex-compact +6.5% +27.8% -16.6% +27.0% ➖ noise
1 duckdb:vortex-file-compressed +3.5% +27.8% -19.0% +26.9% ➖ noise
2 datafusion:arrow +5.2% +5.3% -0.1% +25.5% ➖ noise
2 datafusion:vortex-compact +4.3% +5.3% -1.0% +25.5% ➖ noise
2 datafusion:vortex-file-compressed +6.6% +5.3% +1.2% +25.5% ➖ noise
2 duckdb:duckdb +7.3% +5.3% +1.9% +25.5% ➖ noise
2 duckdb:vortex-compact +7.0% +5.3% +1.6% +25.5% ➖ noise
2 duckdb:vortex-file-compressed +6.3% +5.3% +1.0% +25.5% ➖ noise
3 datafusion:arrow +6.1% +3.3% +2.7% +25.5% ➖ noise
3 datafusion:vortex-compact +5.8% +3.3% +2.4% +25.5% ➖ noise
3 datafusion:vortex-file-compressed +26.2% +3.3% +22.1% +25.5% ➖ noise
3 duckdb:duckdb +3.1% +3.3% -0.2% +25.5% ➖ noise
3 duckdb:vortex-compact +10.4% +3.3% +6.8% +25.5% ➖ noise
3 duckdb:vortex-file-compressed +8.5% +3.3% +4.9% +25.5% ➖ noise
4 datafusion:arrow +11.9% +12.4% -0.5% +25.5% ➖ noise
4 datafusion:vortex-compact -0.3% +12.4% -11.3% +25.5% ➖ noise
4 datafusion:vortex-file-compressed +4.7% +12.4% -6.9% +25.5% ➖ noise
4 duckdb:duckdb +11.1% +12.4% -1.2% +25.5% ➖ noise
4 duckdb:vortex-compact +4.3% +12.4% -7.2% +25.5% ➖ noise
4 duckdb:vortex-file-compressed +0.9% +12.4% -10.2% +25.5% ➖ noise
5 datafusion:arrow +6.4% +3.1% +3.2% +25.5% ➖ noise
5 datafusion:vortex-compact +5.2% +3.1% +2.1% +25.5% ➖ noise
5 datafusion:vortex-file-compressed +6.7% +3.1% +3.5% +25.5% ➖ noise
5 duckdb:duckdb +1.1% +3.1% -2.0% +25.5% ➖ noise
5 duckdb:vortex-compact +4.5% +3.1% +1.4% +25.5% ➖ noise
5 duckdb:vortex-file-compressed +12.9% +3.1% +9.5% +25.5% ➖ noise
6 datafusion:arrow +10.1% -21.9% +41.0% +25.5% 🚨 regression
6 datafusion:vortex-compact -2.7% -21.9% +24.6% +25.5% ➖ noise
6 datafusion:vortex-file-compressed +11.1% -21.9% +42.4% +25.5% 🚨 regression
6 duckdb:duckdb +8.0% -21.9% +38.4% +27.8% 🚨 regression
6 duckdb:vortex-compact +21.0% -21.9% +55.1% +25.5% 🚨 regression
6 duckdb:vortex-file-compressed +18.3% -21.9% +51.5% +25.5% 🚨 regression
7 datafusion:arrow +17.6% +5.7% +11.3% +25.5% ➖ noise
7 datafusion:vortex-compact +2.0% +5.7% -3.6% +25.5% ➖ noise
7 datafusion:vortex-file-compressed +2.0% +5.7% -3.5% +25.5% ➖ noise
7 duckdb:duckdb +6.1% +5.7% +0.3% +25.5% ➖ noise
7 duckdb:vortex-compact +7.7% +5.7% +1.9% +25.5% ➖ noise
7 duckdb:vortex-file-compressed +3.6% +5.7% -2.0% +25.5% ➖ noise
8 datafusion:arrow +21.9% +7.2% +13.7% +25.5% ➖ noise
8 datafusion:vortex-compact +2.5% +7.2% -4.3% +25.5% ➖ noise
8 datafusion:vortex-file-compressed +6.2% +7.2% -0.9% +25.5% ➖ noise
8 duckdb:duckdb +7.6% +7.2% +0.4% +25.5% ➖ noise
8 duckdb:vortex-compact +8.2% +7.2% +1.0% +25.5% ➖ noise
8 duckdb:vortex-file-compressed +4.0% +7.2% -3.0% +25.5% ➖ noise
9 datafusion:arrow +12.7% +12.7% -0.0% +25.5% ➖ noise
9 datafusion:vortex-compact +1.9% +12.7% -9.6% +25.5% ➖ noise
9 datafusion:vortex-file-compressed +9.1% +12.7% -3.2% +25.5% ➖ noise
9 duckdb:duckdb +3.3% +12.7% -8.3% +25.5% ➖ noise
9 duckdb:vortex-compact +13.2% +12.7% +0.4% +25.5% ➖ noise
9 duckdb:vortex-file-compressed -0.2% +12.7% -11.5% +25.5% ➖ noise
10 datafusion:arrow +11.6% +6.5% +4.8% +25.5% ➖ noise
10 datafusion:vortex-compact +4.5% +6.5% -1.9% +25.5% ➖ noise
10 datafusion:vortex-file-compressed +9.2% +6.5% +2.6% +25.5% ➖ noise
10 duckdb:duckdb +6.2% +6.5% -0.3% +25.5% ➖ noise
10 duckdb:vortex-compact +7.9% +6.5% +1.3% +25.5% ➖ noise
10 duckdb:vortex-file-compressed +2.2% +6.5% -4.1% +25.5% ➖ noise
11 datafusion:arrow +8.5% +6.1% +2.3% +25.5% ➖ noise
11 datafusion:vortex-compact +13.0% +6.1% +6.6% +25.5% ➖ noise
11 datafusion:vortex-file-compressed +5.7% +6.1% -0.4% +25.5% ➖ noise
11 duckdb:duckdb +5.7% +6.1% -0.3% +25.5% ➖ noise
11 duckdb:vortex-compact +4.2% +6.1% -1.7% +25.5% ➖ noise
11 duckdb:vortex-file-compressed +0.1% +6.1% -5.6% +25.5% ➖ noise
12 datafusion:arrow +14.9% -8.3% +25.3% +25.5% ➖ noise
12 datafusion:vortex-compact -1.1% -8.3% +7.8% +25.5% ➖ noise
12 datafusion:vortex-file-compressed +5.3% -8.3% +14.7% +25.5% ➖ noise
12 duckdb:duckdb +12.9% -8.3% +23.1% +25.5% ➖ noise
12 duckdb:vortex-compact +6.5% -8.3% +16.1% +25.5% ➖ noise
12 duckdb:vortex-file-compressed +15.7% -8.3% +26.1% +25.5% 🚨 regression
13 datafusion:arrow +2.1% +7.2% -4.7% +25.5% ➖ noise
13 datafusion:vortex-compact +2.0% +7.2% -4.9% +25.5% ➖ noise
13 datafusion:vortex-file-compressed +3.7% +7.2% -3.3% +25.5% ➖ noise
13 duckdb:duckdb +6.5% +7.2% -0.7% +25.5% ➖ noise
13 duckdb:vortex-compact +4.3% +7.2% -2.7% +25.5% ➖ noise
13 duckdb:vortex-file-compressed +16.1% +7.2% +8.3% +25.5% ➖ noise
14 datafusion:arrow +11.6% -3.5% +15.7% +25.5% ➖ noise
14 datafusion:vortex-compact +3.4% -3.5% +7.2% +25.5% ➖ noise
14 datafusion:vortex-file-compressed +8.6% -3.5% +12.6% +25.5% ➖ noise
14 duckdb:duckdb +12.1% -3.5% +16.2% +26.6% ➖ noise
14 duckdb:vortex-compact +15.5% -3.5% +19.8% +25.5% ➖ noise
14 duckdb:vortex-file-compressed +18.2% -3.5% +22.6% +25.5% ➖ noise
15 datafusion:arrow +9.4% +6.9% +2.3% +25.5% ➖ noise
15 datafusion:vortex-compact +8.8% +6.9% +1.7% +25.5% ➖ noise
15 datafusion:vortex-file-compressed +3.7% +6.9% -3.0% +25.5% ➖ noise
15 duckdb:duckdb -1.1% +6.9% -7.5% +25.5% ➖ noise
15 duckdb:vortex-compact +8.5% +6.9% +1.4% +25.5% ➖ noise
15 duckdb:vortex-file-compressed +4.8% +6.9% -2.0% +25.5% ➖ noise
16 datafusion:arrow +10.5% +4.8% +5.4% +25.5% ➖ noise
16 datafusion:vortex-compact +8.6% +4.8% +3.6% +25.5% ➖ noise
16 datafusion:vortex-file-compressed +6.8% +4.8% +1.8% +25.5% ➖ noise
16 duckdb:duckdb +4.9% +4.8% +0.1% +25.5% ➖ noise
16 duckdb:vortex-compact +11.1% +4.8% +6.0% +25.5% ➖ noise
16 duckdb:vortex-file-compressed +8.2% +4.8% +3.2% +25.5% ➖ noise
17 datafusion:arrow +5.4% +6.1% -0.7% +25.5% ➖ noise
17 datafusion:vortex-compact +9.4% +6.1% +3.1% +25.5% ➖ noise
17 datafusion:vortex-file-compressed +6.4% +6.1% +0.2% +25.5% ➖ noise
17 duckdb:duckdb +6.2% +6.1% +0.1% +25.5% ➖ noise
17 duckdb:vortex-compact +5.2% +6.1% -0.9% +25.5% ➖ noise
17 duckdb:vortex-file-compressed +7.6% +6.1% +1.4% +25.5% ➖ noise
18 datafusion:arrow +5.7% +4.1% +1.6% +25.5% ➖ noise
18 datafusion:vortex-compact +2.3% +4.1% -1.8% +25.5% ➖ noise
18 datafusion:vortex-file-compressed +5.1% +4.1% +1.0% +25.5% ➖ noise
18 duckdb:duckdb +7.6% +4.1% +3.4% +25.5% ➖ noise
18 duckdb:vortex-compact +4.6% +4.1% +0.5% +25.5% ➖ noise
18 duckdb:vortex-file-compressed +6.4% +4.1% +2.3% +25.5% ➖ noise
19 datafusion:arrow -4.4% +6.2% -9.9% +25.5% ➖ noise
19 datafusion:vortex-compact +6.2% +6.2% +0.1% +25.5% ➖ noise
19 datafusion:vortex-file-compressed -7.9% +6.2% -13.2% +25.5% ➖ noise
19 duckdb:duckdb +20.6% +6.2% +13.6% +25.5% ➖ noise
19 duckdb:vortex-compact +17.7% +6.2% +10.8% +25.5% ➖ noise
19 duckdb:vortex-file-compressed +13.7% +6.2% +7.1% +25.5% ➖ noise
20 datafusion:arrow +16.2% +3.3% +12.5% +25.5% ➖ noise
20 datafusion:vortex-compact +9.6% +3.3% +6.1% +25.5% ➖ noise
20 datafusion:vortex-file-compressed -0.2% +3.3% -3.4% +25.5% ➖ noise
20 duckdb:duckdb -0.7% +3.3% -3.9% +25.5% ➖ noise
20 duckdb:vortex-compact +11.7% +3.3% +8.2% +25.5% ➖ noise
20 duckdb:vortex-file-compressed +8.0% +3.3% +4.6% +25.5% ➖ noise
21 datafusion:arrow +20.4% +5.4% +14.2% +25.5% ➖ noise
21 datafusion:vortex-compact +2.0% +5.4% -3.3% +25.5% ➖ noise
21 datafusion:vortex-file-compressed +7.4% +5.4% +1.9% +25.5% ➖ noise
21 duckdb:duckdb +7.2% +5.4% +1.7% +25.5% ➖ noise
21 duckdb:vortex-compact +11.9% +5.4% +6.1% +25.5% ➖ noise
21 duckdb:vortex-file-compressed +7.6% +5.4% +2.1% +25.5% ➖ noise
22 datafusion:arrow +6.5% +5.2% +1.2% +25.5% ➖ noise
22 datafusion:vortex-compact +11.5% +5.2% +6.0% +25.5% ➖ noise
22 datafusion:vortex-file-compressed +3.0% +5.2% -2.1% +25.5% ➖ noise
22 duckdb:duckdb +2.0% +5.2% -3.1% +25.5% ➖ noise
22 duckdb:vortex-compact +12.8% +5.2% +7.2% +25.5% ➖ noise
22 duckdb:vortex-file-compressed +12.8% +5.2% +7.2% +25.5% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (medium confidence)
Attributed Vortex impact: +4.0%
Vortex (geomean): 0.990x ➖
Parquet (geomean): 0.952x ➖
Shifts: Parquet (control) -4.8% · Median polish -4.4%


datafusion / vortex-file-compressed (0.916x ➖, 3↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 4511280 5187674 0.87
fineweb_q01/datafusion:vortex-file-compressed 24507334 26905435 0.91
fineweb_q02/datafusion:vortex-file-compressed 27491849 29510448 0.93
fineweb_q03/datafusion:vortex-file-compressed 🚀 71577273 80060371 0.89
fineweb_q04/datafusion:vortex-file-compressed 247945422 273498227 0.91
fineweb_q05/datafusion:vortex-file-compressed 229945104 228467787 1.01
fineweb_q06/datafusion:vortex-file-compressed 65211100 69285438 0.94
fineweb_q07/datafusion:vortex-file-compressed 65187179 68199798 0.96
fineweb_q08/datafusion:vortex-file-compressed 🚀 24496461 29304543 0.84
datafusion / vortex-compact (0.753x ✅, 8↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 4844758 5442740 0.89
fineweb_q01/datafusion:vortex-compact 🚀 128625655 165785073 0.78
fineweb_q02/datafusion:vortex-compact 🚀 130770915 168268848 0.78
fineweb_q03/datafusion:vortex-compact 🚀 976391249 1490959422 0.65
fineweb_q04/datafusion:vortex-compact 🚀 1070688435 1627588877 0.66
fineweb_q05/datafusion:vortex-compact 🚀 890810754 1266147426 0.70
fineweb_q06/datafusion:vortex-compact 🚀 510839284 711903404 0.72
fineweb_q07/datafusion:vortex-compact 🚀 530827763 761954561 0.70
fineweb_q08/datafusion:vortex-compact 22385342 23396658 0.96
datafusion / parquet (0.951x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 5958095 6270413 0.95
fineweb_q01/datafusion:parquet 271623500 285937983 0.95
fineweb_q02/datafusion:parquet 272390314 288241229 0.95
fineweb_q03/datafusion:parquet 277905488 289583167 0.96
fineweb_q04/datafusion:parquet 289920488 302505132 0.96
fineweb_q05/datafusion:parquet 284355470 299881507 0.95
fineweb_q06/datafusion:parquet 277404989 297220351 0.93
fineweb_q07/datafusion:parquet 271915641 285055086 0.95
fineweb_q08/datafusion:parquet 269577716 279729598 0.96
duckdb / vortex-file-compressed (1.311x ❌, 1↑ 8↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 3185151 3700111 0.86
fineweb_q01/duckdb:vortex-file-compressed 🚨 30107137 25433376 1.18
fineweb_q02/duckdb:vortex-file-compressed 🚨 37150225 29726483 1.25
fineweb_q03/duckdb:vortex-file-compressed 🚨 214071230 137199882 1.56
fineweb_q04/duckdb:vortex-file-compressed 🚨 351094957 233957708 1.50
fineweb_q05/duckdb:vortex-file-compressed 🚨 344995559 224398393 1.54
fineweb_q06/duckdb:vortex-file-compressed 🚨 83230751 73472176 1.13
fineweb_q07/duckdb:vortex-file-compressed 🚨 81910829 73008983 1.12
fineweb_q08/duckdb:vortex-file-compressed 🚨 51331309 26072227 1.97
duckdb / vortex-compact (1.063x ➖, 0↑ 1↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4174520 4578695 0.91
fineweb_q01/duckdb:vortex-compact 109390362 108179618 1.01
fineweb_q02/duckdb:vortex-compact 124774512 122437979 1.02
fineweb_q03/duckdb:vortex-compact 891700256 882072047 1.01
fineweb_q04/duckdb:vortex-compact 929733172 933066914 1.00
fineweb_q05/duckdb:vortex-compact 859467625 835867316 1.03
fineweb_q06/duckdb:vortex-compact 483037649 479118102 1.01
fineweb_q07/duckdb:vortex-compact 489546262 494420654 0.99
fineweb_q08/duckdb:vortex-compact 🚨 44269734 24870200 1.78
duckdb / parquet (0.953x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 35573401 38791246 0.92
fineweb_q01/duckdb:parquet 92296127 99179593 0.93
fineweb_q02/duckdb:parquet 97180712 101104866 0.96
fineweb_q03/duckdb:parquet 308542710 317970984 0.97
fineweb_q04/duckdb:parquet 438226008 447670777 0.98
fineweb_q05/duckdb:parquet 410708309 419569924 0.98
fineweb_q06/duckdb:parquet 199579120 209245055 0.95
fineweb_q07/duckdb:parquet 209700064 220402041 0.95
fineweb_q08/duckdb:parquet 57753561 61546822 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -11.0% -6.7% -4.6% +51.3% ➖ noise
0 datafusion:vortex-file-compressed -13.0% -6.7% -6.8% +77.3% ➖ noise
0 duckdb:vortex-compact -8.8% -6.7% -2.3% +41.2% ➖ noise
0 duckdb:vortex-file-compressed -13.9% -6.7% -7.8% +53.1% ➖ noise
1 datafusion:vortex-compact -22.4% -6.0% -17.5% +10.0% ✅ faster
1 datafusion:vortex-file-compressed -8.9% -6.0% -3.1% +28.2% ➖ noise
1 duckdb:vortex-compact +1.1% -6.0% +7.5% +15.8% ➖ noise
1 duckdb:vortex-file-compressed +18.4% -6.0% +25.9% +46.3% ➖ noise
2 datafusion:vortex-compact -22.3% -4.7% -18.5% +10.0% ✅ faster
2 datafusion:vortex-file-compressed -6.8% -4.7% -2.3% +20.3% ➖ noise
2 duckdb:vortex-compact +1.9% -4.7% +6.9% +15.1% ➖ noise
2 duckdb:vortex-file-compressed +25.0% -4.7% +31.1% +16.8% 🚨 regression
3 datafusion:vortex-compact -34.5% -3.5% -32.1% +10.0% ✅ faster
3 datafusion:vortex-file-compressed -10.6% -3.5% -7.4% +17.1% ➖ noise
3 duckdb:vortex-compact +1.1% -3.5% +4.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +56.0% -3.5% +61.7% +19.0% 🚨 regression
4 datafusion:vortex-compact -34.2% -3.1% -32.1% +10.0% ✅ faster
4 datafusion:vortex-file-compressed -9.3% -3.1% -6.4% +10.0% ➖ noise
4 duckdb:vortex-compact -0.4% -3.1% +2.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +50.1% -3.1% +54.9% +10.0% 🚨 regression
5 datafusion:vortex-compact -29.6% -3.7% -27.0% +10.0% ✅ faster
5 datafusion:vortex-file-compressed +0.6% -3.7% +4.5% +10.0% ➖ noise
5 duckdb:vortex-compact +2.8% -3.7% +6.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +53.7% -3.7% +59.6% +10.0% 🚨 regression
6 datafusion:vortex-compact -28.2% -5.6% -23.9% +10.0% ✅ faster
6 datafusion:vortex-file-compressed -5.9% -5.6% -0.2% +12.6% ➖ noise
6 duckdb:vortex-compact +0.8% -5.6% +6.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +13.3% -5.6% +20.1% +12.9% 🚨 regression
7 datafusion:vortex-compact -30.3% -4.7% -26.9% +10.0% ✅ faster
7 datafusion:vortex-file-compressed -4.4% -4.7% +0.3% +14.8% ➖ noise
7 duckdb:vortex-compact -1.0% -4.7% +3.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +12.2% -4.7% +17.8% +10.0% 🚨 regression
8 datafusion:vortex-compact -4.3% -4.9% +0.6% +19.6% ➖ noise
8 datafusion:vortex-file-compressed -16.4% -4.9% -12.1% +40.5% ➖ noise
8 duckdb:vortex-compact +78.0% -4.9% +87.2% +23.0% 🚨 regression
8 duckdb:vortex-file-compressed +96.9% -4.9% +107.0% +19.8% 🚨 regression

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.6%
Vortex (geomean): 0.980x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish -0.4%


datafusion / vortex-file-compressed (0.970x ➖, 6↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 29021318 28542064 1.02
tpcds_q02/datafusion:vortex-file-compressed 75450725 74582362 1.01
tpcds_q03/datafusion:vortex-file-compressed 26632538 26700934 1.00
tpcds_q04/datafusion:vortex-file-compressed 408185519 405827988 1.01
tpcds_q05/datafusion:vortex-file-compressed 73486692 73611331 1.00
tpcds_q06/datafusion:vortex-file-compressed 74986335 74210349 1.01
tpcds_q07/datafusion:vortex-file-compressed 72248420 75986006 0.95
tpcds_q08/datafusion:vortex-file-compressed 38436698 40442952 0.95
tpcds_q09/datafusion:vortex-file-compressed 47170722 48164933 0.98
tpcds_q10/datafusion:vortex-file-compressed 49452769 51126175 0.97
tpcds_q11/datafusion:vortex-file-compressed 227856271 230241734 0.99
tpcds_q12/datafusion:vortex-file-compressed 34521030 34241042 1.01
tpcds_q13/datafusion:vortex-file-compressed 76337988 77681606 0.98
tpcds_q14/datafusion:vortex-file-compressed 218174448 219000316 1.00
tpcds_q15/datafusion:vortex-file-compressed 50352751 51343705 0.98
tpcds_q16/datafusion:vortex-file-compressed 29089883 29336372 0.99
tpcds_q17/datafusion:vortex-file-compressed 111285689 107664496 1.03
tpcds_q18/datafusion:vortex-file-compressed 99021377 99071685 1.00
tpcds_q19/datafusion:vortex-file-compressed 45486404 46898544 0.97
tpcds_q20/datafusion:vortex-file-compressed 40019223 40857112 0.98
tpcds_q21/datafusion:vortex-file-compressed 167992639 168156166 1.00
tpcds_q22/datafusion:vortex-file-compressed 69988985 69429397 1.01
tpcds_q23/datafusion:vortex-file-compressed 187849913 185803165 1.01
tpcds_q24/datafusion:vortex-file-compressed 175859102 175475462 1.00
tpcds_q25/datafusion:vortex-file-compressed 111615185 108501789 1.03
tpcds_q26/datafusion:vortex-file-compressed 62140983 61284981 1.01
tpcds_q27/datafusion:vortex-file-compressed 175444166 173867391 1.01
tpcds_q28/datafusion:vortex-file-compressed 50262610 49516977 1.02
tpcds_q29/datafusion:vortex-file-compressed 111539989 109214002 1.02
tpcds_q30/datafusion:vortex-file-compressed 29208845 31460554 0.93
tpcds_q31/datafusion:vortex-file-compressed 172001591 176304645 0.98
tpcds_q32/datafusion:vortex-file-compressed 23128015 24643747 0.94
tpcds_q33/datafusion:vortex-file-compressed 36852745 36188495 1.02
tpcds_q34/datafusion:vortex-file-compressed 36286325 38244243 0.95
tpcds_q35/datafusion:vortex-file-compressed 60102501 62049258 0.97
tpcds_q36/datafusion:vortex-file-compressed 101046511 105163972 0.96
tpcds_q37/datafusion:vortex-file-compressed 37287633 40626881 0.92
tpcds_q38/datafusion:vortex-file-compressed 85253449 86300618 0.99
tpcds_q39/datafusion:vortex-file-compressed 204776827 219358225 0.93
tpcds_q40/datafusion:vortex-file-compressed 🚀 52886254 59333069 0.89
tpcds_q41/datafusion:vortex-file-compressed 🚀 13468793 16499082 0.82
tpcds_q42/datafusion:vortex-file-compressed 30770640 31923984 0.96
tpcds_q43/datafusion:vortex-file-compressed 47059136 46343497 1.02
tpcds_q44/datafusion:vortex-file-compressed 41539087 42829226 0.97
tpcds_q45/datafusion:vortex-file-compressed 47103340 51913010 0.91
tpcds_q46/datafusion:vortex-file-compressed 63705014 65834971 0.97
tpcds_q47/datafusion:vortex-file-compressed 269967438 267961530 1.01
tpcds_q48/datafusion:vortex-file-compressed 68438757 69892133 0.98
tpcds_q49/datafusion:vortex-file-compressed 70784344 73460445 0.96
tpcds_q50/datafusion:vortex-file-compressed 73106424 75368710 0.97
tpcds_q51/datafusion:vortex-file-compressed 96614741 92759525 1.04
tpcds_q52/datafusion:vortex-file-compressed 28048639 30672275 0.91
tpcds_q53/datafusion:vortex-file-compressed 29451472 29799390 0.99
tpcds_q54/datafusion:vortex-file-compressed 47296683 48925105 0.97
tpcds_q55/datafusion:vortex-file-compressed 30209944 30888255 0.98
tpcds_q56/datafusion:vortex-file-compressed 45276522 47058359 0.96
tpcds_q57/datafusion:vortex-file-compressed 178898959 182611193 0.98
tpcds_q58/datafusion:vortex-file-compressed 109991017 113401015 0.97
tpcds_q59/datafusion:vortex-file-compressed 93785730 92783237 1.01
tpcds_q60/datafusion:vortex-file-compressed 47929226 46982130 1.02
tpcds_q61/datafusion:vortex-file-compressed 58077688 57897995 1.00
tpcds_q62/datafusion:vortex-file-compressed 42847531 45061590 0.95
tpcds_q63/datafusion:vortex-file-compressed 30026218 29654608 1.01
tpcds_q64/datafusion:vortex-file-compressed 720301388 715484059 1.01
tpcds_q65/datafusion:vortex-file-compressed 50951541 51009297 1.00
tpcds_q66/datafusion:vortex-file-compressed 103653276 104031721 1.00
tpcds_q67/datafusion:vortex-file-compressed 147093082 156075416 0.94
tpcds_q68/datafusion:vortex-file-compressed 🚀 61441352 72112341 0.85
tpcds_q69/datafusion:vortex-file-compressed 43831278 47121647 0.93
tpcds_q70/datafusion:vortex-file-compressed 135560196 135268638 1.00
tpcds_q71/datafusion:vortex-file-compressed 29731599 29885013 0.99
tpcds_q72/datafusion:vortex-file-compressed 3449806298 3307498869 1.04
tpcds_q73/datafusion:vortex-file-compressed 37096019 38240751 0.97
tpcds_q74/datafusion:vortex-file-compressed 169127356 163665430 1.03
tpcds_q75/datafusion:vortex-file-compressed 129338884 131208688 0.99
tpcds_q76/datafusion:vortex-file-compressed 61828485 60250923 1.03
tpcds_q77/datafusion:vortex-file-compressed 51709926 53594447 0.96
tpcds_q78/datafusion:vortex-file-compressed 177067982 177318846 1.00
tpcds_q79/datafusion:vortex-file-compressed 41701920 41632282 1.00
tpcds_q80/datafusion:vortex-file-compressed 118303132 117114535 1.01
tpcds_q81/datafusion:vortex-file-compressed 37083126 40243163 0.92
tpcds_q82/datafusion:vortex-file-compressed 39117795 42386759 0.92
tpcds_q83/datafusion:vortex-file-compressed 64467271 68620935 0.94
tpcds_q84/datafusion:vortex-file-compressed 🚀 14702138 17286213 0.85
tpcds_q85/datafusion:vortex-file-compressed 133286716 139364579 0.96
tpcds_q86/datafusion:vortex-file-compressed 30197525 33146205 0.91
tpcds_q87/datafusion:vortex-file-compressed 87735156 89495749 0.98
tpcds_q88/datafusion:vortex-file-compressed 81240553 85218057 0.95
tpcds_q89/datafusion:vortex-file-compressed 58863527 61207529 0.96
tpcds_q90/datafusion:vortex-file-compressed 16543980 17045069 0.97
tpcds_q91/datafusion:vortex-file-compressed 🚀 24923554 30067026 0.83
tpcds_q92/datafusion:vortex-file-compressed 🚀 19323739 22206496 0.87
tpcds_q93/datafusion:vortex-file-compressed 36084050 39751049 0.91
tpcds_q94/datafusion:vortex-file-compressed 26028008 28683996 0.91
tpcds_q95/datafusion:vortex-file-compressed 85820052 88769230 0.97
tpcds_q96/datafusion:vortex-file-compressed 14872951 16494718 0.90
tpcds_q97/datafusion:vortex-file-compressed 31776566 35056831 0.91
tpcds_q98/datafusion:vortex-file-compressed 49354924 53216522 0.93
tpcds_q99/datafusion:vortex-file-compressed 62358636 62482670 1.00
datafusion / vortex-compact (0.997x ➖, 0↑ 1↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 35303605 36776513 0.96
tpcds_q02/datafusion:vortex-compact 82894558 86822458 0.95
tpcds_q03/datafusion:vortex-compact 32804173 35149774 0.93
tpcds_q04/datafusion:vortex-compact 442103108 445904463 0.99
tpcds_q05/datafusion:vortex-compact 82101997 80545558 1.02
tpcds_q06/datafusion:vortex-compact 81007543 82238978 0.99
tpcds_q07/datafusion:vortex-compact 90529518 92178831 0.98
tpcds_q08/datafusion:vortex-compact 49335325 50392807 0.98
tpcds_q09/datafusion:vortex-compact 95643860 95706218 1.00
tpcds_q10/datafusion:vortex-compact 66771135 67198332 0.99
tpcds_q11/datafusion:vortex-compact 251772089 254430554 0.99
tpcds_q12/datafusion:vortex-compact 37498285 37747056 0.99
tpcds_q13/datafusion:vortex-compact 141244436 139834647 1.01
tpcds_q14/datafusion:vortex-compact 266522507 271791014 0.98
tpcds_q15/datafusion:vortex-compact 51896253 55218525 0.94
tpcds_q16/datafusion:vortex-compact 42169077 40306448 1.05
tpcds_q17/datafusion:vortex-compact 123553143 125123918 0.99
tpcds_q18/datafusion:vortex-compact 112572239 115978602 0.97
tpcds_q19/datafusion:vortex-compact 62265658 58620302 1.06
tpcds_q20/datafusion:vortex-compact 47032513 43864595 1.07
tpcds_q21/datafusion:vortex-compact 168771391 184048072 0.92
tpcds_q22/datafusion:vortex-compact 77911570 78799941 0.99
tpcds_q23/datafusion:vortex-compact 232559307 227746271 1.02
tpcds_q24/datafusion:vortex-compact 202556121 210488982 0.96
tpcds_q25/datafusion:vortex-compact 126669493 127134816 1.00
tpcds_q26/datafusion:vortex-compact 70127490 69040541 1.02
tpcds_q27/datafusion:vortex-compact 210301406 211614998 0.99
tpcds_q28/datafusion:vortex-compact 103397067 99831843 1.04
tpcds_q29/datafusion:vortex-compact 131303396 127736457 1.03
tpcds_q30/datafusion:vortex-compact 34931551 36495505 0.96
tpcds_q31/datafusion:vortex-compact 210565712 210016335 1.00
tpcds_q32/datafusion:vortex-compact 29313531 29349691 1.00
tpcds_q33/datafusion:vortex-compact 52267342 51378332 1.02
tpcds_q34/datafusion:vortex-compact 56096898 53740383 1.04
tpcds_q35/datafusion:vortex-compact 71925906 75497658 0.95
tpcds_q36/datafusion:vortex-compact 128564235 122926621 1.05
tpcds_q37/datafusion:vortex-compact 49656450 49892528 1.00
tpcds_q38/datafusion:vortex-compact 101424624 99907726 1.02
tpcds_q39/datafusion:vortex-compact 🚨 229333176 195062380 1.18
tpcds_q40/datafusion:vortex-compact 62543346 61431912 1.02
tpcds_q41/datafusion:vortex-compact 14549993 15796433 0.92
tpcds_q42/datafusion:vortex-compact 34573014 34931974 0.99
tpcds_q43/datafusion:vortex-compact 52565283 56634959 0.93
tpcds_q44/datafusion:vortex-compact 66514965 72990343 0.91
tpcds_q45/datafusion:vortex-compact 51607026 52968698 0.97
tpcds_q46/datafusion:vortex-compact 93270309 90214227 1.03
tpcds_q47/datafusion:vortex-compact 300172518 292780990 1.03
tpcds_q48/datafusion:vortex-compact 108601226 109673297 0.99
tpcds_q49/datafusion:vortex-compact 95613194 98440584 0.97
tpcds_q50/datafusion:vortex-compact 94655428 91119249 1.04
tpcds_q51/datafusion:vortex-compact 99296972 98632480 1.01
tpcds_q52/datafusion:vortex-compact 35346665 34939207 1.01
tpcds_q53/datafusion:vortex-compact 38443911 40269834 0.95
tpcds_q54/datafusion:vortex-compact 61084495 62152834 0.98
tpcds_q55/datafusion:vortex-compact 36482853 35367753 1.03
tpcds_q56/datafusion:vortex-compact 57552421 58298048 0.99
tpcds_q57/datafusion:vortex-compact 196952611 188971073 1.04
tpcds_q58/datafusion:vortex-compact 115770471 116516778 0.99
tpcds_q59/datafusion:vortex-compact 105283112 108146505 0.97
tpcds_q60/datafusion:vortex-compact 59987984 56748232 1.06
tpcds_q61/datafusion:vortex-compact 83387483 80867495 1.03
tpcds_q62/datafusion:vortex-compact 44564312 43836328 1.02
tpcds_q63/datafusion:vortex-compact 38712855 38096198 1.02
tpcds_q64/datafusion:vortex-compact 788185640 776479061 1.02
tpcds_q65/datafusion:vortex-compact 70395231 70869343 0.99
tpcds_q66/datafusion:vortex-compact 110141051 112212781 0.98
tpcds_q67/datafusion:vortex-compact 152662174 154664073 0.99
tpcds_q68/datafusion:vortex-compact 92818773 89968948 1.03
tpcds_q69/datafusion:vortex-compact 62483111 61187915 1.02
tpcds_q70/datafusion:vortex-compact 138959795 141739868 0.98
tpcds_q71/datafusion:vortex-compact 45979089 43958437 1.05
tpcds_q72/datafusion:vortex-compact 3363469901 3385018576 0.99
tpcds_q73/datafusion:vortex-compact 55602521 56075292 0.99
tpcds_q74/datafusion:vortex-compact 184630221 187244400 0.99
tpcds_q75/datafusion:vortex-compact 173577606 182795708 0.95
tpcds_q76/datafusion:vortex-compact 77246549 75902620 1.02
tpcds_q77/datafusion:vortex-compact 68095473 67585211 1.01
tpcds_q78/datafusion:vortex-compact 200498637 203419327 0.99
tpcds_q79/datafusion:vortex-compact 67367455 68313039 0.99
tpcds_q80/datafusion:vortex-compact 134901971 135901859 0.99
tpcds_q81/datafusion:vortex-compact 43269059 42892653 1.01
tpcds_q82/datafusion:vortex-compact 50166364 52235988 0.96
tpcds_q83/datafusion:vortex-compact 64286076 66062078 0.97
tpcds_q84/datafusion:vortex-compact 17671279 18867190 0.94
tpcds_q85/datafusion:vortex-compact 157822752 159700079 0.99
tpcds_q86/datafusion:vortex-compact 32335797 31594282 1.02
tpcds_q87/datafusion:vortex-compact 101909161 102307873 1.00
tpcds_q88/datafusion:vortex-compact 132444103 130698310 1.01
tpcds_q89/datafusion:vortex-compact 62965403 62405977 1.01
tpcds_q90/datafusion:vortex-compact 22029591 21867062 1.01
tpcds_q91/datafusion:vortex-compact 40879564 40654624 1.01
tpcds_q92/datafusion:vortex-compact 21214767 22079401 0.96
tpcds_q93/datafusion:vortex-compact 50831069 53059033 0.96
tpcds_q94/datafusion:vortex-compact 32767254 32817459 1.00
tpcds_q95/datafusion:vortex-compact 95925687 96477076 0.99
tpcds_q96/datafusion:vortex-compact 24229402 23967175 1.01
tpcds_q97/datafusion:vortex-compact 44794525 44268738 1.01
tpcds_q98/datafusion:vortex-compact 55288605 55101003 1.00
tpcds_q99/datafusion:vortex-compact 63926620 62574368 1.02
datafusion / parquet (1.012x ➖, 1↑ 2↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 36182441 36260536 1.00
tpcds_q02/datafusion:parquet 🚨 55784628 49965744 1.12
tpcds_q03/datafusion:parquet 17189409 15711050 1.09
tpcds_q04/datafusion:parquet 357264032 352995749 1.01
tpcds_q05/datafusion:parquet 88475552 91561539 0.97
tpcds_q06/datafusion:parquet 92982891 92812325 1.00
tpcds_q07/datafusion:parquet 139354293 131641535 1.06
tpcds_q08/datafusion:parquet 39349628 37772926 1.04
tpcds_q09/datafusion:parquet 55193886 54247242 1.02
tpcds_q10/datafusion:parquet 103570441 101672365 1.02
tpcds_q11/datafusion:parquet 231893579 226732548 1.02
tpcds_q12/datafusion:parquet 30040118 30540861 0.98
tpcds_q13/datafusion:parquet 141373578 140141972 1.01
tpcds_q14/datafusion:parquet 213258362 207739366 1.03
tpcds_q15/datafusion:parquet 56385780 55602610 1.01
tpcds_q16/datafusion:parquet 33431331 33150347 1.01
tpcds_q17/datafusion:parquet 173211194 169597190 1.02
tpcds_q18/datafusion:parquet 175624537 174428326 1.01
tpcds_q19/datafusion:parquet 36036101 35293862 1.02
tpcds_q20/datafusion:parquet 23817771 23607158 1.01
tpcds_q21/datafusion:parquet 27208064 26198898 1.04
tpcds_q22/datafusion:parquet 🚀 142172558 169353908 0.84
tpcds_q23/datafusion:parquet 178838940 178454298 1.00
tpcds_q24/datafusion:parquet 217020688 208142201 1.04
tpcds_q25/datafusion:parquet 175532695 176705959 0.99
tpcds_q26/datafusion:parquet 115961648 114106780 1.02
tpcds_q27/datafusion:parquet 261552756 254778196 1.03
tpcds_q28/datafusion:parquet 52438184 52604148 1.00
tpcds_q29/datafusion:parquet 177726780 175649724 1.01
tpcds_q30/datafusion:parquet 44412403 43897450 1.01
tpcds_q31/datafusion:parquet 103036613 103452100 1.00
tpcds_q32/datafusion:parquet 29615753 29019922 1.02
tpcds_q33/datafusion:parquet 36489137 36166462 1.01
tpcds_q34/datafusion:parquet 36280908 35800121 1.01
tpcds_q35/datafusion:parquet 97089980 94440645 1.03
tpcds_q36/datafusion:parquet 83551474 81696157 1.02
tpcds_q37/datafusion:parquet 25230134 25004449 1.01
tpcds_q38/datafusion:parquet 62534403 61115027 1.02
tpcds_q39/datafusion:parquet 98663952 96810308 1.02
tpcds_q40/datafusion:parquet 34868705 34767139 1.00
tpcds_q41/datafusion:parquet 12569803 12902600 0.97
tpcds_q42/datafusion:parquet 15723595 14998237 1.05
tpcds_q43/datafusion:parquet 25741047 25648110 1.00
tpcds_q44/datafusion:parquet 40138919 40339106 1.00
tpcds_q45/datafusion:parquet 66849900 68268114 0.98
tpcds_q46/datafusion:parquet 51292211 50897551 1.01
tpcds_q47/datafusion:parquet 182795968 188791081 0.97
tpcds_q48/datafusion:parquet 130447218 130570925 1.00
tpcds_q49/datafusion:parquet 72005780 71111731 1.01
tpcds_q50/datafusion:parquet 108759260 105019911 1.04
tpcds_q51/datafusion:parquet 99898939 92550155 1.08
tpcds_q52/datafusion:parquet 15741153 16040452 0.98
tpcds_q53/datafusion:parquet 31587609 30375419 1.04
tpcds_q54/datafusion:parquet 47882577 48400613 0.99
tpcds_q55/datafusion:parquet 15845355 15434090 1.03
tpcds_q56/datafusion:parquet 35843575 34892987 1.03
tpcds_q57/datafusion:parquet 132683595 132685300 1.00
tpcds_q58/datafusion:parquet 76953297 73397708 1.05
tpcds_q59/datafusion:parquet 71875863 67843050 1.06
tpcds_q60/datafusion:parquet 38150012 36974322 1.03
tpcds_q61/datafusion:parquet 67125375 66086872 1.02
tpcds_q62/datafusion:parquet 🚨 46395844 41450628 1.12
tpcds_q63/datafusion:parquet 31251122 31559444 0.99
tpcds_q64/datafusion:parquet 996524093 996371337 1.00
tpcds_q65/datafusion:parquet 48896346 48167050 1.02
tpcds_q66/datafusion:parquet 89527756 93067311 0.96
tpcds_q67/datafusion:parquet 179629568 179774444 1.00
tpcds_q68/datafusion:parquet 51234230 51098740 1.00
tpcds_q69/datafusion:parquet 94713572 93399596 1.01
tpcds_q70/datafusion:parquet 110544267 112278470 0.98
tpcds_q71/datafusion:parquet 29179769 29181536 1.00
tpcds_q72/datafusion:parquet 862539322 850717085 1.01
tpcds_q73/datafusion:parquet 36316345 38250124 0.95
tpcds_q74/datafusion:parquet 131437461 126696902 1.04
tpcds_q75/datafusion:parquet 130320416 131336310 0.99
tpcds_q76/datafusion:parquet 89510332 89486352 1.00
tpcds_q77/datafusion:parquet 57845168 58604310 0.99
tpcds_q78/datafusion:parquet 178233303 181530840 0.98
tpcds_q79/datafusion:parquet 41306730 38998264 1.06
tpcds_q80/datafusion:parquet 110935817 112113823 0.99
tpcds_q81/datafusion:parquet 41130679 41961818 0.98
tpcds_q82/datafusion:parquet 29109268 28184527 1.03
tpcds_q83/datafusion:parquet 55120880 55172368 1.00
tpcds_q84/datafusion:parquet 48987610 49742088 0.98
tpcds_q85/datafusion:parquet 243105225 239970509 1.01
tpcds_q86/datafusion:parquet 21751345 19933209 1.09
tpcds_q87/datafusion:parquet 62830137 63121323 1.00
tpcds_q88/datafusion:parquet 79516102 78463416 1.01
tpcds_q89/datafusion:parquet 38491525 36107489 1.07
tpcds_q90/datafusion:parquet 18298674 19117819 0.96
tpcds_q91/datafusion:parquet 77570671 76624101 1.01
tpcds_q92/datafusion:parquet 25751503 24402170 1.06
tpcds_q93/datafusion:parquet 38030965 38137591 1.00
tpcds_q94/datafusion:parquet 29276057 28356644 1.03
tpcds_q95/datafusion:parquet 134218411 128267339 1.05
tpcds_q96/datafusion:parquet 15183859 15271895 0.99
tpcds_q97/datafusion:parquet 37505729 39603640 0.95
tpcds_q98/datafusion:parquet 36578003 36588745 1.00
tpcds_q99/datafusion:parquet 45038673 44986309 1.00
duckdb / vortex-file-compressed (0.999x ➖, 1↑ 2↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 25852802 26521220 0.97
tpcds_q02/duckdb:vortex-file-compressed 85728075 80507089 1.06
tpcds_q03/duckdb:vortex-file-compressed 24189089 23918175 1.01
tpcds_q04/duckdb:vortex-file-compressed 106663496 109159900 0.98
tpcds_q05/duckdb:vortex-file-compressed 99463239 102371078 0.97
tpcds_q06/duckdb:vortex-file-compressed 34341029 35553957 0.97
tpcds_q07/duckdb:vortex-file-compressed 23494429 23421260 1.00
tpcds_q08/duckdb:vortex-file-compressed 23617828 23060411 1.02
tpcds_q09/duckdb:vortex-file-compressed 40061885 39680278 1.01
tpcds_q10/duckdb:vortex-file-compressed 37704603 36929617 1.02
tpcds_q11/duckdb:vortex-file-compressed 60415450 60503040 1.00
tpcds_q12/duckdb:vortex-file-compressed 13350896 13945008 0.96
tpcds_q13/duckdb:vortex-file-compressed 33938402 33005030 1.03
tpcds_q14/duckdb:vortex-file-compressed 204629230 204593201 1.00
tpcds_q15/duckdb:vortex-file-compressed 42926266 41188183 1.04
tpcds_q16/duckdb:vortex-file-compressed 29090741 29409594 0.99
tpcds_q17/duckdb:vortex-file-compressed 37208313 38929595 0.96
tpcds_q18/duckdb:vortex-file-compressed 44952542 45687931 0.98
tpcds_q19/duckdb:vortex-file-compressed 32531216 31815531 1.02
tpcds_q20/duckdb:vortex-file-compressed 15933362 15491646 1.03
tpcds_q21/duckdb:vortex-file-compressed 🚨 22844912 20546576 1.11
tpcds_q22/duckdb:vortex-file-compressed 114501768 110398187 1.04
tpcds_q23/duckdb:vortex-file-compressed 130435989 128464767 1.02
tpcds_q24/duckdb:vortex-file-compressed 58549453 56058976 1.04
tpcds_q25/duckdb:vortex-file-compressed 37444452 39223114 0.95
tpcds_q26/duckdb:vortex-file-compressed 40476707 42005048 0.96
tpcds_q27/duckdb:vortex-file-compressed 82334184 85210844 0.97
tpcds_q28/duckdb:vortex-file-compressed 37717934 37833047 1.00
tpcds_q29/duckdb:vortex-file-compressed 35154771 37570034 0.94
tpcds_q30/duckdb:vortex-file-compressed 29547679 28659364 1.03
tpcds_q31/duckdb:vortex-file-compressed 25860698 25305429 1.02
tpcds_q32/duckdb:vortex-file-compressed 16641808 17615506 0.94
tpcds_q33/duckdb:vortex-file-compressed 68380919 65094452 1.05
tpcds_q34/duckdb:vortex-file-compressed 19396820 19695236 0.98
tpcds_q35/duckdb:vortex-file-compressed 62911623 61398990 1.02
tpcds_q36/duckdb:vortex-file-compressed 27280217 26600182 1.03
tpcds_q37/duckdb:vortex-file-compressed 21244709 21532854 0.99
tpcds_q38/duckdb:vortex-file-compressed 37320364 37798335 0.99
tpcds_q39/duckdb:vortex-file-compressed 48417009 46358190 1.04
tpcds_q40/duckdb:vortex-file-compressed 22790701 24670224 0.92
tpcds_q41/duckdb:vortex-file-compressed 13005295 13352671 0.97
tpcds_q42/duckdb:vortex-file-compressed 11770429 11622496 1.01
tpcds_q43/duckdb:vortex-file-compressed 20381654 20963885 0.97
tpcds_q44/duckdb:vortex-file-compressed 24015236 24251111 0.99
tpcds_q45/duckdb:vortex-file-compressed 26968094 27698848 0.97
tpcds_q46/duckdb:vortex-file-compressed 47055381 47418700 0.99
tpcds_q47/duckdb:vortex-file-compressed 50013855 49164834 1.02
tpcds_q48/duckdb:vortex-file-compressed 30426764 30974033 0.98
tpcds_q49/duckdb:vortex-file-compressed 29732131 28195624 1.05
tpcds_q50/duckdb:vortex-file-compressed 36900596 34490194 1.07
tpcds_q51/duckdb:vortex-file-compressed 102048153 101258818 1.01
tpcds_q52/duckdb:vortex-file-compressed 11645043 12361817 0.94
tpcds_q53/duckdb:vortex-file-compressed 17445688 17526755 1.00
tpcds_q54/duckdb:vortex-file-compressed 48371808 47699148 1.01
tpcds_q55/duckdb:vortex-file-compressed 11804967 12178968 0.97
tpcds_q56/duckdb:vortex-file-compressed 69275149 64865881 1.07
tpcds_q57/duckdb:vortex-file-compressed 45992727 45462549 1.01
tpcds_q58/duckdb:vortex-file-compressed 🚨 34658514 31248510 1.11
tpcds_q59/duckdb:vortex-file-compressed 57895823 54657688 1.06
tpcds_q60/duckdb:vortex-file-compressed 65237951 65390582 1.00
tpcds_q61/duckdb:vortex-file-compressed 35384906 38394834 0.92
tpcds_q62/duckdb:vortex-file-compressed 🚀 17908810 21124297 0.85
tpcds_q63/duckdb:vortex-file-compressed 17690626 18195080 0.97
tpcds_q64/duckdb:vortex-file-compressed 79075572 79348057 1.00
tpcds_q65/duckdb:vortex-file-compressed 23810549 24281524 0.98
tpcds_q66/duckdb:vortex-file-compressed 58589376 59589645 0.98
tpcds_q67/duckdb:vortex-file-compressed 145542613 144651264 1.01
tpcds_q68/duckdb:vortex-file-compressed 40261714 40160813 1.00
tpcds_q69/duckdb:vortex-file-compressed 36988431 38110503 0.97
tpcds_q70/duckdb:vortex-file-compressed 25044326 24842160 1.01
tpcds_q71/duckdb:vortex-file-compressed 20652174 21089697 0.98
tpcds_q72/duckdb:vortex-file-compressed 179623706 178799910 1.00
tpcds_q73/duckdb:vortex-file-compressed 19228178 20309515 0.95
tpcds_q74/duckdb:vortex-file-compressed 52205021 50089066 1.04
tpcds_q75/duckdb:vortex-file-compressed 60783165 61886177 0.98
tpcds_q76/duckdb:vortex-file-compressed 63169404 62266800 1.01
tpcds_q77/duckdb:vortex-file-compressed 67468636 66601437 1.01
tpcds_q78/duckdb:vortex-file-compressed 82590805 79595580 1.04
tpcds_q79/duckdb:vortex-file-compressed 37554907 34956054 1.07
tpcds_q80/duckdb:vortex-file-compressed 91950309 91111085 1.01
tpcds_q81/duckdb:vortex-file-compressed 33470302 33104304 1.01
tpcds_q82/duckdb:vortex-file-compressed 22256328 22739383 0.98
tpcds_q83/duckdb:vortex-file-compressed 26395883 27581045 0.96
tpcds_q84/duckdb:vortex-file-compressed 17373163 17222002 1.01
tpcds_q85/duckdb:vortex-file-compressed 45207920 45355144 1.00
tpcds_q86/duckdb:vortex-file-compressed 16693759 16357710 1.02
tpcds_q87/duckdb:vortex-file-compressed 41904549 40337202 1.04
tpcds_q88/duckdb:vortex-file-compressed 40612350 41039495 0.99
tpcds_q89/duckdb:vortex-file-compressed 17821940 18789576 0.95
tpcds_q90/duckdb:vortex-file-compressed 15152846 14892238 1.02
tpcds_q91/duckdb:vortex-file-compressed 27375702 26408018 1.04
tpcds_q92/duckdb:vortex-file-compressed 14118292 14812616 0.95
tpcds_q93/duckdb:vortex-file-compressed 31343594 30793552 1.02
tpcds_q94/duckdb:vortex-file-compressed 22477315 23080343 0.97
tpcds_q95/duckdb:vortex-file-compressed 157448547 156729404 1.00
tpcds_q96/duckdb:vortex-file-compressed 16919574 18125985 0.93
tpcds_q97/duckdb:vortex-file-compressed 40054919 39597662 1.01
tpcds_q98/duckdb:vortex-file-compressed 17311892 18473053 0.94
tpcds_q99/duckdb:vortex-file-compressed 33925593 31655865 1.07
duckdb / vortex-compact (0.956x ➖, 19↑ 1↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 33075784 35116892 0.94
tpcds_q02/duckdb:vortex-compact 126450415 127176868 0.99
tpcds_q03/duckdb:vortex-compact 53623821 50486595 1.06
tpcds_q04/duckdb:vortex-compact 126969564 129927789 0.98
tpcds_q05/duckdb:vortex-compact 178440364 166848894 1.07
tpcds_q06/duckdb:vortex-compact 40743098 40793018 1.00
tpcds_q07/duckdb:vortex-compact 39107085 40161363 0.97
tpcds_q08/duckdb:vortex-compact 28818440 29614120 0.97
tpcds_q09/duckdb:vortex-compact 112786651 109393045 1.03
tpcds_q10/duckdb:vortex-compact 48839159 49531726 0.99
tpcds_q11/duckdb:vortex-compact 77975504 76029787 1.03
tpcds_q12/duckdb:vortex-compact 18929508 19082066 0.99
tpcds_q13/duckdb:vortex-compact 53895434 54448578 0.99
tpcds_q14/duckdb:vortex-compact 290404384 290769907 1.00
tpcds_q15/duckdb:vortex-compact 45402867 47387480 0.96
tpcds_q16/duckdb:vortex-compact 38512079 38914644 0.99
tpcds_q17/duckdb:vortex-compact 54354013 54312531 1.00
tpcds_q18/duckdb:vortex-compact 67037325 69503822 0.96
tpcds_q19/duckdb:vortex-compact 40485138 41143148 0.98
tpcds_q20/duckdb:vortex-compact 21662473 20196744 1.07
tpcds_q21/duckdb:vortex-compact 27422075 27998519 0.98
tpcds_q22/duckdb:vortex-compact 115795405 118463723 0.98
tpcds_q23/duckdb:vortex-compact 174029794 175319228 0.99
tpcds_q24/duckdb:vortex-compact 82982690 78000466 1.06
tpcds_q25/duckdb:vortex-compact 50497809 52056440 0.97
tpcds_q26/duckdb:vortex-compact 49433251 53524848 0.92
tpcds_q27/duckdb:vortex-compact 141227685 142886456 0.99
tpcds_q28/duckdb:vortex-compact 108282575 109337723 0.99
tpcds_q29/duckdb:vortex-compact 50756232 51993774 0.98
tpcds_q30/duckdb:vortex-compact 35487525 34165262 1.04
tpcds_q31/duckdb:vortex-compact 30947054 30188663 1.03
tpcds_q32/duckdb:vortex-compact 23178788 23500614 0.99
tpcds_q33/duckdb:vortex-compact 145791675 145080797 1.00
tpcds_q34/duckdb:vortex-compact 29878158 29841937 1.00
tpcds_q35/duckdb:vortex-compact 70861143 70524511 1.00
tpcds_q36/duckdb:vortex-compact 34665393 34682673 1.00
tpcds_q37/duckdb:vortex-compact 30904102 31785963 0.97
tpcds_q38/duckdb:vortex-compact 40248387 41031770 0.98
tpcds_q39/duckdb:vortex-compact 52809633 52368469 1.01
tpcds_q40/duckdb:vortex-compact 31762120 31450497 1.01
tpcds_q41/duckdb:vortex-compact 16260624 16698497 0.97
tpcds_q42/duckdb:vortex-compact 14801158 14823236 1.00
tpcds_q43/duckdb:vortex-compact 24163896 24328773 0.99
tpcds_q44/duckdb:vortex-compact 34028567 35963907 0.95
tpcds_q45/duckdb:vortex-compact 31531570 30935092 1.02
tpcds_q46/duckdb:vortex-compact 59814262 62006288 0.96
tpcds_q47/duckdb:vortex-compact 53436340 55984182 0.95
tpcds_q48/duckdb:vortex-compact 45432404 45720780 0.99
tpcds_q49/duckdb:vortex-compact 47576322 49554702 0.96
tpcds_q50/duckdb:vortex-compact 57776003 54908669 1.05
tpcds_q51/duckdb:vortex-compact 🚀 104806009 128511741 0.82
tpcds_q52/duckdb:vortex-compact 15366287 15335491 1.00
tpcds_q53/duckdb:vortex-compact 22058806 22870971 0.96
tpcds_q54/duckdb:vortex-compact 85072090 89272555 0.95
tpcds_q55/duckdb:vortex-compact 15427954 15441272 1.00
tpcds_q56/duckdb:vortex-compact 139498641 141551656 0.99
tpcds_q57/duckdb:vortex-compact 48040695 48047617 1.00
tpcds_q58/duckdb:vortex-compact 🚨 45544353 39645098 1.15
tpcds_q59/duckdb:vortex-compact 65669142 66987934 0.98
tpcds_q60/duckdb:vortex-compact 142078048 144585446 0.98
tpcds_q61/duckdb:vortex-compact 53093739 55011324 0.97
tpcds_q62/duckdb:vortex-compact 22083980 22577102 0.98
tpcds_q63/duckdb:vortex-compact 22375361 22740874 0.98
tpcds_q64/duckdb:vortex-compact 105664627 105412956 1.00
tpcds_q65/duckdb:vortex-compact 28693382 29423184 0.98
tpcds_q66/duckdb:vortex-compact 98187550 102674019 0.96
tpcds_q67/duckdb:vortex-compact 150535911 155070310 0.97
tpcds_q68/duckdb:vortex-compact 55841901 58107180 0.96
tpcds_q69/duckdb:vortex-compact 51405587 49217645 1.04
tpcds_q70/duckdb:vortex-compact 28438897 29074207 0.98
tpcds_q71/duckdb:vortex-compact 26725623 26823857 1.00
tpcds_q72/duckdb:vortex-compact 196615829 198694227 0.99
tpcds_q73/duckdb:vortex-compact 28504883 29597063 0.96
tpcds_q74/duckdb:vortex-compact 56719289 62960968 0.90
tpcds_q75/duckdb:vortex-compact 72686743 77703332 0.94
tpcds_q76/duckdb:vortex-compact 142425731 145421391 0.98
tpcds_q77/duckdb:vortex-compact 139501450 154477911 0.90
tpcds_q78/duckdb:vortex-compact 🚀 86128178 101507697 0.85
tpcds_q79/duckdb:vortex-compact 67301999 67509372 1.00
tpcds_q80/duckdb:vortex-compact 🚀 166141051 195066867 0.85
tpcds_q81/duckdb:vortex-compact 🚀 39711381 47824391 0.83
tpcds_q82/duckdb:vortex-compact 🚀 30702326 36989548 0.83
tpcds_q83/duckdb:vortex-compact 🚀 44644294 52639669 0.85
tpcds_q84/duckdb:vortex-compact 🚀 20471291 24153586 0.85
tpcds_q85/duckdb:vortex-compact 🚀 60147207 73897537 0.81
tpcds_q86/duckdb:vortex-compact 🚀 18864428 23425342 0.81
tpcds_q87/duckdb:vortex-compact 🚀 43399874 49455349 0.88
tpcds_q88/duckdb:vortex-compact 43902599 48582913 0.90
tpcds_q89/duckdb:vortex-compact 🚀 24024907 28735440 0.84
tpcds_q90/duckdb:vortex-compact 🚀 16238260 18323591 0.89
tpcds_q91/duckdb:vortex-compact 🚀 42998119 50344651 0.85
tpcds_q92/duckdb:vortex-compact 🚀 19759424 23465432 0.84
tpcds_q93/duckdb:vortex-compact 🚀 37234653 44560718 0.84
tpcds_q94/duckdb:vortex-compact 🚀 26826334 32910924 0.82
tpcds_q95/duckdb:vortex-compact 159899417 166378308 0.96
tpcds_q96/duckdb:vortex-compact 🚀 18377884 25822854 0.71
tpcds_q97/duckdb:vortex-compact 🚀 43270819 48750724 0.89
tpcds_q98/duckdb:vortex-compact 🚀 22605578 26161785 0.86
tpcds_q99/duckdb:vortex-compact 37879075 41309200 0.92
duckdb / parquet (1.001x ➖, 1↑ 3↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 48903439 44906327 1.09
tpcds_q02/duckdb:parquet 59584911 60597648 0.98
tpcds_q03/duckdb:parquet 12218856 12165785 1.00
tpcds_q04/duckdb:parquet 124311110 124605883 1.00
tpcds_q05/duckdb:parquet 72526262 69460863 1.04
tpcds_q06/duckdb:parquet 28420878 29275802 0.97
tpcds_q07/duckdb:parquet 23613692 23833345 0.99
tpcds_q08/duckdb:parquet 27511349 26930482 1.02
tpcds_q09/duckdb:parquet 39719581 39640707 1.00
tpcds_q10/duckdb:parquet 33426864 34215288 0.98
tpcds_q11/duckdb:parquet 90159731 88031431 1.02
tpcds_q12/duckdb:parquet 14049115 15184715 0.93
tpcds_q13/duckdb:parquet 34321512 35571505 0.96
tpcds_q14/duckdb:parquet 159977881 162180530 0.99
tpcds_q15/duckdb:parquet 29053596 30012392 0.97
tpcds_q16/duckdb:parquet 22147958 21120265 1.05
tpcds_q17/duckdb:parquet 37875400 37455448 1.01
tpcds_q18/duckdb:parquet 46043454 46073695 1.00
tpcds_q19/duckdb:parquet 29229322 28725512 1.02
tpcds_q20/duckdb:parquet 15723420 15541965 1.01
tpcds_q21/duckdb:parquet 11080004 12031542 0.92
tpcds_q22/duckdb:parquet 67656026 65924868 1.03
tpcds_q23/duckdb:parquet 116125982 117242637 0.99
tpcds_q24/duckdb:parquet 44637652 44480061 1.00
tpcds_q25/duckdb:parquet 33084646 33285004 0.99
tpcds_q26/duckdb:parquet 37627279 36440086 1.03
tpcds_q27/duckdb:parquet 88527591 88809655 1.00
tpcds_q28/duckdb:parquet 37378936 37527645 1.00
tpcds_q29/duckdb:parquet 35106296 34390785 1.02
tpcds_q30/duckdb:parquet 39161869 38794379 1.01
tpcds_q31/duckdb:parquet 23497808 23992940 0.98
tpcds_q32/duckdb:parquet 🚨 11998441 10783105 1.11
tpcds_q33/duckdb:parquet 74109873 71959016 1.03
tpcds_q34/duckdb:parquet 20575534 21290508 0.97
tpcds_q35/duckdb:parquet 59428998 58711730 1.01
tpcds_q36/duckdb:parquet 20275645 21812951 0.93
tpcds_q37/duckdb:parquet 13862183 13117924 1.06
tpcds_q38/duckdb:parquet 33588626 32627761 1.03
tpcds_q39/duckdb:parquet 32507530 32533066 1.00
tpcds_q40/duckdb:parquet 17761030 18100896 0.98
tpcds_q41/duckdb:parquet 7490778 7713367 0.97
tpcds_q42/duckdb:parquet 10346543 10458189 0.99
tpcds_q43/duckdb:parquet 15364934 15389919 1.00
tpcds_q44/duckdb:parquet 20672881 21300300 0.97
tpcds_q45/duckdb:parquet 25752032 27330100 0.94
tpcds_q46/duckdb:parquet 44722837 45225997 0.99
tpcds_q47/duckdb:parquet 45862174 45994369 1.00
tpcds_q48/duckdb:parquet 30481781 30323958 1.01
tpcds_q49/duckdb:parquet 24352267 26200340 0.93
tpcds_q50/duckdb:parquet 24333778 24690580 0.99
tpcds_q51/duckdb:parquet 94652540 93681361 1.01
tpcds_q52/duckdb:parquet 10775405 10572025 1.02
tpcds_q53/duckdb:parquet 16132613 16338483 0.99
tpcds_q54/duckdb:parquet 39811891 40638486 0.98
tpcds_q55/duckdb:parquet 10970633 10739463 1.02
tpcds_q56/duckdb:parquet 67441967 68275968 0.99
tpcds_q57/duckdb:parquet 34693844 34748378 1.00
tpcds_q58/duckdb:parquet 21070572 21643584 0.97
tpcds_q59/duckdb:parquet 36710033 36714390 1.00
tpcds_q60/duckdb:parquet 71727975 70859335 1.01
tpcds_q61/duckdb:parquet 31118996 31297826 0.99
tpcds_q62/duckdb:parquet 11829618 12288358 0.96
tpcds_q63/duckdb:parquet 15824128 15423011 1.03
tpcds_q64/duckdb:parquet 73381571 73556978 1.00
tpcds_q65/duckdb:parquet 19970910 20210601 0.99
tpcds_q66/duckdb:parquet 🚨 60526034 54180174 1.12
tpcds_q67/duckdb:parquet 137408424 137531042 1.00
tpcds_q68/duckdb:parquet 38290279 37850019 1.01
tpcds_q69/duckdb:parquet 38629041 37729114 1.02
tpcds_q70/duckdb:parquet 19653743 19739768 1.00
tpcds_q71/duckdb:parquet 🚨 20555395 18410071 1.12
tpcds_q72/duckdb:parquet 165964776 164102707 1.01
tpcds_q73/duckdb:parquet 17510757 17891272 0.98
tpcds_q74/duckdb:parquet 51245670 47971245 1.07
tpcds_q75/duckdb:parquet 54824920 52958253 1.04
tpcds_q76/duckdb:parquet 71192839 70240966 1.01
tpcds_q77/duckdb:parquet 63978755 62324194 1.03
tpcds_q78/duckdb:parquet 74483298 75428644 0.99
tpcds_q79/duckdb:parquet 27315129 27501456 0.99
tpcds_q80/duckdb:parquet 82511685 84050529 0.98
tpcds_q81/duckdb:parquet 46268654 47007743 0.98
tpcds_q82/duckdb:parquet 15567805 15754245 0.99
tpcds_q83/duckdb:parquet 16546811 15530297 1.07
tpcds_q84/duckdb:parquet 19174163 19338022 0.99
tpcds_q85/duckdb:parquet 40680443 38153464 1.07
tpcds_q86/duckdb:parquet 12317661 12802958 0.96
tpcds_q87/duckdb:parquet 36465401 36237820 1.01
tpcds_q88/duckdb:parquet 28815842 29049445 0.99
tpcds_q89/duckdb:parquet 17272642 17349473 1.00
tpcds_q90/duckdb:parquet 7408247 7199350 1.03
tpcds_q91/duckdb:parquet 23706161 22806248 1.04
tpcds_q92/duckdb:parquet 10926581 11372399 0.96
tpcds_q93/duckdb:parquet 30645179 30157267 1.02
tpcds_q94/duckdb:parquet 16174097 15965923 1.01
tpcds_q95/duckdb:parquet 🚀 130421542 147104033 0.89
tpcds_q96/duckdb:parquet 8996223 9177990 0.98
tpcds_q97/duckdb:parquet 34353476 35639160 0.96
tpcds_q98/duckdb:parquet 18240341 17751928 1.03
tpcds_q99/duckdb:parquet 19390412 19803238 0.98
duckdb / duckdb (0.882x ✅, 64↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚀 19807749 22667906 0.87
tpcds_q02/duckdb:duckdb 18382636 20219067 0.91
tpcds_q03/duckdb:duckdb 🚀 8066311 10475784 0.77
tpcds_q04/duckdb:duckdb 161185824 178707092 0.90
tpcds_q05/duckdb:duckdb 🚀 17926687 21027603 0.85
tpcds_q06/duckdb:duckdb 🚀 22094133 28837052 0.77
tpcds_q07/duckdb:duckdb 🚀 38105440 43908678 0.87
tpcds_q08/duckdb:duckdb 120424211 123836009 0.97
tpcds_q09/duckdb:duckdb 19406982 20815091 0.93
tpcds_q10/duckdb:duckdb 🚀 23318079 26741625 0.87
tpcds_q11/duckdb:duckdb 139703979 152345294 0.92
tpcds_q12/duckdb:duckdb 11503977 12732729 0.90
tpcds_q13/duckdb:duckdb 23204622 24965660 0.93
tpcds_q14/duckdb:duckdb 92767944 102322296 0.91
tpcds_q15/duckdb:duckdb 🚀 24370707 27916398 0.87
tpcds_q16/duckdb:duckdb 🚀 17490595 20691639 0.85
tpcds_q17/duckdb:duckdb 🚀 20502648 25566336 0.80
tpcds_q18/duckdb:duckdb 🚀 43083036 50236966 0.86
tpcds_q19/duckdb:duckdb 🚀 17050103 19001098 0.90
tpcds_q20/duckdb:duckdb 🚀 11751686 13945447 0.84
tpcds_q21/duckdb:duckdb 🚀 6455321 7954310 0.81
tpcds_q22/duckdb:duckdb 🚀 61882909 75423721 0.82
tpcds_q23/duckdb:duckdb 77722819 83255394 0.93
tpcds_q24/duckdb:duckdb 🚀 22134092 27301066 0.81
tpcds_q25/duckdb:duckdb 🚀 16759577 18730935 0.89
tpcds_q26/duckdb:duckdb 27025942 29619184 0.91
tpcds_q27/duckdb:duckdb 🚀 38273823 44386345 0.86
tpcds_q28/duckdb:duckdb 21274867 23016596 0.92
tpcds_q29/duckdb:duckdb 🚀 20027527 22397468 0.89
tpcds_q30/duckdb:duckdb 🚀 28977165 33186559 0.87
tpcds_q31/duckdb:duckdb 🚀 18576476 22850687 0.81
tpcds_q32/duckdb:duckdb 🚀 6675343 8198028 0.81
tpcds_q33/duckdb:duckdb 🚀 12150379 14468605 0.84
tpcds_q34/duckdb:duckdb 🚀 14180611 16698615 0.85
tpcds_q35/duckdb:duckdb 🚀 32249544 39204595 0.82
tpcds_q36/duckdb:duckdb 🚀 67936805 78822557 0.86
tpcds_q37/duckdb:duckdb 🚀 7173136 8711904 0.82
tpcds_q38/duckdb:duckdb 🚀 29448243 34177756 0.86
tpcds_q39/duckdb:duckdb 26474728 28965149 0.91
tpcds_q40/duckdb:duckdb 🚀 12587033 15566485 0.81
tpcds_q41/duckdb:duckdb 🚀 8711692 10515935 0.83
tpcds_q42/duckdb:duckdb 🚀 6397534 7494114 0.85
tpcds_q43/duckdb:duckdb 🚀 10680475 12111867 0.88
tpcds_q44/duckdb:duckdb 🚀 13206635 15151194 0.87
tpcds_q45/duckdb:duckdb 🚀 16807643 20489266 0.82
tpcds_q46/duckdb:duckdb 🚀 35636446 41765754 0.85
tpcds_q47/duckdb:duckdb 🚀 40945113 47009476 0.87
tpcds_q48/duckdb:duckdb 🚀 21501887 25173889 0.85
tpcds_q49/duckdb:duckdb 🚀 15898105 17669629 0.90
tpcds_q50/duckdb:duckdb 🚀 13580142 15848669 0.86
tpcds_q51/duckdb:duckdb 🚀 89595518 114668905 0.78
tpcds_q52/duckdb:duckdb 7454499 8117598 0.92
tpcds_q53/duckdb:duckdb 🚀 11856701 13400693 0.88
tpcds_q54/duckdb:duckdb 🚀 16624606 18479456 0.90
tpcds_q55/duckdb:duckdb 🚀 7015228 8335398 0.84
tpcds_q56/duckdb:duckdb 🚀 12928333 15285807 0.85
tpcds_q57/duckdb:duckdb 🚀 31269976 35833515 0.87
tpcds_q58/duckdb:duckdb 12590799 13443207 0.94
tpcds_q59/duckdb:duckdb 33987104 37279039 0.91
tpcds_q60/duckdb:duckdb 🚀 14088284 16068359 0.88
tpcds_q61/duckdb:duckdb 🚀 13891306 16077936 0.86
tpcds_q62/duckdb:duckdb 🚀 8969198 10091894 0.89
tpcds_q63/duckdb:duckdb 10801092 11823255 0.91
tpcds_q64/duckdb:duckdb 🚀 51946341 59372098 0.87
tpcds_q65/duckdb:duckdb 🚀 31530223 39202302 0.80
tpcds_q66/duckdb:duckdb 🚀 24044188 28127918 0.85
tpcds_q67/duckdb:duckdb 🚀 128195983 149207204 0.86
tpcds_q68/duckdb:duckdb 🚀 24416578 27970391 0.87
tpcds_q69/duckdb:duckdb 24905411 26220500 0.95
tpcds_q70/duckdb:duckdb 🚀 14029076 15664943 0.90
tpcds_q71/duckdb:duckdb 12912323 13768985 0.94
tpcds_q72/duckdb:duckdb 41607364 45899366 0.91
tpcds_q73/duckdb:duckdb 🚀 10217618 11623218 0.88
tpcds_q74/duckdb:duckdb 97617495 104058648 0.94
tpcds_q75/duckdb:duckdb 42512226 46770095 0.91
tpcds_q76/duckdb:duckdb 12464095 12722935 0.98
tpcds_q77/duckdb:duckdb 12109307 12311329 0.98
tpcds_q78/duckdb:duckdb 63706682 67695174 0.94
tpcds_q79/duckdb:duckdb 🚀 17799771 19861440 0.90
tpcds_q80/duckdb:duckdb 🚀 27816398 32438842 0.86
tpcds_q81/duckdb:duckdb 36462061 39021721 0.93
tpcds_q82/duckdb:duckdb 8772995 9472578 0.93
tpcds_q83/duckdb:duckdb 🚀 8902318 9922399 0.90
tpcds_q84/duckdb:duckdb 🚀 13066979 14813477 0.88
tpcds_q85/duckdb:duckdb 🚀 22608375 27216458 0.83
tpcds_q86/duckdb:duckdb 10782177 11972395 0.90
tpcds_q87/duckdb:duckdb 33166922 35199990 0.94
tpcds_q88/duckdb:duckdb 24323985 25228326 0.96
tpcds_q89/duckdb:duckdb 13000881 14379199 0.90
tpcds_q90/duckdb:duckdb 🚀 5365082 6293762 0.85
tpcds_q91/duckdb:duckdb 🚀 12123860 13926304 0.87
tpcds_q92/duckdb:duckdb 8757938 9341052 0.94
tpcds_q93/duckdb:duckdb 🚀 21524994 24612554 0.87
tpcds_q94/duckdb:duckdb 12680515 13304137 0.95
tpcds_q95/duckdb:duckdb 126330155 117732893 1.07
tpcds_q96/duckdb:duckdb 🚀 4479405 5012505 0.89
tpcds_q97/duckdb:duckdb 🚀 28831500 32440546 0.89
tpcds_q98/duckdb:duckdb 13228028 14333193 0.92
tpcds_q99/duckdb:duckdb 16415308 16869114 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -4.0% +4.2% -7.9% +13.5% ➖ noise
1 datafusion:vortex-file-compressed +1.7% +4.2% -2.5% +15.9% ➖ noise
1 duckdb:duckdb -12.6% +4.2% -16.2% +13.6% ✅ faster
1 duckdb:vortex-compact -5.8% +4.2% -9.6% +13.4% ➖ noise
1 duckdb:vortex-file-compressed -2.5% +4.2% -6.5% +11.2% ➖ noise
2 datafusion:vortex-compact -4.5% +4.8% -8.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +1.2% +4.8% -3.4% +10.5% ➖ noise
2 duckdb:duckdb -9.1% +4.8% -13.2% +10.0% ✅ faster
2 duckdb:vortex-compact -0.6% +4.8% -5.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +6.5% +4.8% +1.6% +12.0% ➖ noise
3 datafusion:vortex-compact -6.7% +4.8% -11.0% +13.3% ➖ noise
3 datafusion:vortex-file-compressed -0.3% +4.8% -4.8% +14.1% ➖ noise
3 duckdb:duckdb -23.0% +4.8% -26.5% +17.3% ✅ faster
3 duckdb:vortex-compact +6.2% +4.8% +1.3% +16.8% ➖ noise
3 duckdb:vortex-file-compressed +1.1% +4.8% -3.5% +16.8% ➖ noise
4 datafusion:vortex-compact -0.9% +0.5% -1.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.6% +0.5% +0.1% +10.0% ➖ noise
4 duckdb:duckdb -9.8% +0.5% -10.2% +10.0% ✅ faster
4 duckdb:vortex-compact -2.3% +0.5% -2.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.3% +0.5% -2.8% +10.0% ➖ noise
5 datafusion:vortex-compact +1.9% +0.4% +1.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -0.2% +0.4% -0.6% +10.0% ➖ noise
5 duckdb:duckdb -14.7% +0.4% -15.1% +13.2% ✅ faster
5 duckdb:vortex-compact +6.9% +0.4% +6.5% +11.2% ➖ noise
5 duckdb:vortex-file-compressed -2.8% +0.4% -3.3% +10.6% ➖ noise
6 datafusion:vortex-compact -1.5% -1.4% -0.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.0% -1.4% +2.5% +10.0% ➖ noise
6 duckdb:duckdb -23.4% -1.4% -22.3% +17.4% ✅ faster
6 duckdb:vortex-compact -0.1% -1.4% +1.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -3.4% -1.4% -2.1% +10.0% ➖ noise
7 datafusion:vortex-compact -1.8% +2.4% -4.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -4.9% +2.4% -7.2% +10.0% ➖ noise
7 duckdb:duckdb -13.2% +2.4% -15.3% +16.8% ✅ faster
7 duckdb:vortex-compact -2.6% +2.4% -4.9% +11.8% ➖ noise
7 duckdb:vortex-file-compressed +0.3% +2.4% -2.1% +15.2% ➖ noise
8 datafusion:vortex-compact -2.1% +3.2% -5.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -5.0% +3.2% -7.9% +11.8% ➖ noise
8 duckdb:duckdb -2.8% +3.2% -5.7% +10.0% ➖ noise
8 duckdb:vortex-compact -2.7% +3.2% -5.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.4% +3.2% -0.7% +12.2% ➖ noise
9 datafusion:vortex-compact -0.1% +1.0% -1.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -2.1% +1.0% -3.0% +10.0% ➖ noise
9 duckdb:duckdb -6.8% +1.0% -7.7% +10.0% ➖ noise
9 duckdb:vortex-compact +3.1% +1.0% +2.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.0% +1.0% -0.0% +10.0% ➖ noise
10 datafusion:vortex-compact -0.6% -0.2% -0.4% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -3.3% -0.2% -3.0% +10.0% ➖ noise
10 duckdb:duckdb -12.8% -0.2% -12.6% +10.0% ✅ faster
10 duckdb:vortex-compact -1.4% -0.2% -1.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.1% -0.2% +2.3% +10.0% ➖ noise
11 datafusion:vortex-compact -1.0% +2.3% -3.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -1.0% +2.3% -3.3% +10.0% ➖ noise
11 duckdb:duckdb -8.3% +2.3% -10.4% +10.0% ✅ faster
11 duckdb:vortex-compact +2.6% +2.3% +0.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -0.1% +2.3% -2.4% +10.0% ➖ noise
12 datafusion:vortex-compact -0.7% -4.6% +4.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +0.8% -4.6% +5.7% +10.0% ➖ noise
12 duckdb:duckdb -9.7% -4.6% -5.3% +11.0% ➖ noise
12 duckdb:vortex-compact -0.8% -4.6% +4.0% +12.3% ➖ noise
12 duckdb:vortex-file-compressed -4.3% -4.6% +0.4% +11.0% ➖ noise
13 datafusion:vortex-compact +1.0% -1.3% +2.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.7% -1.3% -0.4% +10.0% ➖ noise
13 duckdb:duckdb -7.1% -1.3% -5.8% +10.0% ➖ noise
13 duckdb:vortex-compact -1.0% -1.3% +0.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +2.8% -1.3% +4.2% +10.0% ➖ noise
14 datafusion:vortex-compact -1.9% +0.6% -2.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -0.4% +0.6% -1.0% +10.0% ➖ noise
14 duckdb:duckdb -9.3% +0.6% -9.9% +10.0% ✅ faster
14 duckdb:vortex-compact -0.1% +0.6% -0.8% +15.0% ➖ noise
14 duckdb:vortex-file-compressed +0.0% +0.6% -0.6% +13.3% ➖ noise
15 datafusion:vortex-compact -6.0% -0.9% -5.1% +16.2% ➖ noise
15 datafusion:vortex-file-compressed -1.9% -0.9% -1.0% +15.0% ➖ noise
15 duckdb:duckdb -12.7% -0.9% -11.9% +17.1% ➖ noise
15 duckdb:vortex-compact -4.2% -0.9% -3.3% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +4.2% -0.9% +5.2% +10.0% ➖ noise
16 datafusion:vortex-compact +4.6% +2.8% +1.7% +11.6% ➖ noise
16 datafusion:vortex-file-compressed -0.8% +2.8% -3.6% +11.3% ➖ noise
16 duckdb:duckdb -15.5% +2.8% -17.8% +15.6% ✅ faster
16 duckdb:vortex-compact -1.0% +2.8% -3.8% +10.2% ➖ noise
16 duckdb:vortex-file-compressed -1.1% +2.8% -3.8% +10.0% ➖ noise
17 datafusion:vortex-compact -1.3% +1.6% -2.8% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +3.4% +1.6% +1.7% +10.0% ➖ noise
17 duckdb:duckdb -19.8% +1.6% -21.1% +11.3% ✅ faster
17 duckdb:vortex-compact +0.1% +1.6% -1.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -4.4% +1.6% -5.9% +10.0% ➖ noise
18 datafusion:vortex-compact -2.9% +0.3% -3.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.1% +0.3% -0.4% +10.0% ➖ noise
18 duckdb:duckdb -14.2% +0.3% -14.5% +10.0% ✅ faster
18 duckdb:vortex-compact -3.5% +0.3% -3.8% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.6% +0.3% -1.9% +10.0% ➖ noise
19 datafusion:vortex-compact +6.2% +1.9% +4.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -3.0% +1.9% -4.8% +10.0% ➖ noise
19 duckdb:duckdb -10.3% +1.9% -12.0% +10.0% ✅ faster
19 duckdb:vortex-compact -1.6% +1.9% -3.5% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +2.2% +1.9% +0.3% +10.0% ➖ noise
20 datafusion:vortex-compact +7.2% +1.0% +6.1% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -2.1% +1.0% -3.0% +10.0% ➖ noise
20 duckdb:duckdb -15.7% +1.0% -16.6% +13.2% ✅ faster
20 duckdb:vortex-compact +7.3% +1.0% +6.2% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +2.9% +1.0% +1.8% +11.0% ➖ noise
21 datafusion:vortex-compact -8.3% -2.2% -6.2% +11.1% ➖ noise
21 datafusion:vortex-file-compressed -0.1% -2.2% +2.2% +11.6% ➖ noise
21 duckdb:duckdb -18.8% -2.2% -17.0% +24.2% ➖ noise
21 duckdb:vortex-compact -2.1% -2.2% +0.1% +12.3% ➖ noise
21 duckdb:vortex-file-compressed +11.2% -2.2% +13.7% +14.2% ➖ noise
22 datafusion:vortex-compact -1.1% -7.2% +6.5% +11.2% ➖ noise
22 datafusion:vortex-file-compressed +0.8% -7.2% +8.6% +11.1% ➖ noise
22 duckdb:duckdb -18.0% -7.2% -11.6% +12.7% ✅ faster
22 duckdb:vortex-compact -2.3% -7.2% +5.3% +10.7% ➖ noise
22 duckdb:vortex-file-compressed +3.7% -7.2% +11.7% +12.1% ➖ noise
23 datafusion:vortex-compact +2.1% -0.4% +2.5% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +1.1% -0.4% +1.5% +10.0% ➖ noise
23 duckdb:duckdb -6.6% -0.4% -6.3% +16.6% ➖ noise
23 duckdb:vortex-compact -0.7% -0.4% -0.4% +11.8% ➖ noise
23 duckdb:vortex-file-compressed +1.5% -0.4% +1.9% +10.0% ➖ noise
24 datafusion:vortex-compact -3.8% +2.3% -5.9% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +0.2% +2.3% -2.0% +10.0% ➖ noise
24 duckdb:duckdb -18.9% +2.3% -20.7% +10.7% ✅ faster
24 duckdb:vortex-compact +6.4% +2.3% +4.0% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +4.4% +2.3% +2.1% +10.0% ➖ noise
25 datafusion:vortex-compact -0.4% -0.6% +0.3% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +2.9% -0.6% +3.5% +10.0% ➖ noise
25 duckdb:duckdb -10.5% -0.6% -10.0% +10.0% ✅ faster
25 duckdb:vortex-compact -3.0% -0.6% -2.4% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -4.5% -0.6% -3.9% +10.0% ➖ noise
26 datafusion:vortex-compact +1.6% +2.4% -0.8% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +1.4% +2.4% -1.0% +10.0% ➖ noise
26 duckdb:duckdb -8.8% +2.4% -10.9% +16.8% ➖ noise
26 duckdb:vortex-compact -7.6% +2.4% -9.8% +10.0% ✅ faster
26 duckdb:vortex-file-compressed -3.6% +2.4% -5.9% +11.2% ➖ noise
27 datafusion:vortex-compact -0.6% +1.2% -1.8% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +0.9% +1.2% -0.2% +10.0% ➖ noise
27 duckdb:duckdb -13.8% +1.2% -14.8% +20.9% ➖ noise
27 duckdb:vortex-compact -1.2% +1.2% -2.3% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -3.4% +1.2% -4.5% +10.0% ➖ noise
28 datafusion:vortex-compact +3.6% -0.4% +3.9% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +1.5% -0.4% +1.9% +10.0% ➖ noise
28 duckdb:duckdb -7.6% -0.4% -7.2% +10.0% ➖ noise
28 duckdb:vortex-compact -1.0% -0.4% -0.6% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.3% -0.4% +0.1% +16.6% ➖ noise
29 datafusion:vortex-compact +2.8% +1.6% +1.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +2.1% +1.6% +0.5% +10.0% ➖ noise
29 duckdb:duckdb -10.6% +1.6% -12.0% +10.0% ✅ faster
29 duckdb:vortex-compact -2.4% +1.6% -3.9% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -6.4% +1.6% -7.9% +11.1% ➖ noise
30 datafusion:vortex-compact -4.3% +1.1% -5.3% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -7.2% +1.1% -8.1% +10.0% ➖ noise
30 duckdb:duckdb -12.7% +1.1% -13.6% +10.0% ✅ faster
30 duckdb:vortex-compact +3.9% +1.1% +2.8% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +3.1% +1.1% +2.0% +10.0% ➖ noise
31 datafusion:vortex-compact +0.3% -1.2% +1.5% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -2.4% -1.2% -1.2% +10.0% ➖ noise
31 duckdb:duckdb -18.7% -1.2% -17.7% +10.0% ✅ faster
31 duckdb:vortex-compact +2.5% -1.2% +3.8% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +2.2% -1.2% +3.5% +10.2% ➖ noise
32 datafusion:vortex-compact -0.1% +6.6% -6.3% +12.5% ➖ noise
32 datafusion:vortex-file-compressed -6.2% +6.6% -11.9% +14.5% ➖ noise
32 duckdb:duckdb -18.6% +6.6% -23.6% +17.6% ✅ faster
32 duckdb:vortex-compact -1.4% +6.6% -7.4% +13.1% ➖ noise
32 duckdb:vortex-file-compressed -5.5% +6.6% -11.3% +17.3% ➖ noise
33 datafusion:vortex-compact +1.7% +1.9% -0.2% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +1.8% +1.9% -0.1% +10.0% ➖ noise
33 duckdb:duckdb -16.0% +1.9% -17.6% +10.0% ✅ faster
33 duckdb:vortex-compact +0.5% +1.9% -1.4% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +5.0% +1.9% +3.1% +13.6% ➖ noise
34 datafusion:vortex-compact +4.4% -1.0% +5.5% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -5.1% -1.0% -4.1% +10.0% ➖ noise
34 duckdb:duckdb -15.1% -1.0% -14.2% +10.1% ✅ faster
34 duckdb:vortex-compact +0.1% -1.0% +1.2% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -1.5% -1.0% -0.5% +10.3% ➖ noise
35 datafusion:vortex-compact -4.7% +2.0% -6.6% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -3.1% +2.0% -5.0% +10.0% ➖ noise
35 duckdb:duckdb -17.7% +2.0% -19.4% +11.2% ✅ faster
35 duckdb:vortex-compact +0.5% +2.0% -1.5% +11.2% ➖ noise
35 duckdb:vortex-file-compressed +2.5% +2.0% +0.4% +10.0% ➖ noise
36 datafusion:vortex-compact +4.6% -2.5% +7.3% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -3.9% -2.5% -1.5% +10.0% ➖ noise
36 duckdb:duckdb -13.8% -2.5% -11.6% +10.0% ✅ faster
36 duckdb:vortex-compact -0.0% -2.5% +2.5% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +2.6% -2.5% +5.2% +12.4% ➖ noise
37 datafusion:vortex-compact -0.5% +3.3% -3.6% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -8.2% +3.3% -11.1% +10.0% ✅ faster
37 duckdb:duckdb -17.7% +3.3% -20.3% +18.0% ✅ faster
37 duckdb:vortex-compact -2.8% +3.3% -5.8% +10.8% ➖ noise
37 duckdb:vortex-file-compressed -1.3% +3.3% -4.5% +17.4% ➖ noise
38 datafusion:vortex-compact +1.5% +2.6% -1.1% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -1.2% +2.6% -3.7% +10.0% ➖ noise
38 duckdb:duckdb -13.8% +2.6% -16.0% +10.0% ✅ faster
38 duckdb:vortex-compact -1.9% +2.6% -4.4% +14.8% ➖ noise
38 duckdb:vortex-file-compressed -1.3% +2.6% -3.8% +14.6% ➖ noise
39 datafusion:vortex-compact +17.6% +0.9% +16.5% +21.0% ➖ noise
39 datafusion:vortex-file-compressed -6.6% +0.9% -7.5% +24.4% ➖ noise
39 duckdb:duckdb -8.6% +0.9% -9.4% +20.4% ➖ noise
39 duckdb:vortex-compact +0.8% +0.9% -0.1% +16.1% ➖ noise
39 duckdb:vortex-file-compressed +4.4% +0.9% +3.5% +24.7% ➖ noise
40 datafusion:vortex-compact +1.8% -0.8% +2.6% +12.1% ➖ noise
40 datafusion:vortex-file-compressed -10.9% -0.8% -10.1% +12.7% ➖ noise
40 duckdb:duckdb -19.1% -0.8% -18.5% +17.4% ✅ faster
40 duckdb:vortex-compact +1.0% -0.8% +1.8% +15.2% ➖ noise
40 duckdb:vortex-file-compressed -7.6% -0.8% -6.9% +10.7% ➖ noise
41 datafusion:vortex-compact -7.9% -2.7% -5.3% +13.4% ➖ noise
41 datafusion:vortex-file-compressed -18.4% -2.7% -16.1% +15.8% ✅ faster
41 duckdb:duckdb -17.2% -2.7% -14.8% +10.2% ✅ faster
41 duckdb:vortex-compact -2.6% -2.7% +0.1% +10.3% ➖ noise
41 duckdb:vortex-file-compressed -2.6% -2.7% +0.1% +11.8% ➖ noise
42 datafusion:vortex-compact -1.0% +1.8% -2.8% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -3.6% +1.8% -5.4% +12.0% ➖ noise
42 duckdb:duckdb -14.6% +1.8% -16.2% +17.9% ✅ faster
42 duckdb:vortex-compact -0.1% +1.8% -2.0% +16.6% ➖ noise
42 duckdb:vortex-file-compressed +1.3% +1.8% -0.6% +15.2% ➖ noise
43 datafusion:vortex-compact -7.2% +0.1% -7.3% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +1.5% +0.1% +1.4% +10.2% ➖ noise
43 duckdb:duckdb -11.8% +0.1% -11.9% +10.7% ✅ faster
43 duckdb:vortex-compact -0.7% +0.1% -0.8% +10.0% ➖ noise
43 duckdb:vortex-file-compressed -2.8% +0.1% -2.9% +10.0% ➖ noise
44 datafusion:vortex-compact -8.9% -1.7% -7.3% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -3.0% -1.7% -1.3% +10.0% ➖ noise
44 duckdb:duckdb -12.8% -1.7% -11.3% +15.0% ➖ noise
44 duckdb:vortex-compact -5.4% -1.7% -3.7% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -1.0% -1.7% +0.8% +10.0% ➖ noise
45 datafusion:vortex-compact -2.6% -3.9% +1.4% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -9.3% -3.9% -5.5% +10.0% ➖ noise
45 duckdb:duckdb -18.0% -3.9% -14.6% +10.4% ✅ faster
45 duckdb:vortex-compact +1.9% -3.9% +6.1% +10.0% ➖ noise
45 duckdb:vortex-file-compressed -2.6% -3.9% +1.4% +10.0% ➖ noise
46 datafusion:vortex-compact +3.4% -0.2% +3.6% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -3.2% -0.2% -3.1% +10.0% ➖ noise
46 duckdb:duckdb -14.7% -0.2% -14.5% +10.0% ✅ faster
46 duckdb:vortex-compact -3.5% -0.2% -3.4% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -0.8% -0.2% -0.6% +10.0% ➖ noise
47 datafusion:vortex-compact +2.5% -1.7% +4.3% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +0.7% -1.7% +2.5% +10.0% ➖ noise
47 duckdb:duckdb -12.9% -1.7% -11.4% +10.8% ✅ faster
47 duckdb:vortex-compact -4.6% -1.7% -2.9% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +1.7% -1.7% +3.5% +10.6% ➖ noise
48 datafusion:vortex-compact -1.0% +0.2% -1.2% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -2.1% +0.2% -2.3% +10.0% ➖ noise
48 duckdb:duckdb -14.6% +0.2% -14.8% +10.0% ✅ faster
48 duckdb:vortex-compact -0.6% +0.2% -0.8% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -1.8% +0.2% -2.0% +10.0% ➖ noise
49 datafusion:vortex-compact -2.9% -3.0% +0.1% +12.7% ➖ noise
49 datafusion:vortex-file-compressed -3.6% -3.0% -0.7% +14.1% ➖ noise
49 duckdb:duckdb -10.0% -3.0% -7.3% +13.8% ➖ noise
49 duckdb:vortex-compact -4.0% -3.0% -1.0% +10.3% ➖ noise
49 duckdb:vortex-file-compressed +5.4% -3.0% +8.7% +13.4% ➖ noise
50 datafusion:vortex-compact +3.9% +1.0% +2.8% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -3.0% +1.0% -4.0% +10.0% ➖ noise
50 duckdb:duckdb -14.3% +1.0% -15.2% +10.0% ✅ faster
50 duckdb:vortex-compact +5.2% +1.0% +4.2% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +7.0% +1.0% +5.9% +10.0% ➖ noise
51 datafusion:vortex-compact +0.7% +4.4% -3.6% +10.0% ➖ noise
51 datafusion:vortex-file-compressed +4.2% +4.4% -0.3% +10.0% ➖ noise
51 duckdb:duckdb -21.9% +4.4% -25.2% +16.9% ✅ faster
51 duckdb:vortex-compact -18.4% +4.4% -21.9% +18.7% ✅ faster
51 duckdb:vortex-file-compressed +0.8% +4.4% -3.5% +21.7% ➖ noise
52 datafusion:vortex-compact +1.2% +0.0% +1.2% +11.2% ➖ noise
52 datafusion:vortex-file-compressed -8.6% +0.0% -8.6% +10.6% ➖ noise
52 duckdb:duckdb -8.2% +0.0% -8.2% +13.8% ➖ noise
52 duckdb:vortex-compact +0.2% +0.0% +0.2% +16.4% ➖ noise
52 duckdb:vortex-file-compressed -5.8% +0.0% -5.8% +17.9% ➖ noise
53 datafusion:vortex-compact -4.5% +1.3% -5.8% +11.7% ➖ noise
53 datafusion:vortex-file-compressed -1.2% +1.3% -2.5% +10.0% ➖ noise
53 duckdb:duckdb -11.5% +1.3% -12.7% +10.0% ✅ faster
53 duckdb:vortex-compact -3.6% +1.3% -4.8% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -0.5% +1.3% -1.8% +10.0% ➖ noise
54 datafusion:vortex-compact -1.7% -1.6% -0.2% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -3.3% -1.6% -1.8% +10.0% ➖ noise
54 duckdb:duckdb -10.0% -1.6% -8.6% +13.3% ➖ noise
54 duckdb:vortex-compact -4.7% -1.6% -3.2% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +1.4% -1.6% +3.0% +10.6% ➖ noise
55 datafusion:vortex-compact +3.2% +2.4% +0.7% +13.0% ➖ noise
55 datafusion:vortex-file-compressed -2.2% +2.4% -4.5% +12.8% ➖ noise
55 duckdb:duckdb -15.8% +2.4% -17.8% +14.5% ✅ faster
55 duckdb:vortex-compact -0.1% +2.4% -2.4% +15.1% ➖ noise
55 duckdb:vortex-file-compressed -3.1% +2.4% -5.4% +14.6% ➖ noise
56 datafusion:vortex-compact -1.3% +0.7% -2.0% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -3.8% +0.7% -4.5% +10.0% ➖ noise
56 duckdb:duckdb -15.4% +0.7% -16.0% +10.0% ✅ faster
56 duckdb:vortex-compact -1.5% +0.7% -2.2% +10.0% ➖ noise
56 duckdb:vortex-file-compressed +6.8% +0.7% +6.0% +10.0% ➖ noise
57 datafusion:vortex-compact +4.2% -0.1% +4.3% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -2.0% -0.1% -2.0% +10.0% ➖ noise
57 duckdb:duckdb -12.7% -0.1% -12.7% +12.7% ✅ faster
57 duckdb:vortex-compact -0.0% -0.1% +0.1% +15.2% ➖ noise
57 duckdb:vortex-file-compressed +1.2% -0.1% +1.2% +18.8% ➖ noise
58 datafusion:vortex-compact -0.6% +1.0% -1.7% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -3.0% +1.0% -4.0% +10.0% ➖ noise
58 duckdb:duckdb -6.3% +1.0% -7.3% +15.7% ➖ noise
58 duckdb:vortex-compact +14.9% +1.0% +13.7% +14.7% ➖ noise
58 duckdb:vortex-file-compressed +10.9% +1.0% +9.8% +15.7% ➖ noise
59 datafusion:vortex-compact -2.6% +2.9% -5.4% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +1.1% +2.9% -1.8% +10.0% ➖ noise
59 duckdb:duckdb -8.8% +2.9% -11.4% +10.0% ✅ faster
59 duckdb:vortex-compact -2.0% +2.9% -4.8% +10.0% ➖ noise
59 duckdb:vortex-file-compressed +5.9% +2.9% +2.9% +10.0% ➖ noise
60 datafusion:vortex-compact +5.7% +2.2% +3.4% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +2.0% +2.2% -0.2% +10.0% ➖ noise
60 duckdb:duckdb -12.3% +2.2% -14.2% +11.9% ✅ faster
60 duckdb:vortex-compact -1.7% +2.2% -3.8% +10.0% ➖ noise
60 duckdb:vortex-file-compressed -0.2% +2.2% -2.4% +12.8% ➖ noise
61 datafusion:vortex-compact +3.1% +0.5% +2.6% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +0.3% +0.5% -0.2% +10.0% ➖ noise
61 duckdb:duckdb -13.6% +0.5% -14.0% +10.0% ✅ faster
61 duckdb:vortex-compact -3.5% +0.5% -4.0% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -7.8% +0.5% -8.3% +15.2% ➖ noise
62 datafusion:vortex-compact +1.7% +3.8% -2.1% +11.1% ➖ noise
62 datafusion:vortex-file-compressed -4.9% +3.8% -8.4% +13.1% ➖ noise
62 duckdb:duckdb -11.1% +3.8% -14.4% +17.1% ➖ noise
62 duckdb:vortex-compact -2.2% +3.8% -5.8% +16.6% ➖ noise
62 duckdb:vortex-file-compressed -15.2% +3.8% -18.3% +27.0% ➖ noise
63 datafusion:vortex-compact +1.6% +0.8% +0.8% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +1.3% +0.8% +0.5% +10.0% ➖ noise
63 duckdb:duckdb -8.6% +0.8% -9.4% +10.5% ➖ noise
63 duckdb:vortex-compact -1.6% +0.8% -2.4% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -2.8% +0.8% -3.5% +10.0% ➖ noise
64 datafusion:vortex-compact +1.5% -0.1% +1.6% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +0.7% -0.1% +0.8% +10.0% ➖ noise
64 duckdb:duckdb -12.5% -0.1% -12.4% +10.4% ✅ faster
64 duckdb:vortex-compact +0.2% -0.1% +0.4% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -0.3% -0.1% -0.2% +10.0% ➖ noise
65 datafusion:vortex-compact -0.7% +0.2% -0.8% +10.4% ➖ noise
65 datafusion:vortex-file-compressed -0.1% +0.2% -0.3% +10.3% ➖ noise
65 duckdb:duckdb -19.6% +0.2% -19.7% +14.8% ✅ faster
65 duckdb:vortex-compact -2.5% +0.2% -2.6% +11.2% ➖ noise
65 duckdb:vortex-file-compressed -1.9% +0.2% -2.1% +11.0% ➖ noise
66 datafusion:vortex-compact -1.8% +3.7% -5.3% +12.3% ➖ noise
66 datafusion:vortex-file-compressed -0.4% +3.7% -3.9% +12.5% ➖ noise
66 duckdb:duckdb -14.5% +3.7% -17.5% +12.9% ✅ faster
66 duckdb:vortex-compact -4.4% +3.7% -7.8% +16.7% ➖ noise
66 duckdb:vortex-file-compressed -1.7% +3.7% -5.2% +20.2% ➖ noise
67 datafusion:vortex-compact -1.3% -0.1% -1.2% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -5.8% -0.1% -5.7% +10.0% ➖ noise
67 duckdb:duckdb -14.1% -0.1% -14.0% +10.0% ✅ faster
67 duckdb:vortex-compact -2.9% -0.1% -2.8% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +0.6% -0.1% +0.7% +10.0% ➖ noise
68 datafusion:vortex-compact +3.2% +0.7% +2.4% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -14.8% +0.7% -15.4% +10.0% ✅ faster
68 duckdb:duckdb -12.7% +0.7% -13.3% +10.0% ✅ faster
68 duckdb:vortex-compact -3.9% +0.7% -4.6% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +0.3% +0.7% -0.5% +10.0% ➖ noise
69 datafusion:vortex-compact +2.1% +1.9% +0.2% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -7.0% +1.9% -8.7% +10.0% ➖ noise
69 duckdb:duckdb -5.0% +1.9% -6.8% +19.7% ➖ noise
69 duckdb:vortex-compact +4.4% +1.9% +2.5% +10.3% ➖ noise
69 duckdb:vortex-file-compressed -2.9% +1.9% -4.7% +10.0% ➖ noise
70 datafusion:vortex-compact -2.0% -1.0% -1.0% +10.2% ➖ noise
70 datafusion:vortex-file-compressed +0.2% -1.0% +1.2% +11.6% ➖ noise
70 duckdb:duckdb -10.4% -1.0% -9.5% +11.1% ➖ noise
70 duckdb:vortex-compact -2.2% -1.0% -1.2% +10.1% ➖ noise
70 duckdb:vortex-file-compressed +0.8% -1.0% +1.8% +10.0% ➖ noise
71 datafusion:vortex-compact +4.6% +5.7% -1.0% +10.0% ➖ noise
71 datafusion:vortex-file-compressed -0.5% +5.7% -5.8% +10.0% ➖ noise
71 duckdb:duckdb -6.2% +5.7% -11.2% +14.9% ➖ noise
71 duckdb:vortex-compact -0.4% +5.7% -5.7% +10.0% ➖ noise
71 duckdb:vortex-file-compressed -2.1% +5.7% -7.3% +12.0% ➖ noise
72 datafusion:vortex-compact -0.6% +1.3% -1.9% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +4.3% +1.3% +3.0% +10.0% ➖ noise
72 duckdb:duckdb -9.4% +1.3% -10.5% +12.8% ➖ noise
72 duckdb:vortex-compact -1.0% +1.3% -2.3% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +0.5% +1.3% -0.8% +10.0% ➖ noise
73 datafusion:vortex-compact -0.8% -3.6% +2.9% +20.0% ➖ noise
73 datafusion:vortex-file-compressed -3.0% -3.6% +0.6% +24.5% ➖ noise
73 duckdb:duckdb -12.1% -3.6% -8.8% +12.2% ➖ noise
73 duckdb:vortex-compact -3.7% -3.6% -0.1% +10.0% ➖ noise
73 duckdb:vortex-file-compressed -5.3% -3.6% -1.8% +10.0% ➖ noise
74 datafusion:vortex-compact -1.4% +5.3% -6.3% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +3.3% +5.3% -1.8% +10.0% ➖ noise
74 duckdb:duckdb -6.2% +5.3% -10.9% +10.0% ✅ faster
74 duckdb:vortex-compact -9.9% +5.3% -14.4% +10.0% ✅ faster
74 duckdb:vortex-file-compressed +4.2% +5.3% -1.0% +11.1% ➖ noise
75 datafusion:vortex-compact -5.0% +1.4% -6.3% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -1.4% +1.4% -2.7% +10.0% ➖ noise
75 duckdb:duckdb -9.1% +1.4% -10.3% +14.9% ➖ noise
75 duckdb:vortex-compact -6.5% +1.4% -7.7% +14.9% ➖ noise
75 duckdb:vortex-file-compressed -1.8% +1.4% -3.1% +10.0% ➖ noise
76 datafusion:vortex-compact +1.8% +0.7% +1.1% +10.0% ➖ noise
76 datafusion:vortex-file-compressed +2.6% +0.7% +1.9% +10.0% ➖ noise
76 duckdb:duckdb -2.0% +0.7% -2.7% +13.2% ➖ noise
76 duckdb:vortex-compact -2.1% +0.7% -2.7% +10.0% ➖ noise
76 duckdb:vortex-file-compressed +1.4% +0.7% +0.8% +24.7% ➖ noise
77 datafusion:vortex-compact +0.8% +0.7% +0.1% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -3.5% +0.7% -4.1% +10.0% ➖ noise
77 duckdb:duckdb -1.6% +0.7% -2.3% +12.2% ➖ noise
77 duckdb:vortex-compact -9.7% +0.7% -10.3% +10.0% ✅ faster
77 duckdb:vortex-file-compressed +1.3% +0.7% +0.6% +10.1% ➖ noise
78 datafusion:vortex-compact -1.4% -1.5% +0.1% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -0.1% -1.5% +1.4% +10.0% ➖ noise
78 duckdb:duckdb -5.9% -1.5% -4.4% +10.3% ➖ noise
78 duckdb:vortex-compact -15.2% -1.5% -13.8% +10.0% ✅ faster
78 duckdb:vortex-file-compressed +3.8% -1.5% +5.4% +14.0% ➖ noise
79 datafusion:vortex-compact -1.4% +2.6% -3.9% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +0.2% +2.6% -2.3% +10.0% ➖ noise
79 duckdb:duckdb -10.4% +2.6% -12.6% +10.0% ✅ faster
79 duckdb:vortex-compact -0.3% +2.6% -2.8% +10.1% ➖ noise
79 duckdb:vortex-file-compressed +7.4% +2.6% +4.7% +11.5% ➖ noise
80 datafusion:vortex-compact -0.7% -1.4% +0.7% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +1.0% -1.4% +2.5% +10.0% ➖ noise
80 duckdb:duckdb -14.2% -1.4% -13.0% +16.3% ➖ noise
80 duckdb:vortex-compact -14.8% -1.4% -13.6% +10.0% ✅ faster
80 duckdb:vortex-file-compressed +0.9% -1.4% +2.4% +10.0% ➖ noise
81 datafusion:vortex-compact +0.9% -1.8% +2.7% +11.5% ➖ noise
81 datafusion:vortex-file-compressed -7.9% -1.8% -6.2% +12.6% ➖ noise
81 duckdb:duckdb -6.6% -1.8% -4.9% +10.6% ➖ noise
81 duckdb:vortex-compact -17.0% -1.8% -15.5% +10.0% ✅ faster
81 duckdb:vortex-file-compressed +1.1% -1.8% +2.9% +14.3% ➖ noise
82 datafusion:vortex-compact -4.0% +1.0% -4.9% +13.7% ➖ noise
82 datafusion:vortex-file-compressed -7.7% +1.0% -8.6% +10.0% ➖ noise
82 duckdb:duckdb -7.4% +1.0% -8.3% +14.6% ➖ noise
82 duckdb:vortex-compact -17.0% +1.0% -17.8% +16.0% ✅ faster
82 duckdb:vortex-file-compressed -2.1% +1.0% -3.1% +13.5% ➖ noise
83 datafusion:vortex-compact -2.7% +3.2% -5.7% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -6.1% +3.2% -8.9% +10.0% ➖ noise
83 duckdb:duckdb -10.3% +3.2% -13.0% +13.0% ✅ faster
83 duckdb:vortex-compact -15.2% +3.2% -17.8% +10.0% ✅ faster
83 duckdb:vortex-file-compressed -4.3% +3.2% -7.2% +10.0% ➖ noise
84 datafusion:vortex-compact -6.3% -1.2% -5.2% +15.0% ➖ noise
84 datafusion:vortex-file-compressed -14.9% -1.2% -13.9% +10.0% ✅ faster
84 duckdb:duckdb -11.8% -1.2% -10.7% +10.0% ✅ faster
84 duckdb:vortex-compact -15.2% -1.2% -14.2% +10.0% ✅ faster
84 duckdb:vortex-file-compressed +0.9% -1.2% +2.1% +10.0% ➖ noise
85 datafusion:vortex-compact -1.2% +3.9% -4.9% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -4.4% +3.9% -8.0% +10.0% ➖ noise
85 duckdb:duckdb -16.9% +3.9% -20.1% +10.0% ✅ faster
85 duckdb:vortex-compact -18.6% +3.9% -21.7% +10.0% ✅ faster
85 duckdb:vortex-file-compressed -0.3% +3.9% -4.1% +10.0% ➖ noise
86 datafusion:vortex-compact +2.3% +2.5% -0.1% +12.0% ➖ noise
86 datafusion:vortex-file-compressed -8.9% +2.5% -11.1% +11.8% ✅ faster
86 duckdb:duckdb -9.9% +2.5% -12.1% +12.5% ✅ faster
86 duckdb:vortex-compact -19.5% +2.5% -21.4% +16.4% ✅ faster
86 duckdb:vortex-file-compressed +2.1% +2.5% -0.4% +15.8% ➖ noise
87 datafusion:vortex-compact -0.4% +0.1% -0.5% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -2.0% +0.1% -2.0% +10.0% ➖ noise
87 duckdb:duckdb -5.8% +0.1% -5.9% +13.0% ➖ noise
87 duckdb:vortex-compact -12.2% +0.1% -12.3% +11.4% ✅ faster
87 duckdb:vortex-file-compressed +3.9% +0.1% +3.8% +14.7% ➖ noise
88 datafusion:vortex-compact +1.3% +0.3% +1.1% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -4.7% +0.3% -4.9% +10.0% ➖ noise
88 duckdb:duckdb -3.6% +0.3% -3.8% +10.0% ➖ noise
88 duckdb:vortex-compact -9.6% +0.3% -9.9% +15.6% ➖ noise
88 duckdb:vortex-file-compressed -1.0% +0.3% -1.3% +10.0% ➖ noise
89 datafusion:vortex-compact +0.9% +3.0% -2.1% +10.0% ➖ noise
89 datafusion:vortex-file-compressed -3.8% +3.0% -6.6% +10.0% ➖ noise
89 duckdb:duckdb -9.6% +3.0% -12.2% +10.6% ✅ faster
89 duckdb:vortex-compact -16.4% +3.0% -18.8% +13.0% ✅ faster
89 duckdb:vortex-file-compressed -5.1% +3.0% -7.9% +10.8% ➖ noise
90 datafusion:vortex-compact +0.7% -0.8% +1.5% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -2.9% -0.8% -2.2% +10.2% ➖ noise
90 duckdb:duckdb -14.8% -0.8% -14.1% +11.1% ✅ faster
90 duckdb:vortex-compact -11.4% -0.8% -10.7% +10.0% ✅ faster
90 duckdb:vortex-file-compressed +1.7% -0.8% +2.5% +10.0% ➖ noise
91 datafusion:vortex-compact +0.6% +2.6% -2.0% +11.4% ➖ noise
91 datafusion:vortex-file-compressed -17.1% +2.6% -19.2% +10.0% ✅ faster
91 duckdb:duckdb -12.9% +2.6% -15.1% +12.5% ✅ faster
91 duckdb:vortex-compact -14.6% +2.6% -16.7% +10.0% ✅ faster
91 duckdb:vortex-file-compressed +3.7% +2.6% +1.1% +10.0% ➖ noise
92 datafusion:vortex-compact -3.9% +0.7% -4.6% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -13.0% +0.7% -13.6% +10.0% ✅ faster
92 duckdb:duckdb -6.2% +0.7% -6.9% +18.0% ➖ noise
92 duckdb:vortex-compact -15.8% +0.7% -16.4% +13.2% ✅ faster
92 duckdb:vortex-file-compressed -4.7% +0.7% -5.3% +11.4% ➖ noise
93 datafusion:vortex-compact -4.2% +0.7% -4.8% +13.5% ➖ noise
93 datafusion:vortex-file-compressed -9.2% +0.7% -9.8% +13.3% ➖ noise
93 duckdb:duckdb -12.5% +0.7% -13.1% +11.8% ✅ faster
93 duckdb:vortex-compact -16.4% +0.7% -17.0% +11.0% ✅ faster
93 duckdb:vortex-file-compressed +1.8% +0.7% +1.1% +16.0% ➖ noise
94 datafusion:vortex-compact -0.2% +2.3% -2.4% +10.0% ➖ noise
94 datafusion:vortex-file-compressed -9.3% +2.3% -11.3% +10.0% ✅ faster
94 duckdb:duckdb -4.7% +2.3% -6.8% +12.8% ➖ noise
94 duckdb:vortex-compact -18.5% +2.3% -20.3% +15.1% ✅ faster
94 duckdb:vortex-file-compressed -2.6% +2.3% -4.8% +10.0% ➖ noise
95 datafusion:vortex-compact -0.6% -3.7% +3.2% +10.0% ➖ noise
95 datafusion:vortex-file-compressed -3.3% -3.7% +0.4% +12.0% ➖ noise
95 duckdb:duckdb +7.3% -3.7% +11.4% +22.9% ➖ noise
95 duckdb:vortex-compact -3.9% -3.7% -0.2% +16.7% ➖ noise
95 duckdb:vortex-file-compressed +0.5% -3.7% +4.3% +24.7% ➖ noise
96 datafusion:vortex-compact +1.1% -1.3% +2.4% +12.9% ➖ noise
96 datafusion:vortex-file-compressed -9.8% -1.3% -8.7% +14.4% ➖ noise
96 duckdb:duckdb -10.6% -1.3% -9.5% +17.4% ➖ noise
96 duckdb:vortex-compact -28.8% -1.3% -27.9% +27.6% ✅ faster
96 duckdb:vortex-file-compressed -6.7% -1.3% -5.4% +18.5% ➖ noise
97 datafusion:vortex-compact +1.2% -4.5% +5.9% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -9.4% -4.5% -5.1% +10.1% ➖ noise
97 duckdb:duckdb -11.1% -4.5% -7.0% +11.2% ➖ noise
97 duckdb:vortex-compact -11.2% -4.5% -7.1% +10.0% ➖ noise
97 duckdb:vortex-file-compressed +1.2% -4.5% +5.9% +12.6% ➖ noise
98 datafusion:vortex-compact +0.3% +1.4% -1.0% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -7.3% +1.4% -8.5% +10.0% ➖ noise
98 duckdb:duckdb -7.7% +1.4% -8.9% +13.5% ➖ noise
98 duckdb:vortex-compact -13.6% +1.4% -14.7% +11.5% ✅ faster
98 duckdb:vortex-file-compressed -6.3% +1.4% -7.5% +14.2% ➖ noise
99 datafusion:vortex-compact +2.2% -1.0% +3.2% +10.0% ➖ noise
99 datafusion:vortex-file-compressed -0.2% -1.0% +0.8% +10.0% ➖ noise
99 duckdb:duckdb -2.7% -1.0% -1.7% +36.0% ➖ noise
99 duckdb:vortex-compact -8.3% -1.0% -7.4% +20.1% ➖ noise
99 duckdb:vortex-file-compressed +7.2% -1.0% +8.2% +11.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 1.007x ➖
Parquet (geomean): 1.007x ➖
Shifts: Parquet (control) +0.7% · Median polish +0.6%


datafusion / vortex-file-compressed (1.000x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 419372315 427225712 0.98
tpch_q02/datafusion:vortex-file-compressed 157174606 154744444 1.02
tpch_q03/datafusion:vortex-file-compressed 258285323 245492654 1.05
tpch_q04/datafusion:vortex-file-compressed 106337869 106918682 0.99
tpch_q05/datafusion:vortex-file-compressed 457448929 454683138 1.01
tpch_q06/datafusion:vortex-file-compressed 38745329 40511419 0.96
tpch_q07/datafusion:vortex-file-compressed 658376426 644377733 1.02
tpch_q08/datafusion:vortex-file-compressed 467275211 457825853 1.02
tpch_q09/datafusion:vortex-file-compressed 795477026 796633662 1.00
tpch_q10/datafusion:vortex-file-compressed 292776058 289625649 1.01
tpch_q11/datafusion:vortex-file-compressed 114397114 114953514 1.00
tpch_q12/datafusion:vortex-file-compressed 122433240 122073600 1.00
tpch_q13/datafusion:vortex-file-compressed 226313830 223593719 1.01
tpch_q14/datafusion:vortex-file-compressed 70777099 74853403 0.95
tpch_q15/datafusion:vortex-file-compressed 106844366 106027916 1.01
tpch_q16/datafusion:vortex-file-compressed 93134312 95611120 0.97
tpch_q17/datafusion:vortex-file-compressed 739902358 732069313 1.01
tpch_q18/datafusion:vortex-file-compressed 965564495 961158091 1.00
tpch_q19/datafusion:vortex-file-compressed 130305995 128257869 1.02
tpch_q20/datafusion:vortex-file-compressed 195902953 198608452 0.99
tpch_q21/datafusion:vortex-file-compressed 779938851 759679076 1.03
tpch_q22/datafusion:vortex-file-compressed 58805891 60343252 0.97
datafusion / vortex-compact (0.999x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 480273185 478731751 1.00
tpch_q02/datafusion:vortex-compact 162112479 159815638 1.01
tpch_q03/datafusion:vortex-compact 271253916 257656325 1.05
tpch_q04/datafusion:vortex-compact 125327533 126740872 0.99
tpch_q05/datafusion:vortex-compact 475072117 461794443 1.03
tpch_q06/datafusion:vortex-compact 61611470 62904299 0.98
tpch_q07/datafusion:vortex-compact 680153328 674238334 1.01
tpch_q08/datafusion:vortex-compact 474284421 473798917 1.00
tpch_q09/datafusion:vortex-compact 813016772 818457969 0.99
tpch_q10/datafusion:vortex-compact 320472763 323978879 0.99
tpch_q11/datafusion:vortex-compact 118547023 121426494 0.98
tpch_q12/datafusion:vortex-compact 173931603 184071242 0.94
tpch_q13/datafusion:vortex-compact 270005202 275907204 0.98
tpch_q14/datafusion:vortex-compact 88314211 90027176 0.98
tpch_q15/datafusion:vortex-compact 164058271 164460113 1.00
tpch_q16/datafusion:vortex-compact 98408243 99175343 0.99
tpch_q17/datafusion:vortex-compact 751617323 734188351 1.02
tpch_q18/datafusion:vortex-compact 988450739 975660508 1.01
tpch_q19/datafusion:vortex-compact 230463921 229497046 1.00
tpch_q20/datafusion:vortex-compact 229504373 228140138 1.01
tpch_q21/datafusion:vortex-compact 802818624 795427825 1.01
tpch_q22/datafusion:vortex-compact 70559321 70373534 1.00
datafusion / parquet (1.013x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 485253508 490127750 0.99
tpch_q02/datafusion:parquet 259460238 256897907 1.01
tpch_q03/datafusion:parquet 394801765 384058112 1.03
tpch_q04/datafusion:parquet 150092333 148884523 1.01
tpch_q05/datafusion:parquet 578994611 565793392 1.02
tpch_q06/datafusion:parquet 138020008 133847080 1.03
tpch_q07/datafusion:parquet 795357181 784346155 1.01
tpch_q08/datafusion:parquet 649185256 635858672 1.02
tpch_q09/datafusion:parquet 965327800 960401398 1.01
tpch_q10/datafusion:parquet 597210769 595932135 1.00
tpch_q11/datafusion:parquet 196693989 189602788 1.04
tpch_q12/datafusion:parquet 257372718 261540721 0.98
tpch_q13/datafusion:parquet 346433332 337169080 1.03
tpch_q14/datafusion:parquet 204256996 198895687 1.03
tpch_q15/datafusion:parquet 265310459 265483595 1.00
tpch_q16/datafusion:parquet 184436096 176729932 1.04
tpch_q17/datafusion:parquet 836769548 829293658 1.01
tpch_q18/datafusion:parquet 1033007865 1027056314 1.01
tpch_q19/datafusion:parquet 342418384 335491452 1.02
tpch_q20/datafusion:parquet 369230927 371025641 1.00
tpch_q21/datafusion:parquet 901313739 887872908 1.02
tpch_q22/datafusion:parquet 220383515 223537048 0.99
datafusion / arrow (1.003x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 716038553 732401320 0.98
tpch_q02/datafusion:arrow 201974538 196155823 1.03
tpch_q03/datafusion:arrow 549196397 544906189 1.01
tpch_q04/datafusion:arrow 401074912 398556517 1.01
tpch_q05/datafusion:arrow 1066219869 1051576130 1.01
tpch_q06/datafusion:arrow 320582331 318014129 1.01
tpch_q07/datafusion:arrow 1368760965 1359419326 1.01
tpch_q08/datafusion:arrow 1285168052 1275662934 1.01
tpch_q09/datafusion:arrow 1551561634 1533898749 1.01
tpch_q10/datafusion:arrow 676655641 691505869 0.98
tpch_q11/datafusion:arrow 180716773 174905299 1.03
tpch_q12/datafusion:arrow 730373976 718929571 1.02
tpch_q13/datafusion:arrow 526970372 517000684 1.02
tpch_q14/datafusion:arrow 351762053 358722258 0.98
tpch_q15/datafusion:arrow 748404596 754729896 0.99
tpch_q16/datafusion:arrow 123823781 120627475 1.03
tpch_q17/datafusion:arrow 1569310212 1539294712 1.02
tpch_q18/datafusion:arrow 2091775289 2111345800 0.99
tpch_q19/datafusion:arrow 578409250 582149253 0.99
tpch_q20/datafusion:arrow 551479779 557699473 0.99
tpch_q21/datafusion:arrow 3882756502 4151049384 0.94
tpch_q22/datafusion:arrow 180716032 177176554 1.02
duckdb / vortex-file-compressed (1.023x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 181087198 175578189 1.03
tpch_q02/duckdb:vortex-file-compressed 53793592 52974313 1.02
tpch_q03/duckdb:vortex-file-compressed 131117843 130274121 1.01
tpch_q04/duckdb:vortex-file-compressed 153550768 149522081 1.03
tpch_q05/duckdb:vortex-file-compressed 130046033 130390534 1.00
tpch_q06/duckdb:vortex-file-compressed 53475695 49784214 1.07
tpch_q07/duckdb:vortex-file-compressed 152116841 147642492 1.03
tpch_q08/duckdb:vortex-file-compressed 177996957 173377844 1.03
tpch_q09/duckdb:vortex-file-compressed 335931850 335610602 1.00
tpch_q10/duckdb:vortex-file-compressed 170614975 157165510 1.09
tpch_q11/duckdb:vortex-file-compressed 37646635 35555123 1.06
tpch_q12/duckdb:vortex-file-compressed 96444064 93895437 1.03
tpch_q13/duckdb:vortex-file-compressed 250218748 248799421 1.01
tpch_q14/duckdb:vortex-file-compressed 74745679 70656534 1.06
tpch_q15/duckdb:vortex-file-compressed 98966110 98296549 1.01
tpch_q16/duckdb:vortex-file-compressed 79190515 78916648 1.00
tpch_q17/duckdb:vortex-file-compressed 102217508 100991471 1.01
tpch_q18/duckdb:vortex-file-compressed 271045550 282623431 0.96
tpch_q19/duckdb:vortex-file-compressed 91985588 91652237 1.00
tpch_q20/duckdb:vortex-file-compressed 165818805 164380193 1.01
tpch_q21/duckdb:vortex-file-compressed 560206984 565077246 0.99
tpch_q22/duckdb:vortex-file-compressed 82410019 76196666 1.08
duckdb / vortex-compact (1.007x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 229250634 230127856 1.00
tpch_q02/duckdb:vortex-compact 59660600 58811157 1.01
tpch_q03/duckdb:vortex-compact 145066361 140777260 1.03
tpch_q04/duckdb:vortex-compact 180855041 176579972 1.02
tpch_q05/duckdb:vortex-compact 150882816 148917985 1.01
tpch_q06/duckdb:vortex-compact 90269647 85305063 1.06
tpch_q07/duckdb:vortex-compact 204522307 206127810 0.99
tpch_q08/duckdb:vortex-compact 194758604 189890556 1.03
tpch_q09/duckdb:vortex-compact 362842218 367184360 0.99
tpch_q10/duckdb:vortex-compact 192973327 187790427 1.03
tpch_q11/duckdb:vortex-compact 42186006 42726630 0.99
tpch_q12/duckdb:vortex-compact 208707298 208318994 1.00
tpch_q13/duckdb:vortex-compact 295200370 296567281 1.00
tpch_q14/duckdb:vortex-compact 104653082 103595830 1.01
tpch_q15/duckdb:vortex-compact 121505583 120624315 1.01
tpch_q16/duckdb:vortex-compact 84811142 86563998 0.98
tpch_q17/duckdb:vortex-compact 115754518 116288724 1.00
tpch_q18/duckdb:vortex-compact 287971189 305157734 0.94
tpch_q19/duckdb:vortex-compact 116190832 115117541 1.01
tpch_q20/duckdb:vortex-compact 209578954 207254776 1.01
tpch_q21/duckdb:vortex-compact 636355549 634305301 1.00
tpch_q22/duckdb:vortex-compact 93158931 89448789 1.04
duckdb / parquet (1.002x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 256576406 265711318 0.97
tpch_q02/duckdb:parquet 94884540 95973675 0.99
tpch_q03/duckdb:parquet 207936663 210887758 0.99
tpch_q04/duckdb:parquet 136911496 135875018 1.01
tpch_q05/duckdb:parquet 220598977 219430817 1.01
tpch_q06/duckdb:parquet 67334572 66645347 1.01
tpch_q07/duckdb:parquet 183851458 177904490 1.03
tpch_q08/duckdb:parquet 254720321 255147065 1.00
tpch_q09/duckdb:parquet 442958956 464907473 0.95
tpch_q10/duckdb:parquet 605956522 602840813 1.01
tpch_q11/duckdb:parquet 42084093 38310865 1.10
tpch_q12/duckdb:parquet 125339696 126018887 0.99
tpch_q13/duckdb:parquet 467875383 449964829 1.04
tpch_q14/duckdb:parquet 177029954 176762784 1.00
tpch_q15/duckdb:parquet 95984009 97248095 0.99
tpch_q16/duckdb:parquet 161634253 163714410 0.99
tpch_q17/duckdb:parquet 180576752 177748425 1.02
tpch_q18/duckdb:parquet 351001347 352984234 0.99
tpch_q19/duckdb:parquet 282734362 289304860 0.98
tpch_q20/duckdb:parquet 227670804 228030851 1.00
tpch_q21/duckdb:parquet 572149406 575964168 0.99
tpch_q22/duckdb:parquet 293912683 290373957 1.01
duckdb / duckdb (0.995x ➖, 1↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117834827 116538917 1.01
tpch_q02/duckdb:duckdb 45600176 48574107 0.94
tpch_q03/duckdb:duckdb 97616803 97929274 1.00
tpch_q04/duckdb:duckdb 131060983 131198196 1.00
tpch_q05/duckdb:duckdb 110033865 110839464 0.99
tpch_q06/duckdb:duckdb 39619205 39992757 0.99
tpch_q07/duckdb:duckdb 87647735 85732519 1.02
tpch_q08/duckdb:duckdb 110727182 110798171 1.00
tpch_q09/duckdb:duckdb 278922030 276042243 1.01
tpch_q10/duckdb:duckdb 202046830 201135818 1.00
tpch_q11/duckdb:duckdb 15697528 15255971 1.03
tpch_q12/duckdb:duckdb 84656321 84946751 1.00
tpch_q13/duckdb:duckdb 251032512 254074347 0.99
tpch_q14/duckdb:duckdb 72225460 70143442 1.03
tpch_q15/duckdb:duckdb 79417860 80195796 0.99
tpch_q16/duckdb:duckdb 73220934 72048959 1.02
tpch_q17/duckdb:duckdb 84955310 85272079 1.00
tpch_q18/duckdb:duckdb 214885188 214113944 1.00
tpch_q19/duckdb:duckdb 115176122 115049549 1.00
tpch_q20/duckdb:duckdb 111869232 111542232 1.00
tpch_q21/duckdb:duckdb 304742526 300402780 1.01
tpch_q22/duckdb:duckdb 🚀 62394392 71093536 0.88
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -2.2% -2.2% -0.0% +11.9% ➖ noise
1 datafusion:vortex-compact +0.3% -2.2% +2.6% +13.2% ➖ noise
1 datafusion:vortex-file-compressed -1.8% -2.2% +0.4% +15.6% ➖ noise
1 duckdb:duckdb +1.1% -2.2% +3.4% +11.9% ➖ noise
1 duckdb:vortex-compact -0.4% -2.2% +1.9% +11.8% ➖ noise
1 duckdb:vortex-file-compressed +3.1% -2.2% +5.5% +12.7% ➖ noise
2 datafusion:arrow +3.0% -0.1% +3.0% +10.0% ➖ noise
2 datafusion:vortex-compact +1.4% -0.1% +1.5% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +1.6% -0.1% +1.6% +10.0% ➖ noise
2 duckdb:duckdb -6.1% -0.1% -6.1% +13.1% ➖ noise
2 duckdb:vortex-compact +1.4% -0.1% +1.5% +11.3% ➖ noise
2 duckdb:vortex-file-compressed +1.5% -0.1% +1.6% +10.7% ➖ noise
3 datafusion:arrow +0.8% +0.7% +0.1% +10.0% ➖ noise
3 datafusion:vortex-compact +5.3% +0.7% +4.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +5.2% +0.7% +4.5% +10.0% ➖ noise
3 duckdb:duckdb -0.3% +0.7% -1.0% +10.0% ➖ noise
3 duckdb:vortex-compact +3.0% +0.7% +2.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.6% +0.7% -0.0% +10.0% ➖ noise
4 datafusion:arrow +0.6% +0.8% -0.2% +10.0% ➖ noise
4 datafusion:vortex-compact -1.1% +0.8% -1.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.5% +0.8% -1.3% +10.0% ➖ noise
4 duckdb:duckdb -0.1% +0.8% -0.9% +10.0% ➖ noise
4 duckdb:vortex-compact +2.4% +0.8% +1.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.7% +0.8% +1.9% +10.0% ➖ noise
5 datafusion:arrow +1.4% +1.4% -0.0% +10.0% ➖ noise
5 datafusion:vortex-compact +2.9% +1.4% +1.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.6% +1.4% -0.8% +10.0% ➖ noise
5 duckdb:duckdb -0.7% +1.4% -2.1% +10.0% ➖ noise
5 duckdb:vortex-compact +1.3% +1.4% -0.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.3% +1.4% -1.7% +10.0% ➖ noise
6 datafusion:arrow +0.8% +2.1% -1.2% +10.0% ➖ noise
6 datafusion:vortex-compact -2.1% +2.1% -4.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -4.4% +2.1% -6.3% +10.0% ➖ noise
6 duckdb:duckdb -0.9% +2.1% -2.9% +16.7% ➖ noise
6 duckdb:vortex-compact +5.8% +2.1% +3.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +7.4% +2.1% +5.2% +10.0% ➖ noise
7 datafusion:arrow +0.7% +2.4% -1.6% +10.0% ➖ noise
7 datafusion:vortex-compact +0.9% +2.4% -1.5% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +2.2% +2.4% -0.2% +10.0% ➖ noise
7 duckdb:duckdb +2.2% +2.4% -0.1% +14.6% ➖ noise
7 duckdb:vortex-compact -0.8% +2.4% -3.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +3.0% +2.4% +0.6% +10.0% ➖ noise
8 datafusion:arrow +0.7% +1.0% -0.2% +10.0% ➖ noise
8 datafusion:vortex-compact +0.1% +1.0% -0.8% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +2.1% +1.0% +1.1% +10.0% ➖ noise
8 duckdb:duckdb -0.1% +1.0% -1.0% +10.0% ➖ noise
8 duckdb:vortex-compact +2.6% +1.0% +1.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.7% +1.0% +1.7% +10.0% ➖ noise
9 datafusion:arrow +1.2% -2.1% +3.4% +10.0% ➖ noise
9 datafusion:vortex-compact -0.7% -2.1% +1.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.1% -2.1% +2.0% +10.0% ➖ noise
9 duckdb:duckdb +1.0% -2.1% +3.3% +10.0% ➖ noise
9 duckdb:vortex-compact -1.2% -2.1% +1.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.1% -2.1% +2.3% +10.0% ➖ noise
10 datafusion:arrow -2.1% +0.4% -2.5% +10.0% ➖ noise
10 datafusion:vortex-compact -1.1% +0.4% -1.4% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.1% +0.4% +0.7% +10.0% ➖ noise
10 duckdb:duckdb +0.5% +0.4% +0.1% +10.0% ➖ noise
10 duckdb:vortex-compact +2.8% +0.4% +2.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +8.6% +0.4% +8.2% +10.0% ➖ noise
11 datafusion:arrow +3.3% +6.8% -3.2% +10.3% ➖ noise
11 datafusion:vortex-compact -2.4% +6.8% -8.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -0.5% +6.8% -6.8% +10.0% ➖ noise
11 duckdb:duckdb +2.9% +6.8% -3.6% +17.7% ➖ noise
11 duckdb:vortex-compact -1.3% +6.8% -7.5% +12.6% ➖ noise
11 duckdb:vortex-file-compressed +5.9% +6.8% -0.8% +13.8% ➖ noise
12 datafusion:arrow +1.6% -1.1% +2.7% +39.9% ➖ noise
12 datafusion:vortex-compact -5.5% -1.1% -4.5% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +0.3% -1.1% +1.4% +10.0% ➖ noise
12 duckdb:duckdb -0.3% -1.1% +0.7% +10.0% ➖ noise
12 duckdb:vortex-compact +0.2% -1.1% +1.3% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +2.7% -1.1% +3.8% +10.0% ➖ noise
13 datafusion:arrow +1.9% +3.4% -1.4% +10.0% ➖ noise
13 datafusion:vortex-compact -2.1% +3.4% -5.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.2% +3.4% -2.1% +10.0% ➖ noise
13 duckdb:duckdb -1.2% +3.4% -4.4% +10.0% ➖ noise
13 duckdb:vortex-compact -0.5% +3.4% -3.7% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.6% +3.4% -2.7% +10.0% ➖ noise
14 datafusion:arrow -1.9% +1.4% -3.3% +10.0% ➖ noise
14 datafusion:vortex-compact -1.9% +1.4% -3.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -5.4% +1.4% -6.8% +10.0% ➖ noise
14 duckdb:duckdb +3.0% +1.4% +1.5% +10.0% ➖ noise
14 duckdb:vortex-compact +1.0% +1.4% -0.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +5.8% +1.4% +4.3% +10.0% ➖ noise
15 datafusion:arrow -0.8% -0.7% -0.2% +10.0% ➖ noise
15 datafusion:vortex-compact -0.2% -0.7% +0.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.8% -0.7% +1.5% +10.0% ➖ noise
15 duckdb:duckdb -1.0% -0.7% -0.3% +10.0% ➖ noise
15 duckdb:vortex-compact +0.7% -0.7% +1.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.7% -0.7% +1.4% +10.0% ➖ noise
16 datafusion:arrow +2.6% +1.5% +1.1% +10.0% ➖ noise
16 datafusion:vortex-compact -0.8% +1.5% -2.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -2.6% +1.5% -4.0% +13.4% ➖ noise
16 duckdb:duckdb +1.6% +1.5% +0.1% +10.0% ➖ noise
16 duckdb:vortex-compact -2.0% +1.5% -3.5% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +0.3% +1.5% -1.1% +10.0% ➖ noise
17 datafusion:arrow +1.9% +1.2% +0.7% +10.0% ➖ noise
17 datafusion:vortex-compact +2.4% +1.2% +1.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +1.1% +1.2% -0.2% +10.0% ➖ noise
17 duckdb:duckdb -0.4% +1.2% -1.6% +10.0% ➖ noise
17 duckdb:vortex-compact -0.5% +1.2% -1.7% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +1.2% +1.2% -0.0% +10.0% ➖ noise
18 datafusion:arrow -0.9% +0.0% -0.9% +10.1% ➖ noise
18 datafusion:vortex-compact +1.3% +0.0% +1.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.5% +0.0% +0.5% +10.0% ➖ noise
18 duckdb:duckdb +0.4% +0.0% +0.4% +10.0% ➖ noise
18 duckdb:vortex-compact -5.6% +0.0% -5.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -4.1% +0.0% -4.1% +10.0% ➖ noise
19 datafusion:arrow -0.6% -0.1% -0.5% +10.0% ➖ noise
19 datafusion:vortex-compact +0.4% -0.1% +0.5% +10.3% ➖ noise
19 datafusion:vortex-file-compressed +1.6% -0.1% +1.7% +10.0% ➖ noise
19 duckdb:duckdb +0.1% -0.1% +0.2% +10.0% ➖ noise
19 duckdb:vortex-compact +0.9% -0.1% +1.1% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +0.4% -0.1% +0.5% +10.0% ➖ noise
20 datafusion:arrow -1.1% -0.3% -0.8% +10.0% ➖ noise
20 datafusion:vortex-compact +0.6% -0.3% +0.9% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -1.4% -0.3% -1.0% +10.0% ➖ noise
20 duckdb:duckdb +0.3% -0.3% +0.6% +10.0% ➖ noise
20 duckdb:vortex-compact +1.1% -0.3% +1.4% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +0.9% -0.3% +1.2% +10.0% ➖ noise
21 datafusion:arrow -6.5% +0.4% -6.9% +10.0% ➖ noise
21 datafusion:vortex-compact +0.9% +0.4% +0.5% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +2.7% +0.4% +2.2% +10.0% ➖ noise
21 duckdb:duckdb +1.4% +0.4% +1.0% +10.0% ➖ noise
21 duckdb:vortex-compact +0.3% +0.4% -0.1% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -0.9% +0.4% -1.3% +10.0% ➖ noise
22 datafusion:arrow +2.0% -0.1% +2.1% +10.0% ➖ noise
22 datafusion:vortex-compact +0.3% -0.1% +0.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -2.5% -0.1% -2.4% +10.0% ➖ noise
22 duckdb:duckdb -12.2% -0.1% -12.1% +10.0% ✅ faster
22 duckdb:vortex-compact +4.1% -0.1% +4.3% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +8.2% -0.1% +8.3% +10.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Vortex (geomean): 0.991x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) -0.0% · Median polish +0.4%


datafusion / vortex-file-compressed (1.000x ➖, 1↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1722461 1662459 1.04
clickbench_q01/datafusion:vortex-file-compressed 13851736 13970910 0.99
clickbench_q02/datafusion:vortex-file-compressed 33811879 33409955 1.01
clickbench_q03/datafusion:vortex-file-compressed 36966806 36564206 1.01
clickbench_q04/datafusion:vortex-file-compressed 324079141 321505158 1.01
clickbench_q05/datafusion:vortex-file-compressed 328516095 315842873 1.04
clickbench_q06/datafusion:vortex-file-compressed 1687619 1730373 0.98
clickbench_q07/datafusion:vortex-file-compressed 18136269 17597181 1.03
clickbench_q08/datafusion:vortex-file-compressed 392602475 389362343 1.01
clickbench_q09/datafusion:vortex-file-compressed 571549801 560072127 1.02
clickbench_q10/datafusion:vortex-file-compressed 72038583 72964554 0.99
clickbench_q11/datafusion:vortex-file-compressed 78985513 80528603 0.98
clickbench_q12/datafusion:vortex-file-compressed 284017974 279322376 1.02
clickbench_q13/datafusion:vortex-file-compressed 426042162 422988750 1.01
clickbench_q14/datafusion:vortex-file-compressed 256760307 251025977 1.02
clickbench_q15/datafusion:vortex-file-compressed 382825733 376644669 1.02
clickbench_q16/datafusion:vortex-file-compressed 735085577 730308920 1.01
clickbench_q17/datafusion:vortex-file-compressed 719193665 720070586 1.00
clickbench_q18/datafusion:vortex-file-compressed 1525928207 1495655636 1.02
clickbench_q19/datafusion:vortex-file-compressed 23492933 24159327 0.97
clickbench_q20/datafusion:vortex-file-compressed 360063657 356500241 1.01
clickbench_q21/datafusion:vortex-file-compressed 407264453 399133728 1.02
clickbench_q22/datafusion:vortex-file-compressed 502497683 535997044 0.94
clickbench_q23/datafusion:vortex-file-compressed 🚀 553513552 615238355 0.90
clickbench_q24/datafusion:vortex-file-compressed 46457297 50965216 0.91
clickbench_q25/datafusion:vortex-file-compressed 66706017 68839265 0.97
clickbench_q26/datafusion:vortex-file-compressed 44519570 46461456 0.96
clickbench_q27/datafusion:vortex-file-compressed 769419927 779120240 0.99
clickbench_q28/datafusion:vortex-file-compressed 6357324233 6701181580 0.95
clickbench_q29/datafusion:vortex-file-compressed 240199978 228328317 1.05
clickbench_q30/datafusion:vortex-file-compressed 237686119 237830273 1.00
clickbench_q31/datafusion:vortex-file-compressed 268211817 275113155 0.97
clickbench_q32/datafusion:vortex-file-compressed 1365464900 1377525697 0.99
clickbench_q33/datafusion:vortex-file-compressed 1411209462 1451888877 0.97
clickbench_q34/datafusion:vortex-file-compressed 1410557868 1406332706 1.00
clickbench_q35/datafusion:vortex-file-compressed 525312804 527450172 1.00
clickbench_q36/datafusion:vortex-file-compressed 84328153 81902981 1.03
clickbench_q37/datafusion:vortex-file-compressed 37099341 37844561 0.98
clickbench_q38/datafusion:vortex-file-compressed 26537365 24776919 1.07
clickbench_q39/datafusion:vortex-file-compressed 161485826 153415803 1.05
clickbench_q40/datafusion:vortex-file-compressed 20841329 21075610 0.99
clickbench_q41/datafusion:vortex-file-compressed 19494446 18109141 1.08
clickbench_q42/datafusion:vortex-file-compressed 22114919 21542338 1.03
datafusion / parquet (0.999x ➖, 1↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1745787 1795181 0.97
clickbench_q01/datafusion:parquet 21217656 20738644 1.02
clickbench_q02/datafusion:parquet 49801812 52022099 0.96
clickbench_q03/datafusion:parquet 42398940 40002841 1.06
clickbench_q04/datafusion:parquet 331999667 359419429 0.92
clickbench_q05/datafusion:parquet 386117602 377515352 1.02
clickbench_q06/datafusion:parquet 🚀 1546738 1815420 0.85
clickbench_q07/datafusion:parquet 25437655 27089419 0.94
clickbench_q08/datafusion:parquet 422898718 412816401 1.02
clickbench_q09/datafusion:parquet 665225926 653744506 1.02
clickbench_q10/datafusion:parquet 114568554 120015345 0.95
clickbench_q11/datafusion:parquet 146470674 145611611 1.01
clickbench_q12/datafusion:parquet 373214056 374641129 1.00
clickbench_q13/datafusion:parquet 520446598 517949493 1.00
clickbench_q14/datafusion:parquet 374149863 370108583 1.01
clickbench_q15/datafusion:parquet 392639994 404017290 0.97
clickbench_q16/datafusion:parquet 751095180 732674985 1.03
clickbench_q17/datafusion:parquet 727022150 728559765 1.00
clickbench_q18/datafusion:parquet 1598777528 1515341758 1.06
clickbench_q19/datafusion:parquet 33718511 34648136 0.97
clickbench_q20/datafusion:parquet 631727542 632554842 1.00
clickbench_q21/datafusion:parquet 690600066 707063224 0.98
clickbench_q22/datafusion:parquet 992610365 989452249 1.00
clickbench_q23/datafusion:parquet 3775030452 3774054403 1.00
clickbench_q24/datafusion:parquet 88932567 94790527 0.94
clickbench_q25/datafusion:parquet 150988134 150985751 1.00
clickbench_q26/datafusion:parquet 97435886 94629452 1.03
clickbench_q27/datafusion:parquet 1083025862 1072308701 1.01
clickbench_q28/datafusion:parquet 6687473795 6690885099 1.00
clickbench_q29/datafusion:parquet 245174872 245982221 1.00
clickbench_q30/datafusion:parquet 382764241 376553192 1.02
clickbench_q31/datafusion:parquet 412053379 411444909 1.00
clickbench_q32/datafusion:parquet 1412669679 1380522776 1.02
clickbench_q33/datafusion:parquet 1595276205 1556918800 1.02
clickbench_q34/datafusion:parquet 1587251889 1574867352 1.01
clickbench_q35/datafusion:parquet 560198103 539724753 1.04
clickbench_q36/datafusion:parquet 151455157 141933309 1.07
clickbench_q37/datafusion:parquet 61535023 61574198 1.00
clickbench_q38/datafusion:parquet 94486328 91686948 1.03
clickbench_q39/datafusion:parquet 285979504 291026302 0.98
clickbench_q40/datafusion:parquet 35369962 35080650 1.01
clickbench_q41/datafusion:parquet 32221750 30987823 1.04
clickbench_q42/datafusion:parquet 33360774 33362611 1.00
duckdb / vortex-file-compressed (0.983x ➖, 6↑ 2↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 5688834 6169214 0.92
clickbench_q01/duckdb:vortex-file-compressed 13809335 13471835 1.03
clickbench_q02/duckdb:vortex-file-compressed 25047406 24042866 1.04
clickbench_q03/duckdb:vortex-file-compressed 30309842 29527745 1.03
clickbench_q04/duckdb:vortex-file-compressed 172461893 168414839 1.02
clickbench_q05/duckdb:vortex-file-compressed 199230501 197368305 1.01
clickbench_q06/duckdb:vortex-file-compressed 18847915 19357427 0.97
clickbench_q07/duckdb:vortex-file-compressed 15192778 15048134 1.01
clickbench_q08/duckdb:vortex-file-compressed 262023016 262342611 1.00
clickbench_q09/duckdb:vortex-file-compressed 375027900 374928416 1.00
clickbench_q10/duckdb:vortex-file-compressed 75639301 72625957 1.04
clickbench_q11/duckdb:vortex-file-compressed 80289235 81349451 0.99
clickbench_q12/duckdb:vortex-file-compressed 213812800 216826018 0.99
clickbench_q13/duckdb:vortex-file-compressed 434526836 423613616 1.03
clickbench_q14/duckdb:vortex-file-compressed 240018392 238215791 1.01
clickbench_q15/duckdb:vortex-file-compressed 217770152 214554050 1.01
clickbench_q16/duckdb:vortex-file-compressed 🚀 612680431 708483313 0.86
clickbench_q17/duckdb:vortex-file-compressed 514576946 534024827 0.96
clickbench_q18/duckdb:vortex-file-compressed 1246930066 1178430412 1.06
clickbench_q19/duckdb:vortex-file-compressed 19947285 20944645 0.95
clickbench_q20/duckdb:vortex-file-compressed 392987892 379713630 1.03
clickbench_q21/duckdb:vortex-file-compressed 399925051 409052634 0.98
clickbench_q22/duckdb:vortex-file-compressed 🚀 568549781 704120389 0.81
clickbench_q23/duckdb:vortex-file-compressed 🚨 822606109 734852197 1.12
clickbench_q24/duckdb:vortex-file-compressed 49494430 47213016 1.05
clickbench_q25/duckdb:vortex-file-compressed 72140296 72237022 1.00
clickbench_q26/duckdb:vortex-file-compressed 🚀 37046488 43482289 0.85
clickbench_q27/duckdb:vortex-file-compressed 527276789 528168942 1.00
clickbench_q28/duckdb:vortex-file-compressed 2982043243 2991470394 1.00
clickbench_q29/duckdb:vortex-file-compressed 28219333 27481131 1.03
clickbench_q30/duckdb:vortex-file-compressed 171263427 173273597 0.99
clickbench_q31/duckdb:vortex-file-compressed 256724649 249252494 1.03
clickbench_q32/duckdb:vortex-file-compressed 1240954061 1284118017 0.97
clickbench_q33/duckdb:vortex-file-compressed 🚨 1671850563 1462212032 1.14
clickbench_q34/duckdb:vortex-file-compressed 1739949892 1582685676 1.10
clickbench_q35/duckdb:vortex-file-compressed 368910111 369320779 1.00
clickbench_q36/duckdb:vortex-file-compressed 27742662 30764232 0.90
clickbench_q37/duckdb:vortex-file-compressed 20531365 22134122 0.93
clickbench_q38/duckdb:vortex-file-compressed 🚀 20918271 24513885 0.85
clickbench_q39/duckdb:vortex-file-compressed 45101258 45797285 0.98
clickbench_q40/duckdb:vortex-file-compressed 🚀 21283003 24532815 0.87
clickbench_q41/duckdb:vortex-file-compressed 🚀 19919314 23874866 0.83
clickbench_q42/duckdb:vortex-file-compressed 24004851 24269331 0.99
duckdb / parquet (1.001x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 223356866 226073610 0.99
clickbench_q01/duckdb:parquet 51121968 52119430 0.98
clickbench_q02/duckdb:parquet 65916169 66382465 0.99
clickbench_q03/duckdb:parquet 64425500 64382089 1.00
clickbench_q04/duckdb:parquet 205605323 206997490 0.99
clickbench_q05/duckdb:parquet 274140722 275586089 0.99
clickbench_q06/duckdb:parquet 60647970 59670150 1.02
clickbench_q07/duckdb:parquet 51307797 50486019 1.02
clickbench_q08/duckdb:parquet 269908535 270715990 1.00
clickbench_q09/duckdb:parquet 396058069 396148118 1.00
clickbench_q10/duckdb:parquet 96523702 97697141 0.99
clickbench_q11/duckdb:parquet 108572998 107620765 1.01
clickbench_q12/duckdb:parquet 299945273 296796167 1.01
clickbench_q13/duckdb:parquet 514552929 518632331 0.99
clickbench_q14/duckdb:parquet 328487625 331467702 0.99
clickbench_q15/duckdb:parquet 241533332 242544155 1.00
clickbench_q16/duckdb:parquet 616188142 617750530 1.00
clickbench_q17/duckdb:parquet 510258714 509618759 1.00
clickbench_q18/duckdb:parquet 1049564233 1052213229 1.00
clickbench_q19/duckdb:parquet 49362594 49031513 1.01
clickbench_q20/duckdb:parquet 438546576 435903081 1.01
clickbench_q21/duckdb:parquet 553414028 555871659 1.00
clickbench_q22/duckdb:parquet 923287019 925517112 1.00
clickbench_q23/duckdb:parquet 316273668 320535675 0.99
clickbench_q24/duckdb:parquet 77413875 78493110 0.99
clickbench_q25/duckdb:parquet 140754601 140250946 1.00
clickbench_q26/duckdb:parquet 54842657 53171795 1.03
clickbench_q27/duckdb:parquet 644585393 642084027 1.00
clickbench_q28/duckdb:parquet 4859758576 4848745576 1.00
clickbench_q29/duckdb:parquet 60747449 61733269 0.98
clickbench_q30/duckdb:parquet 304349704 306711545 0.99
clickbench_q31/duckdb:parquet 347989499 353490487 0.98
clickbench_q32/duckdb:parquet 1149980649 1127209817 1.02
clickbench_q33/duckdb:parquet 1271695614 1250193878 1.02
clickbench_q34/duckdb:parquet 1291284598 1279494494 1.01
clickbench_q35/duckdb:parquet 353771173 353341134 1.00
clickbench_q36/duckdb:parquet 63602806 64207690 0.99
clickbench_q37/duckdb:parquet 53114919 53844773 0.99
clickbench_q38/duckdb:parquet 59093638 58506122 1.01
clickbench_q39/duckdb:parquet 99190771 97388197 1.02
clickbench_q40/duckdb:parquet 56746268 55337528 1.03
clickbench_q41/duckdb:parquet 59216066 58582800 1.01
clickbench_q42/duckdb:parquet 52811226 52832343 1.00
duckdb / duckdb (1.036x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18276676 17770015 1.03
clickbench_q01/duckdb:duckdb 35149506 33980045 1.03
clickbench_q02/duckdb:duckdb 46816102 45281741 1.03
clickbench_q03/duckdb:duckdb 48337639 47181405 1.02
clickbench_q04/duckdb:duckdb 210945951 209000529 1.01
clickbench_q05/duckdb:duckdb 325358479 311958733 1.04
clickbench_q06/duckdb:duckdb 37605634 35381673 1.06
clickbench_q07/duckdb:duckdb 37550974 35950441 1.04
clickbench_q08/duckdb:duckdb 306087740 298366191 1.03
clickbench_q09/duckdb:duckdb 503448342 498778624 1.01
clickbench_q10/duckdb:duckdb 98134428 98224411 1.00
clickbench_q11/duckdb:duckdb 109183156 107791253 1.01
clickbench_q12/duckdb:duckdb 310867876 283236389 1.10
clickbench_q13/duckdb:duckdb 559050312 520421068 1.07
clickbench_q14/duckdb:duckdb 350314230 328779635 1.07
clickbench_q15/duckdb:duckdb 265705306 250435325 1.06
clickbench_q16/duckdb:duckdb 680226867 664688720 1.02
clickbench_q17/duckdb:duckdb 580549173 567054126 1.02
clickbench_q18/duckdb:duckdb 1289404223 1261286328 1.02
clickbench_q19/duckdb:duckdb 36634064 34941451 1.05
clickbench_q20/duckdb:duckdb 936747981 856325922 1.09
clickbench_q21/duckdb:duckdb 993890629 972205449 1.02
clickbench_q22/duckdb:duckdb 1094981124 1053514049 1.04
clickbench_q23/duckdb:duckdb 260717481 256494699 1.02
clickbench_q24/duckdb:duckdb 64702079 61216837 1.06
clickbench_q25/duckdb:duckdb 128017473 123613751 1.04
clickbench_q26/duckdb:duckdb 59047178 55985144 1.05
clickbench_q27/duckdb:duckdb 1053844696 973732652 1.08
clickbench_q28/duckdb:duckdb 4637643227 4657775911 1.00
clickbench_q29/duckdb:duckdb 49445837 48367386 1.02
clickbench_q30/duckdb:duckdb 294449754 280819383 1.05
clickbench_q31/duckdb:duckdb 406400594 410501972 0.99
clickbench_q32/duckdb:duckdb 1421729690 1469242439 0.97
clickbench_q33/duckdb:duckdb 2011759159 2000457841 1.01
clickbench_q34/duckdb:duckdb 2103140697 2064484873 1.02
clickbench_q35/duckdb:duckdb 265511862 265896142 1.00
clickbench_q36/duckdb:duckdb 42595688 41578905 1.02
clickbench_q37/duckdb:duckdb 33715591 31656699 1.07
clickbench_q38/duckdb:duckdb 32592719 31308357 1.04
clickbench_q39/duckdb:duckdb 69583759 64583620 1.08
clickbench_q40/duckdb:duckdb 33504334 31743338 1.06
clickbench_q41/duckdb:duckdb 31580750 30481246 1.04
clickbench_q42/duckdb:duckdb 33516516 31443690 1.07
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +3.6% -2.0% +5.7% +688.3% ➖ noise
0 duckdb:duckdb +2.9% -2.0% +4.9% +307.5% ➖ noise
0 duckdb:vortex-file-compressed -7.8% -2.0% -5.9% +364.4% ➖ noise
1 datafusion:vortex-file-compressed -0.9% +0.2% -1.0% +48.2% ➖ noise
1 duckdb:duckdb +3.4% +0.2% +3.3% +59.9% ➖ noise
1 duckdb:vortex-file-compressed +2.5% +0.2% +2.3% +14.2% ➖ noise
2 datafusion:vortex-file-compressed +1.2% -2.5% +3.8% +31.3% ➖ noise
2 duckdb:duckdb +3.4% -2.5% +6.0% +26.9% ➖ noise
2 duckdb:vortex-file-compressed +4.2% -2.5% +6.9% +15.0% ➖ noise
3 datafusion:vortex-file-compressed +1.1% +3.0% -1.8% +160.1% ➖ noise
3 duckdb:duckdb +2.5% +3.0% -0.5% +60.5% ➖ noise
3 duckdb:vortex-file-compressed +2.6% +3.0% -0.3% +30.3% ➖ noise
4 datafusion:vortex-file-compressed +0.8% -4.2% +5.2% +10.0% ➖ noise
4 duckdb:duckdb +0.9% -4.2% +5.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.4% -4.2% +6.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +4.0% +0.9% +3.1% +10.0% ➖ noise
5 duckdb:duckdb +4.3% +0.9% +3.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.9% +0.9% +0.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -2.5% -6.9% +4.8% +51.7% ➖ noise
6 duckdb:duckdb +6.3% -6.9% +14.2% +29.8% ➖ noise
6 duckdb:vortex-file-compressed -2.6% -6.9% +4.6% +19.7% ➖ noise
7 datafusion:vortex-file-compressed +3.1% -2.3% +5.5% +10.0% ➖ noise
7 duckdb:duckdb +4.5% -2.3% +6.9% +11.6% ➖ noise
7 duckdb:vortex-file-compressed +1.0% -2.3% +3.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.8% +1.1% -0.2% +10.0% ➖ noise
8 duckdb:duckdb +2.6% +1.1% +1.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.1% +1.1% -1.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.0% +0.9% +1.2% +10.0% ➖ noise
9 duckdb:duckdb +0.9% +0.9% +0.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.0% +0.9% -0.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -1.3% -2.9% +1.7% +10.0% ➖ noise
10 duckdb:duckdb -0.1% -2.9% +2.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +4.1% -2.9% +7.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -1.9% +0.7% -2.6% +10.0% ➖ noise
11 duckdb:duckdb +1.3% +0.7% +0.5% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -1.3% +0.7% -2.0% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +1.7% +0.3% +1.3% +10.0% ➖ noise
12 duckdb:duckdb +9.8% +0.3% +9.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -1.4% +0.3% -1.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.7% -0.2% +0.9% +10.0% ➖ noise
13 duckdb:duckdb +7.4% -0.2% +7.6% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +2.6% -0.2% +2.7% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +2.3% +0.1% +2.2% +10.0% ➖ noise
14 duckdb:duckdb +6.5% +0.1% +6.5% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +0.8% +0.1% +0.7% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.6% -1.6% +3.3% +10.0% ➖ noise
15 duckdb:duckdb +6.1% -1.6% +7.8% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +1.5% -1.6% +3.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.7% +1.1% -0.5% +10.0% ➖ noise
16 duckdb:duckdb +2.3% +1.1% +1.2% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -13.5% +1.1% -14.5% +15.8% ✅ faster
17 datafusion:vortex-file-compressed -0.1% -0.0% -0.1% +10.0% ➖ noise
17 duckdb:duckdb +2.4% -0.0% +2.4% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -3.6% -0.0% -3.6% +11.7% ➖ noise
18 datafusion:vortex-file-compressed +2.0% +2.6% -0.5% +10.0% ➖ noise
18 duckdb:duckdb +2.2% +2.6% -0.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +5.8% +2.6% +3.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -2.8% -1.0% -1.8% +16.0% ➖ noise
19 duckdb:duckdb +4.8% -1.0% +5.9% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -4.8% -1.0% -3.8% +32.9% ➖ noise
20 datafusion:vortex-file-compressed +1.0% +0.2% +0.8% +167.3% ➖ noise
20 duckdb:duckdb +9.4% +0.2% +9.1% +27.7% ➖ noise
20 duckdb:vortex-file-compressed +3.5% +0.2% +3.3% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +2.0% -1.4% +3.5% +10.0% ➖ noise
21 duckdb:duckdb +2.2% -1.4% +3.7% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -2.2% -1.4% -0.9% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -6.2% +0.0% -6.3% +10.0% ➖ noise
22 duckdb:duckdb +3.9% +0.0% +3.9% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -19.3% +0.0% -19.3% +10.0% ✅ faster
23 datafusion:vortex-file-compressed -10.0% -0.7% -9.4% +57.3% ➖ noise
23 duckdb:duckdb +1.6% -0.7% +2.3% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +11.9% -0.7% +12.7% +23.5% ➖ noise
24 datafusion:vortex-file-compressed -8.8% -3.8% -5.2% +19.5% ➖ noise
24 duckdb:duckdb +5.7% -3.8% +9.9% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +4.8% -3.8% +9.0% +34.8% ➖ noise
25 datafusion:vortex-file-compressed -3.1% +0.2% -3.3% +10.0% ➖ noise
25 duckdb:duckdb +3.6% +0.2% +3.4% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -0.1% +0.2% -0.3% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -4.2% +3.1% -7.0% +12.7% ➖ noise
26 duckdb:duckdb +5.5% +3.1% +2.3% +11.0% ➖ noise
26 duckdb:vortex-file-compressed -14.8% +3.1% -17.3% +20.8% ✅ faster
27 datafusion:vortex-file-compressed -1.2% +0.7% -1.9% +10.0% ➖ noise
27 duckdb:duckdb +8.2% +0.7% +7.5% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -0.2% +0.7% -0.9% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -5.1% +0.1% -5.2% +10.0% ➖ noise
28 duckdb:duckdb -0.4% +0.1% -0.5% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.3% +0.1% -0.4% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +5.2% -1.0% +6.2% +10.0% ➖ noise
29 duckdb:duckdb +2.2% -1.0% +3.2% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +2.7% -1.0% +3.7% +14.0% ➖ noise
30 datafusion:vortex-file-compressed -0.1% +0.4% -0.5% +10.0% ➖ noise
30 duckdb:duckdb +4.9% +0.4% +4.4% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -1.2% +0.4% -1.6% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -2.5% -0.7% -1.8% +10.0% ➖ noise
31 duckdb:duckdb -1.0% -0.7% -0.3% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +3.0% -0.7% +3.7% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -0.9% +2.2% -3.0% +18.6% ➖ noise
32 duckdb:duckdb -3.2% +2.2% -5.3% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -3.4% +2.2% -5.4% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -2.8% +2.1% -4.8% +10.7% ➖ noise
33 duckdb:duckdb +0.6% +2.1% -1.5% +11.7% ➖ noise
33 duckdb:vortex-file-compressed +14.3% +2.1% +12.0% +10.0% 🚨 regression
34 datafusion:vortex-file-compressed +0.3% +0.9% -0.5% +10.0% ➖ noise
34 duckdb:duckdb +1.9% +0.9% +1.0% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +9.9% +0.9% +9.0% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -0.4% +1.9% -2.3% +10.0% ➖ noise
35 duckdb:duckdb -0.1% +1.9% -2.0% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.1% +1.9% -2.0% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +3.0% +2.8% +0.1% +10.0% ➖ noise
36 duckdb:duckdb +2.4% +2.8% -0.4% +12.4% ➖ noise
36 duckdb:vortex-file-compressed -9.8% +2.8% -12.3% +10.0% ✅ faster
37 datafusion:vortex-file-compressed -2.0% -0.7% -1.3% +14.2% ➖ noise
37 duckdb:duckdb +6.5% -0.7% +7.3% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -7.2% -0.7% -6.6% +11.4% ➖ noise
38 datafusion:vortex-file-compressed +7.1% +2.0% +5.0% +10.0% ➖ noise
38 duckdb:duckdb +4.1% +2.0% +2.0% +10.1% ➖ noise
38 duckdb:vortex-file-compressed -14.7% +2.0% -16.4% +10.8% ✅ faster
39 datafusion:vortex-file-compressed +5.3% +0.0% +5.2% +10.0% ➖ noise
39 duckdb:duckdb +7.7% +0.0% +7.7% +10.4% ➖ noise
39 duckdb:vortex-file-compressed -1.5% +0.0% -1.6% +10.2% ➖ noise
40 datafusion:vortex-file-compressed -1.1% +1.7% -2.7% +10.0% ➖ noise
40 duckdb:duckdb +5.5% +1.7% +3.8% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -13.2% +1.7% -14.7% +10.0% ✅ faster
41 datafusion:vortex-file-compressed +7.6% +2.5% +5.0% +11.2% ➖ noise
41 duckdb:duckdb +3.6% +2.5% +1.1% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -16.6% +2.5% -18.6% +10.4% ✅ faster
42 datafusion:vortex-file-compressed +2.7% -0.0% +2.7% +10.0% ➖ noise
42 duckdb:duckdb +6.6% -0.0% +6.6% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -1.1% -0.0% -1.1% +10.0% ➖ noise

@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 16, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 16, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +22.5%
Vortex (geomean): 1.161x ➖
Parquet (geomean): 0.947x ➖
Shifts: Parquet (control) -5.3% · Median polish -0.4%


datafusion / vortex-file-compressed (1.028x ➖, 1↑ 1↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 33650333 48439813 0.69
fineweb_q01/datafusion:vortex-file-compressed 542848434 541767404 1.00
fineweb_q02/datafusion:vortex-file-compressed 527121220 522416134 1.01
fineweb_q03/datafusion:vortex-file-compressed 1399238512 1373535712 1.02
fineweb_q04/datafusion:vortex-file-compressed 1405580297 1381640654 1.02
fineweb_q05/datafusion:vortex-file-compressed 1366640703 1361420543 1.00
fineweb_q06/datafusion:vortex-file-compressed 1521710304 1487720470 1.02
fineweb_q07/datafusion:vortex-file-compressed 1614670701 1325326627 1.22
fineweb_q08/datafusion:vortex-file-compressed 🚨 754339864 537471515 1.40
datafusion / vortex-compact (0.845x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 33846105 41097940 0.82
fineweb_q01/datafusion:vortex-compact 487688338 611982397 0.80
fineweb_q02/datafusion:vortex-compact 602597828 763171137 0.79
fineweb_q03/datafusion:vortex-compact 1436442778 1873382011 0.77
fineweb_q04/datafusion:vortex-compact 1725835890 2261638602 0.76
fineweb_q05/datafusion:vortex-compact 1435703563 1748843239 0.82
fineweb_q06/datafusion:vortex-compact 1320869839 1466238902 0.90
fineweb_q07/datafusion:vortex-compact 1210086648 1324991613 0.91
fineweb_q08/datafusion:vortex-compact 425635608 396557956 1.07
datafusion / parquet (0.904x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1156568150 1505890534 0.77
fineweb_q01/datafusion:parquet 1831951512 2078649663 0.88
fineweb_q02/datafusion:parquet 1779388615 2158887412 0.82
fineweb_q03/datafusion:parquet 1891798271 1931608853 0.98
fineweb_q04/datafusion:parquet 2052258560 2175001894 0.94
fineweb_q05/datafusion:parquet 1835989082 2133050710 0.86
fineweb_q06/datafusion:parquet 1817412303 2007041867 0.91
fineweb_q07/datafusion:parquet 1872794784 1953198380 0.96
fineweb_q08/datafusion:parquet 2002583566 1916792742 1.04
duckdb / vortex-file-compressed (1.492x ❌, 0↑ 7↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 96586110 108206355 0.89
fineweb_q01/duckdb:vortex-file-compressed 633870608 612756738 1.03
fineweb_q02/duckdb:vortex-file-compressed 🚨 648304158 477818147 1.36
fineweb_q03/duckdb:vortex-file-compressed 🚨 2592983546 1555437475 1.67
fineweb_q04/duckdb:vortex-file-compressed 🚨 2690270051 1435930889 1.87
fineweb_q05/duckdb:vortex-file-compressed 🚨 2708295026 1476573995 1.83
fineweb_q06/duckdb:vortex-file-compressed 🚨 2674641120 1793038477 1.49
fineweb_q07/duckdb:vortex-file-compressed 🚨 2101596844 1443641421 1.46
fineweb_q08/duckdb:vortex-file-compressed 🚨 1815895268 771826719 2.35
duckdb / vortex-compact (1.400x ❌, 0↑ 6↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 101666112 128060245 0.79
fineweb_q01/duckdb:vortex-compact 614514595 660935288 0.93
fineweb_q02/duckdb:vortex-compact 644879562 552321426 1.17
fineweb_q03/duckdb:vortex-compact 🚨 2683987077 1567860962 1.71
fineweb_q04/duckdb:vortex-compact 🚨 2494798846 1726256171 1.45
fineweb_q05/duckdb:vortex-compact 🚨 2273160988 1469398665 1.55
fineweb_q06/duckdb:vortex-compact 🚨 2302112726 1454494883 1.58
fineweb_q07/duckdb:vortex-compact 🚨 2005650856 1350606363 1.49
fineweb_q08/duckdb:vortex-compact 🚨 1303032142 488392397 2.67
duckdb / parquet (0.993x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1152871238 1194776504 0.96
fineweb_q01/duckdb:parquet 1651571679 1721733957 0.96
fineweb_q02/duckdb:parquet 1655750963 1616988729 1.02
fineweb_q03/duckdb:parquet 4245240976 4085100351 1.04
fineweb_q04/duckdb:parquet 1860204105 1959637609 0.95
fineweb_q05/duckdb:parquet 2729110598 2818766937 0.97
fineweb_q06/duckdb:parquet 3515614473 3546276142 0.99
fineweb_q07/duckdb:parquet 4215232700 4294051029 0.98
fineweb_q08/duckdb:parquet 1163163268 1094667164 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -17.6% -13.9% -4.3% +207.3% ➖ noise
0 datafusion:vortex-file-compressed -30.5% -13.9% -19.3% +164.4% ➖ noise
0 duckdb:vortex-compact -20.6% -13.9% -7.8% +31.6% ➖ noise
0 duckdb:vortex-file-compressed -10.7% -13.9% +3.7% +30.0% ➖ noise
1 datafusion:vortex-compact -20.3% -8.1% -13.3% +48.4% ➖ noise
1 datafusion:vortex-file-compressed +0.2% -8.1% +9.0% +48.3% ➖ noise
1 duckdb:vortex-compact -7.0% -8.1% +1.1% +45.4% ➖ noise
1 duckdb:vortex-file-compressed +3.4% -8.1% +12.5% +30.0% ➖ noise
2 datafusion:vortex-compact -21.0% -8.1% -14.1% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +0.9% -8.1% +9.8% +38.3% ➖ noise
2 duckdb:vortex-compact +16.8% -8.1% +27.1% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +35.7% -8.1% +47.7% +32.3% 🚨 regression
3 datafusion:vortex-compact -23.3% +0.9% -24.0% +30.0% ✅ faster
3 datafusion:vortex-file-compressed +1.9% +0.9% +1.0% +30.0% ➖ noise
3 duckdb:vortex-compact +71.2% +0.9% +69.7% +30.0% 🚨 regression
3 duckdb:vortex-file-compressed +66.7% +0.9% +65.2% +30.0% 🚨 regression
4 datafusion:vortex-compact -23.7% -5.4% -19.4% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +1.7% -5.4% +7.5% +30.0% ➖ noise
4 duckdb:vortex-compact +44.5% -5.4% +52.7% +30.0% 🚨 regression
4 duckdb:vortex-file-compressed +87.4% -5.4% +98.0% +30.0% 🚨 regression
5 datafusion:vortex-compact -17.9% -8.7% -10.1% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +0.4% -8.7% +10.0% +30.0% ➖ noise
5 duckdb:vortex-compact +54.7% -8.7% +69.5% +30.0% 🚨 regression
5 duckdb:vortex-file-compressed +83.4% -8.7% +100.9% +30.0% 🚨 regression
6 datafusion:vortex-compact -9.9% -5.3% -4.9% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +2.3% -5.3% +8.0% +30.0% ➖ noise
6 duckdb:vortex-compact +58.3% -5.3% +67.1% +30.0% 🚨 regression
6 duckdb:vortex-file-compressed +49.2% -5.3% +57.4% +30.0% 🚨 regression
7 datafusion:vortex-compact -8.7% -3.0% -5.9% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +21.8% -3.0% +25.6% +30.0% ➖ noise
7 duckdb:vortex-compact +48.5% -3.0% +53.1% +30.0% 🚨 regression
7 duckdb:vortex-file-compressed +45.6% -3.0% +50.1% +30.0% 🚨 regression
8 datafusion:vortex-compact +7.3% +5.4% +1.9% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +40.3% +5.4% +33.2% +30.0% 🚨 regression
8 duckdb:vortex-compact +166.8% +5.4% +153.2% +30.0% 🚨 regression
8 duckdb:vortex-file-compressed +135.3% +5.4% +123.3% +30.0% 🚨 regression

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.9%
Vortex (geomean): 0.983x ➖
Parquet (geomean): 0.929x ➖
Shifts: Parquet (control) -7.1% · Median polish -6.1%


datafusion / vortex-file-compressed (0.947x ➖, 2↑ 1↓)
name PR cbaab6f (ns) base 43ae2dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 759961351 767782107 0.99
tpch_q02/datafusion:vortex-file-compressed 825634562 928711375 0.89
tpch_q03/datafusion:vortex-file-compressed 848766723 1038182231 0.82
tpch_q04/datafusion:vortex-file-compressed 675508258 822991206 0.82
tpch_q05/datafusion:vortex-file-compressed 1180290270 1318708434 0.90
tpch_q06/datafusion:vortex-file-compressed 641239866 816401772 0.79
tpch_q07/datafusion:vortex-file-compressed 1128729379 1308922718 0.86
tpch_q08/datafusion:vortex-file-compressed 1496539247 1381759530 1.08
tpch_q09/datafusion:vortex-file-compressed 1512095147 1740872011 0.87
tpch_q10/datafusion:vortex-file-compressed 964635744 1106403548 0.87
tpch_q11/datafusion:vortex-file-compressed 574321256 609085442 0.94
tpch_q12/datafusion:vortex-file-compressed 1156266850 1013740113 1.14
tpch_q13/datafusion:vortex-file-compressed 576636010 508340094 1.13
tpch_q14/datafusion:vortex-file-compressed 669213327 658632973 1.02
tpch_q15/datafusion:vortex-file-compressed 1366214216 1112370047 1.23
tpch_q16/datafusion:vortex-file-compressed 🚨 610440526 357183768 1.71
tpch_q17/datafusion:vortex-file-compressed 1336703767 1307314352 1.02
tpch_q18/datafusion:vortex-file-compressed 1500238298 1436828359 1.04
tpch_q19/datafusion:vortex-file-compressed 🚀 728916315 1053650040 0.69
tpch_q20/datafusion:vortex-file-compressed 1048124675 1182690251 0.89
tpch_q21/datafusion:vortex-file-compressed 1824830381 2125776619 0.86
tpch_q22/datafusion:vortex-file-compressed 🚀 481645217 688134139 0.70
datafusion / vortex-compact (0.865x ➖, 2↑ 0↓)
name PR cbaab6f (ns) base 43ae2dc (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 860081664 751941085 1.14
tpch_q02/datafusion:vortex-compact 1544290811 1263702779 1.22
tpch_q03/datafusion:vortex-compact 832320154 979662733 0.85
tpch_q04/datafusion:vortex-compact 555144062 727104240 0.76
tpch_q05/datafusion:vortex-compact 984347844 1031388884 0.95
tpch_q06/datafusion:vortex-compact 608021387 688417750 0.88
tpch_q07/datafusion:vortex-compact 1152537185 1365432638 0.84
tpch_q08/datafusion:vortex-compact 1119512703 1420512038 0.79
tpch_q09/datafusion:vortex-compact 1355220073 1625653807 0.83
tpch_q10/datafusion:vortex-compact 🚀 916318178 1614280525 0.57
tpch_q11/datafusion:vortex-compact 🚀 403944009 609687058 0.66
tpch_q12/datafusion:vortex-compact 863380666 1046389631 0.83
tpch_q13/datafusion:vortex-compact 462806854 535560271 0.86
tpch_q14/datafusion:vortex-compact 625316983 687085243 0.91
tpch_q15/datafusion:vortex-compact 1074394323 1191813910 0.90
tpch_q16/datafusion:vortex-compact 333315498 445931864 0.75
tpch_q17/datafusion:vortex-compact 1232810883 1408674883 0.88
tpch_q18/datafusion:vortex-compact 1236428862 1280325094 0.97
tpch_q19/datafusion:vortex-compact 765840361 783209758 0.98
tpch_q20/datafusion:vortex-compact 1004698988 1131258221 0.89
tpch_q21/datafusion:vortex-compact 1541287532 1641588440 0.94
tpch_q22/datafusion:vortex-compact 396453688 467935262 0.85
datafusion / parquet (0.872x ➖, 3↑ 0↓)
name PR cbaab6f (ns) base 43ae2dc (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 861335243 860538257 1.00
tpch_q02/datafusion:parquet 870326470 772541975 1.13
tpch_q03/datafusion:parquet 1000985292 1061260076 0.94
tpch_q04/datafusion:parquet 501708506 516092147 0.97
tpch_q05/datafusion:parquet 1297290846 1415721404 0.92
tpch_q06/datafusion:parquet 550771540 519664892 1.06
tpch_q07/datafusion:parquet 1497832481 1475322323 1.02
tpch_q08/datafusion:parquet 1660763356 1917912859 0.87
tpch_q09/datafusion:parquet 1844566041 1972864132 0.93
tpch_q10/datafusion:parquet 🚀 2223813794 3683054825 0.60
tpch_q11/datafusion:parquet 879013037 928164936 0.95
tpch_q12/datafusion:parquet 740456196 948674670 0.78
tpch_q13/datafusion:parquet 666689573 885843435 0.75
tpch_q14/datafusion:parquet 851931190 961322914 0.89
tpch_q15/datafusion:parquet 1201890259 1423086767 0.84
tpch_q16/datafusion:parquet 🚀 583348752 833744692 0.70
tpch_q17/datafusion:parquet 1401328642 1592878334 0.88
tpch_q18/datafusion:parquet 1615201104 1755765422 0.92
tpch_q19/datafusion:parquet 1007595447 1225511974 0.82
tpch_q20/datafusion:parquet 1280700983 1470613922 0.87
tpch_q21/datafusion:parquet 1815207270 2007391009 0.90
tpch_q22/datafusion:parquet 🚀 687090988 1066985918 0.64
duckdb / vortex-file-compressed (1.111x ➖, 0↑ 2↓)
name PR cbaab6f (ns) base 43ae2dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 633290182 643915605 0.98
tpch_q02/duckdb:vortex-file-compressed 1187646742 1118769391 1.06
tpch_q03/duckdb:vortex-file-compressed 953792204 969358209 0.98
tpch_q04/duckdb:vortex-file-compressed 712543397 657394373 1.08
tpch_q05/duckdb:vortex-file-compressed 1178721853 1207721641 0.98
tpch_q06/duckdb:vortex-file-compressed 851391894 816093905 1.04
tpch_q07/duckdb:vortex-file-compressed 1179703909 1192451757 0.99
tpch_q08/duckdb:vortex-file-compressed 1600699453 1607181598 1.00
tpch_q09/duckdb:vortex-file-compressed 1594095310 1634766052 0.98
tpch_q10/duckdb:vortex-file-compressed 1927470663 1483668610 1.30
tpch_q11/duckdb:vortex-file-compressed 738297552 692506682 1.07
tpch_q12/duckdb:vortex-file-compressed 783717441 760862238 1.03
tpch_q13/duckdb:vortex-file-compressed 🚨 1480537724 947931747 1.56
tpch_q14/duckdb:vortex-file-compressed 1122100633 914511020 1.23
tpch_q15/duckdb:vortex-file-compressed 🚨 715307933 532768115 1.34
tpch_q16/duckdb:vortex-file-compressed 467459936 418488942 1.12
tpch_q17/duckdb:vortex-file-compressed 1136723348 1070794371 1.06
tpch_q18/duckdb:vortex-file-compressed 1212604957 1056388775 1.15
tpch_q19/duckdb:vortex-file-compressed 918837824 739782007 1.24
tpch_q20/duckdb:vortex-file-compressed 1583164269 1329585218 1.19
tpch_q21/duckdb:vortex-file-compressed 2132015226 2116376241 1.01
tpch_q22/duckdb:vortex-file-compressed 889190372 716559323 1.24
duckdb / vortex-compact (1.029x ➖, 0↑ 1↓)
name PR cbaab6f (ns) base 43ae2dc (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 693871987 619028770 1.12
tpch_q02/duckdb:vortex-compact 1004002780 1034848456 0.97
tpch_q03/duckdb:vortex-compact 890756441 858044712 1.04
tpch_q04/duckdb:vortex-compact 555466688 529072382 1.05
tpch_q05/duckdb:vortex-compact 1107777772 1149481873 0.96
tpch_q06/duckdb:vortex-compact 826400679 1028819632 0.80
tpch_q07/duckdb:vortex-compact 1046170718 1015476563 1.03
tpch_q08/duckdb:vortex-compact 1363893721 1571888906 0.87
tpch_q09/duckdb:vortex-compact 1420668169 1313475002 1.08
tpch_q10/duckdb:vortex-compact 1637309898 1326761852 1.23
tpch_q11/duckdb:vortex-compact 683037795 793628046 0.86
tpch_q12/duckdb:vortex-compact 724725931 691827534 1.05
tpch_q13/duckdb:vortex-compact 🚨 1404082014 893051189 1.57
tpch_q14/duckdb:vortex-compact 855347779 813412340 1.05
tpch_q15/duckdb:vortex-compact 595747104 698048801 0.85
tpch_q16/duckdb:vortex-compact 398608905 465412317 0.86
tpch_q17/duckdb:vortex-compact 883246903 828848219 1.07
tpch_q18/duckdb:vortex-compact 837521466 773924981 1.08
tpch_q19/duckdb:vortex-compact 767042076 711798005 1.08
tpch_q20/duckdb:vortex-compact 1520474261 1402331208 1.08
tpch_q21/duckdb:vortex-compact 1751228849 1742632207 1.00
tpch_q22/duckdb:vortex-compact 806593252 695186923 1.16
duckdb / parquet (0.990x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base 43ae2dc (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1183700473 1026339480 1.15
tpch_q02/duckdb:parquet 1590074507 1688826495 0.94
tpch_q03/duckdb:parquet 1800394330 1803113343 1.00
tpch_q04/duckdb:parquet 1036769726 1101449978 0.94
tpch_q05/duckdb:parquet 2429522756 2393299478 1.02
tpch_q06/duckdb:parquet 814091506 967435256 0.84
tpch_q07/duckdb:parquet 1907873957 1669286601 1.14
tpch_q08/duckdb:parquet 2470732961 2686528546 0.92
tpch_q09/duckdb:parquet 2287546805 2862992548 0.80
tpch_q10/duckdb:parquet 3364155683 3383940167 0.99
tpch_q11/duckdb:parquet 1090564325 1053521855 1.04
tpch_q12/duckdb:parquet 1112351041 888320928 1.25
tpch_q13/duckdb:parquet 1338231273 1242314567 1.08
tpch_q14/duckdb:parquet 1322984805 1200620982 1.10
tpch_q15/duckdb:parquet 864424043 982040495 0.88
tpch_q16/duckdb:parquet 755022084 806985521 0.94
tpch_q17/duckdb:parquet 1339584896 1333902484 1.00
tpch_q18/duckdb:parquet 1381581172 1449335387 0.95
tpch_q19/duckdb:parquet 1600152224 1672042186 0.96
tpch_q20/duckdb:parquet 1793294582 1923014036 0.93
tpch_q21/duckdb:parquet 1970744600 2010445039 0.98
tpch_q22/duckdb:parquet 1038467396 1007605609 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +14.4% +7.4% +6.5% +78.4% ➖ noise
1 datafusion:vortex-file-compressed -1.0% +7.4% -7.9% +57.1% ➖ noise
1 duckdb:vortex-compact +12.1% +7.4% +4.3% +39.8% ➖ noise
1 duckdb:vortex-file-compressed -1.7% +7.4% -8.5% +42.6% ➖ noise
2 datafusion:vortex-compact +22.2% +3.0% +18.7% +49.4% ➖ noise
2 datafusion:vortex-file-compressed -11.1% +3.0% -13.7% +47.8% ➖ noise
2 duckdb:vortex-compact -3.0% +3.0% -5.8% +44.1% ➖ noise
2 duckdb:vortex-file-compressed +6.2% +3.0% +3.1% +44.6% ➖ noise
3 datafusion:vortex-compact -15.0% -3.0% -12.5% +69.2% ➖ noise
3 datafusion:vortex-file-compressed -18.2% -3.0% -15.8% +72.5% ➖ noise
3 duckdb:vortex-compact +3.8% -3.0% +7.0% +48.0% ➖ noise
3 duckdb:vortex-file-compressed -1.6% -3.0% +1.4% +66.8% ➖ noise
4 datafusion:vortex-compact -23.7% -4.3% -20.2% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -17.9% -4.3% -14.2% +41.3% ➖ noise
4 duckdb:vortex-compact +5.0% -4.3% +9.8% +42.9% ➖ noise
4 duckdb:vortex-file-compressed +8.4% -4.3% +13.3% +35.8% ➖ noise
5 datafusion:vortex-compact -4.6% -3.6% -1.0% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -10.5% -3.6% -7.2% +30.0% ➖ noise
5 duckdb:vortex-compact -3.6% -3.6% -0.1% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -2.4% -3.6% +1.2% +30.0% ➖ noise
6 datafusion:vortex-compact -11.7% -5.6% -6.5% +50.4% ➖ noise
6 datafusion:vortex-file-compressed -21.5% -5.6% -16.8% +30.0% ➖ noise
6 duckdb:vortex-compact -19.7% -5.6% -14.9% +39.6% ➖ noise
6 duckdb:vortex-file-compressed +4.3% -5.6% +10.5% +30.0% ➖ noise
7 datafusion:vortex-compact -15.6% +7.7% -21.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -13.8% +7.7% -19.9% +30.0% ➖ noise
7 duckdb:vortex-compact +3.0% +7.7% -4.4% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -1.1% +7.7% -8.2% +30.0% ➖ noise
8 datafusion:vortex-compact -21.2% -10.8% -11.7% +38.7% ➖ noise
8 datafusion:vortex-file-compressed +8.3% -10.8% +21.4% +39.3% ➖ noise
8 duckdb:vortex-compact -13.2% -10.8% -2.8% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -0.4% -10.8% +11.6% +32.5% ➖ noise
9 datafusion:vortex-compact -16.6% -13.6% -3.5% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -13.1% -13.6% +0.5% +56.5% ➖ noise
9 duckdb:vortex-compact +8.2% -13.6% +25.1% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -2.5% -13.6% +12.8% +34.9% ➖ noise
10 datafusion:vortex-compact -43.2% -22.5% -26.7% +54.4% ➖ noise
10 datafusion:vortex-file-compressed -12.8% -22.5% +12.5% +30.0% ➖ noise
10 duckdb:vortex-compact +23.4% -22.5% +59.3% +43.6% 🚨 regression
10 duckdb:vortex-file-compressed +29.9% -22.5% +67.7% +64.5% 🚨 regression
11 datafusion:vortex-compact -33.7% -1.0% -33.1% +30.0% ✅ faster
11 datafusion:vortex-file-compressed -5.7% -1.0% -4.8% +39.7% ➖ noise
11 duckdb:vortex-compact -13.9% -1.0% -13.1% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +6.6% -1.0% +7.7% +30.0% ➖ noise
12 datafusion:vortex-compact -17.5% -1.1% -16.5% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +14.1% -1.1% +15.4% +30.0% ➖ noise
12 duckdb:vortex-compact +4.8% -1.1% +6.0% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +3.0% -1.1% +4.2% +34.6% ➖ noise
13 datafusion:vortex-compact -13.6% -10.0% -4.0% +35.2% ➖ noise
13 datafusion:vortex-file-compressed +13.4% -10.0% +26.0% +38.0% ➖ noise
13 duckdb:vortex-compact +57.2% -10.0% +74.6% +58.2% 🚨 regression
13 duckdb:vortex-file-compressed +56.2% -10.0% +73.5% +59.5% 🚨 regression
14 datafusion:vortex-compact -9.0% -1.2% -7.9% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +1.6% -1.2% +2.8% +32.0% ➖ noise
14 duckdb:vortex-compact +5.2% -1.2% +6.4% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +22.7% -1.2% +24.2% +30.0% ➖ noise
15 datafusion:vortex-compact -9.9% -13.8% +4.6% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +22.8% -13.8% +42.4% +30.0% 🚨 regression
15 duckdb:vortex-compact -14.7% -13.8% -1.0% +34.4% ➖ noise
15 duckdb:vortex-file-compressed +34.3% -13.8% +55.7% +30.0% 🚨 regression
16 datafusion:vortex-compact -25.3% -19.1% -7.6% +41.6% ➖ noise
16 datafusion:vortex-file-compressed +70.9% -19.1% +111.2% +78.5% 🚨 regression
16 duckdb:vortex-compact -14.4% -19.1% +5.9% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +11.7% -19.1% +38.1% +30.0% 🚨 regression
17 datafusion:vortex-compact -12.5% -6.0% -6.9% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +2.2% -6.0% +8.8% +30.0% ➖ noise
17 duckdb:vortex-compact +6.6% -6.0% +13.4% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +6.2% -6.0% +12.9% +30.0% ➖ noise
18 datafusion:vortex-compact -3.4% -6.4% +3.1% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +4.4% -6.4% +11.5% +30.0% ➖ noise
18 duckdb:vortex-compact +8.2% -6.4% +15.6% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +14.8% -6.4% +22.6% +30.0% ➖ noise
19 datafusion:vortex-compact -2.2% -11.3% +10.2% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -30.8% -11.3% -22.0% +46.0% ➖ noise
19 duckdb:vortex-compact +7.8% -11.3% +21.5% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +24.2% -11.3% +40.0% +30.0% 🚨 regression
20 datafusion:vortex-compact -11.2% -9.9% -1.4% +33.3% ➖ noise
20 datafusion:vortex-file-compressed -11.4% -9.9% -1.7% +30.0% ➖ noise
20 duckdb:vortex-compact +8.4% -9.9% +20.3% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +19.1% -9.9% +32.1% +30.0% 🚨 regression
21 datafusion:vortex-compact -6.1% -5.9% -0.3% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -14.2% -5.9% -8.8% +31.0% ➖ noise
21 duckdb:vortex-compact +0.5% -5.9% +6.7% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +0.7% -5.9% +7.0% +30.0% ➖ noise
22 datafusion:vortex-compact -15.3% -18.5% +4.0% +30.0% ➖ noise
22 datafusion:vortex-file-compressed -30.0% -18.5% -14.1% +30.0% ➖ noise
22 duckdb:vortex-compact +16.0% -18.5% +42.4% +30.0% 🚨 regression
22 duckdb:vortex-file-compressed +24.1% -18.5% +52.3% +30.6% 🚨 regression

@danking
Copy link
Contributor

danking commented Mar 16, 2026

Do you think the vortex-compact improvements are from more parallelism in decompression?

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Vortex (geomean): 0.994x ➖
Parquet (geomean): 1.009x ➖
Shifts: Parquet (control) +0.9% · Median polish +0.5%


duckdb / vortex-file-compressed (1.006x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10743457 11228980 0.96
statpopgen_q01/duckdb:vortex-file-compressed 18713664 18611901 1.01
statpopgen_q02/duckdb:vortex-file-compressed 1287153009 1282440657 1.00
statpopgen_q03/duckdb:vortex-file-compressed 3104688332 3029092211 1.02
statpopgen_q04/duckdb:vortex-file-compressed 3078143591 3075336264 1.00
statpopgen_q05/duckdb:vortex-file-compressed 1390932684 1374965695 1.01
statpopgen_q06/duckdb:vortex-file-compressed 2046773226 2048201507 1.00
statpopgen_q07/duckdb:vortex-file-compressed 200360654 193670569 1.03
statpopgen_q08/duckdb:vortex-file-compressed 218572818 209308408 1.04
statpopgen_q09/duckdb:vortex-file-compressed 2777820545 2846987937 0.98
statpopgen_q10/duckdb:vortex-file-compressed 4624762289 4583178775 1.01
duckdb / vortex-compact (0.982x ➖, 1↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10672382 10756813 0.99
statpopgen_q01/duckdb:vortex-compact 🚀 124735727 166072441 0.75
statpopgen_q02/duckdb:vortex-compact 1797253394 1808996320 0.99
statpopgen_q03/duckdb:vortex-compact 3517797282 3420127349 1.03
statpopgen_q04/duckdb:vortex-compact 3543586367 3553793476 1.00
statpopgen_q05/duckdb:vortex-compact 1840452296 1817283658 1.01
statpopgen_q06/duckdb:vortex-compact 2677373604 2666755680 1.00
statpopgen_q07/duckdb:vortex-compact 964280068 942085085 1.02
statpopgen_q08/duckdb:vortex-compact 1003417324 977897052 1.03
statpopgen_q09/duckdb:vortex-compact 3328479621 3333001375 1.00
statpopgen_q10/duckdb:vortex-compact 5412285700 5325541440 1.02
duckdb / parquet (1.009x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 319140725 312845111 1.02
statpopgen_q01/duckdb:parquet 405320567 390455382 1.04
statpopgen_q02/duckdb:parquet 1001145523 971472678 1.03
statpopgen_q03/duckdb:parquet 1508875365 1510155111 1.00
statpopgen_q04/duckdb:parquet 1518454129 1513089770 1.00
statpopgen_q05/duckdb:parquet 1000844209 1011405320 0.99
statpopgen_q06/duckdb:parquet 1483714367 1485819259 1.00
statpopgen_q07/duckdb:parquet 1864798701 1878182472 0.99
statpopgen_q08/duckdb:parquet 1897783653 1881403569 1.01
statpopgen_q09/duckdb:parquet 1389405506 1358600652 1.02
statpopgen_q10/duckdb:parquet 2679422490 2674784884 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -0.8% +2.0% -2.7% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -4.3% +2.0% -6.2% +14.5% ➖ noise
1 duckdb:vortex-compact -24.9% +3.8% -27.6% +46.7% ➖ noise
1 duckdb:vortex-file-compressed +0.5% +3.8% -3.1% +215.5% ➖ noise
2 duckdb:vortex-compact -0.6% +3.1% -3.6% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.4% +3.1% -2.6% +10.0% ➖ noise
3 duckdb:vortex-compact +2.9% -0.1% +2.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +2.5% -0.1% +2.6% +10.0% ➖ noise
4 duckdb:vortex-compact -0.3% +0.4% -0.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.1% +0.4% -0.3% +10.0% ➖ noise
5 duckdb:vortex-compact +1.3% -1.0% +2.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.2% -1.0% +2.2% +10.0% ➖ noise
6 duckdb:vortex-compact +0.4% -0.1% +0.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.1% -0.1% +0.1% +10.0% ➖ noise
7 duckdb:vortex-compact +2.4% -0.7% +3.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +3.5% -0.7% +4.2% +10.0% ➖ noise
8 duckdb:vortex-compact +2.6% +0.9% +1.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +4.4% +0.9% +3.5% +10.0% ➖ noise
9 duckdb:vortex-compact -0.1% +2.3% -2.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.4% +2.3% -4.6% +10.0% ➖ noise
10 duckdb:vortex-compact +1.6% +0.2% +1.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.9% +0.2% +0.7% +10.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.7%
Vortex (geomean): 0.946x ➖
Parquet (geomean): 0.962x ➖
Shifts: Parquet (control) -3.8% · Median polish -1.8%


datafusion / vortex-file-compressed (0.885x ➖, 6↑ 3↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 192853625 192250993 1.00
tpch_q02/datafusion:vortex-file-compressed 549367136 423009227 1.30
tpch_q03/datafusion:vortex-file-compressed 🚨 421482713 312356733 1.35
tpch_q04/datafusion:vortex-file-compressed 267793302 212076690 1.26
tpch_q05/datafusion:vortex-file-compressed 🚀 516121528 829061145 0.62
tpch_q06/datafusion:vortex-file-compressed 🚀 316520338 570230862 0.56
tpch_q07/datafusion:vortex-file-compressed 🚀 477737547 959498778 0.50
tpch_q08/datafusion:vortex-file-compressed 🚀 687474520 982730458 0.70
tpch_q09/datafusion:vortex-file-compressed 586681235 672016045 0.87
tpch_q10/datafusion:vortex-file-compressed 🚀 532698330 936365133 0.57
tpch_q11/datafusion:vortex-file-compressed 421811967 535037505 0.79
tpch_q12/datafusion:vortex-file-compressed 423079676 538668007 0.79
tpch_q13/datafusion:vortex-file-compressed 227180376 254265420 0.89
tpch_q14/datafusion:vortex-file-compressed 🚨 262098089 201339237 1.30
tpch_q15/datafusion:vortex-file-compressed 388370565 394191413 0.99
tpch_q16/datafusion:vortex-file-compressed 175533769 239878075 0.73
tpch_q17/datafusion:vortex-file-compressed 380800158 328599377 1.16
tpch_q18/datafusion:vortex-file-compressed 🚨 450009110 319254754 1.41
tpch_q19/datafusion:vortex-file-compressed 442871921 357664304 1.24
tpch_q20/datafusion:vortex-file-compressed 407783945 385768153 1.06
tpch_q21/datafusion:vortex-file-compressed 560805669 605411059 0.93
tpch_q22/datafusion:vortex-file-compressed 🚀 192570585 387163625 0.50
datafusion / vortex-compact (0.880x ➖, 4↑ 1↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀 244375315 534314923 0.46
tpch_q02/datafusion:vortex-compact 🚀 611917921 892475890 0.69
tpch_q03/datafusion:vortex-compact 🚀 405357905 840134935 0.48
tpch_q04/datafusion:vortex-compact 304613675 424464205 0.72
tpch_q05/datafusion:vortex-compact 376276829 407689209 0.92
tpch_q06/datafusion:vortex-compact 291362431 304295220 0.96
tpch_q07/datafusion:vortex-compact 387692147 506961573 0.76
tpch_q08/datafusion:vortex-compact 532911642 740596131 0.72
tpch_q09/datafusion:vortex-compact 450121457 432818934 1.04
tpch_q10/datafusion:vortex-compact 🚀 521554958 774228743 0.67
tpch_q11/datafusion:vortex-compact 320154536 409283642 0.78
tpch_q12/datafusion:vortex-compact 491882194 547223922 0.90
tpch_q13/datafusion:vortex-compact 215651497 238218736 0.91
tpch_q14/datafusion:vortex-compact 299040475 279067838 1.07
tpch_q15/datafusion:vortex-compact 493934065 488177051 1.01
tpch_q16/datafusion:vortex-compact 199809011 180132519 1.11
tpch_q17/datafusion:vortex-compact 341069030 338626991 1.01
tpch_q18/datafusion:vortex-compact 325482781 344673164 0.94
tpch_q19/datafusion:vortex-compact 454240511 414205191 1.10
tpch_q20/datafusion:vortex-compact 610237347 527759613 1.16
tpch_q21/datafusion:vortex-compact 647499413 564971216 1.15
tpch_q22/datafusion:vortex-compact 🚨 212646749 139030467 1.53
datafusion / parquet (0.898x ➖, 3↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 213374632 251842484 0.85
tpch_q02/datafusion:parquet 528341453 461077832 1.15
tpch_q03/datafusion:parquet 364268893 421644026 0.86
tpch_q04/datafusion:parquet 215179507 204018030 1.05
tpch_q05/datafusion:parquet 572248692 645668680 0.89
tpch_q06/datafusion:parquet 🚀 139637868 306493527 0.46
tpch_q07/datafusion:parquet 🚀 571867718 932373200 0.61
tpch_q08/datafusion:parquet 🚀 733519980 1163981274 0.63
tpch_q09/datafusion:parquet 557260984 682643844 0.82
tpch_q10/datafusion:parquet 667544931 668620129 1.00
tpch_q11/datafusion:parquet 390312474 389797176 1.00
tpch_q12/datafusion:parquet 286194852 342887549 0.83
tpch_q13/datafusion:parquet 479906113 453675737 1.06
tpch_q14/datafusion:parquet 257318048 243120789 1.06
tpch_q15/datafusion:parquet 340452362 366357716 0.93
tpch_q16/datafusion:parquet 193826967 197407951 0.98
tpch_q17/datafusion:parquet 464665538 458706474 1.01
tpch_q18/datafusion:parquet 588885600 512364915 1.15
tpch_q19/datafusion:parquet 383055001 426265270 0.90
tpch_q20/datafusion:parquet 381132716 365090277 1.04
tpch_q21/datafusion:parquet 664083567 586315658 1.13
tpch_q22/datafusion:parquet 120651936 154714370 0.78
duckdb / vortex-file-compressed (1.019x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 307438253 246541625 1.25
tpch_q02/duckdb:vortex-file-compressed 977103628 1045862095 0.93
tpch_q03/duckdb:vortex-file-compressed 596148592 613276764 0.97
tpch_q04/duckdb:vortex-file-compressed 395357443 391122095 1.01
tpch_q05/duckdb:vortex-file-compressed 943235778 960538722 0.98
tpch_q06/duckdb:vortex-file-compressed 467082573 524740595 0.89
tpch_q07/duckdb:vortex-file-compressed 842628017 978518081 0.86
tpch_q08/duckdb:vortex-file-compressed 910227988 892619592 1.02
tpch_q09/duckdb:vortex-file-compressed 933274103 938272633 0.99
tpch_q10/duckdb:vortex-file-compressed 778213754 716823827 1.09
tpch_q11/duckdb:vortex-file-compressed 524088164 474254654 1.11
tpch_q12/duckdb:vortex-file-compressed 470432333 536043834 0.88
tpch_q13/duckdb:vortex-file-compressed 585608607 470303407 1.25
tpch_q14/duckdb:vortex-file-compressed 545450189 518800561 1.05
tpch_q15/duckdb:vortex-file-compressed 260574464 318227265 0.82
tpch_q16/duckdb:vortex-file-compressed 358303809 350484131 1.02
tpch_q17/duckdb:vortex-file-compressed 630437301 620753168 1.02
tpch_q18/duckdb:vortex-file-compressed 534974849 562753545 0.95
tpch_q19/duckdb:vortex-file-compressed 521082482 404838363 1.29
tpch_q20/duckdb:vortex-file-compressed 908131083 802632325 1.13
tpch_q21/duckdb:vortex-file-compressed 1094179523 1099036250 1.00
tpch_q22/duckdb:vortex-file-compressed 351498937 326556046 1.08
duckdb / vortex-compact (1.008x ➖, 0↑ 0↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 288777827 304561053 0.95
tpch_q02/duckdb:vortex-compact 996041650 930023246 1.07
tpch_q03/duckdb:vortex-compact 592093006 498859356 1.19
tpch_q04/duckdb:vortex-compact 360969980 375851891 0.96
tpch_q05/duckdb:vortex-compact 873037223 891156432 0.98
tpch_q06/duckdb:vortex-compact 467024233 410652346 1.14
tpch_q07/duckdb:vortex-compact 690391028 872210552 0.79
tpch_q08/duckdb:vortex-compact 885167722 918467622 0.96
tpch_q09/duckdb:vortex-compact 889928666 879244920 1.01
tpch_q10/duckdb:vortex-compact 693358823 726140746 0.95
tpch_q11/duckdb:vortex-compact 509126989 515551527 0.99
tpch_q12/duckdb:vortex-compact 429147256 440529036 0.97
tpch_q13/duckdb:vortex-compact 471390754 451675676 1.04
tpch_q14/duckdb:vortex-compact 557625008 482392556 1.16
tpch_q15/duckdb:vortex-compact 352516123 353919761 1.00
tpch_q16/duckdb:vortex-compact 313730611 302227936 1.04
tpch_q17/duckdb:vortex-compact 680895328 628979837 1.08
tpch_q18/duckdb:vortex-compact 483143028 556654107 0.87
tpch_q19/duckdb:vortex-compact 508729511 444665514 1.14
tpch_q20/duckdb:vortex-compact 747305379 882524647 0.85
tpch_q21/duckdb:vortex-compact 1123364835 1078203097 1.04
tpch_q22/duckdb:vortex-compact 378788071 343079587 1.10
duckdb / parquet (1.032x ➖, 0↑ 1↓)
name PR cbaab6f (ns) base ea106e4 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 536271077 548317866 0.98
tpch_q02/duckdb:parquet 1391213897 1373522507 1.01
tpch_q03/duckdb:parquet 1091351242 1134479157 0.96
tpch_q04/duckdb:parquet 677706678 596878676 1.14
tpch_q05/duckdb:parquet 1624042196 1682368315 0.97
tpch_q06/duckdb:parquet 386084268 414369978 0.93
tpch_q07/duckdb:parquet 1422825051 1213772301 1.17
tpch_q08/duckdb:parquet 1793293401 1777790388 1.01
tpch_q09/duckdb:parquet 1570523077 1465675767 1.07
tpch_q10/duckdb:parquet 1341192446 1586351329 0.85
tpch_q11/duckdb:parquet 833877692 816377039 1.02
tpch_q12/duckdb:parquet 611295130 584339953 1.05
tpch_q13/duckdb:parquet 937685153 881384130 1.06
tpch_q14/duckdb:parquet 🚨 753017759 544757749 1.38
tpch_q15/duckdb:parquet 548598183 563600472 0.97
tpch_q16/duckdb:parquet 525684406 540973355 0.97
tpch_q17/duckdb:parquet 859317330 870815076 0.99
tpch_q18/duckdb:parquet 933588951 811233780 1.15
tpch_q19/duckdb:parquet 859668054 862785433 1.00
tpch_q20/duckdb:parquet 1090046543 1089558282 1.00
tpch_q21/duckdb:parquet 1207107814 1186771527 1.02
tpch_q22/duckdb:parquet 527770340 469538537 1.12
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -54.3% -9.0% -49.8% +133.5% ➖ noise
1 datafusion:vortex-file-compressed +0.3% -9.0% +10.2% +143.6% ➖ noise
1 duckdb:vortex-compact -5.2% -9.0% +4.2% +46.0% ➖ noise
1 duckdb:vortex-file-compressed +24.7% -9.0% +37.0% +50.0% ➖ noise
2 datafusion:vortex-compact -31.4% +7.7% -36.4% +44.0% ✅ faster
2 datafusion:vortex-file-compressed +29.9% +7.7% +20.5% +40.2% ➖ noise
2 duckdb:vortex-compact +7.1% +7.7% -0.6% +40.0% ➖ noise
2 duckdb:vortex-file-compressed -6.6% +7.7% -13.3% +40.0% ➖ noise
3 datafusion:vortex-compact -51.8% -8.8% -47.1% +84.1% ✅ faster
3 datafusion:vortex-file-compressed +34.9% -8.8% +48.0% +80.4% ➖ noise
3 duckdb:vortex-compact +18.7% -8.8% +30.2% +40.0% ➖ noise
3 duckdb:vortex-file-compressed -2.8% -8.8% +6.6% +40.0% ➖ noise
4 datafusion:vortex-compact -28.2% +9.4% -34.4% +55.5% ➖ noise
4 datafusion:vortex-file-compressed +26.3% +9.4% +15.4% +46.8% ➖ noise
4 duckdb:vortex-compact -4.0% +9.4% -12.2% +40.0% ➖ noise
4 duckdb:vortex-file-compressed +1.1% +9.4% -7.6% +40.0% ➖ noise
5 datafusion:vortex-compact -7.7% -7.5% -0.2% +40.0% ➖ noise
5 datafusion:vortex-file-compressed -37.7% -7.5% -32.7% +57.3% ➖ noise
5 duckdb:vortex-compact -2.0% -7.5% +5.9% +40.0% ➖ noise
5 duckdb:vortex-file-compressed -1.8% -7.5% +6.2% +40.0% ➖ noise
6 datafusion:vortex-compact -4.3% -34.8% +47.0% +40.0% 🚨 regression
6 datafusion:vortex-file-compressed -44.5% -34.8% -14.8% +47.5% ➖ noise
6 duckdb:vortex-compact +13.7% -34.8% +74.6% +40.0% 🚨 regression
6 duckdb:vortex-file-compressed -11.0% -34.8% +36.6% +44.2% ➖ noise
7 datafusion:vortex-compact -23.5% -15.2% -9.8% +40.0% ➖ noise
7 datafusion:vortex-file-compressed -50.2% -15.2% -41.3% +40.0% ✅ faster
7 duckdb:vortex-compact -20.8% -15.2% -6.7% +40.0% ➖ noise
7 duckdb:vortex-file-compressed -13.9% -15.2% +1.6% +40.0% ➖ noise
8 datafusion:vortex-compact -28.0% -20.3% -9.7% +40.0% ➖ noise
8 datafusion:vortex-file-compressed -30.0% -20.3% -12.3% +40.0% ➖ noise
8 duckdb:vortex-compact -3.6% -20.3% +20.9% +40.0% ➖ noise
8 duckdb:vortex-file-compressed +2.0% -20.3% +27.9% +40.0% ➖ noise
9 datafusion:vortex-compact +4.0% -6.5% +11.2% +40.0% ➖ noise
9 datafusion:vortex-file-compressed -12.7% -6.5% -6.7% +40.0% ➖ noise
9 duckdb:vortex-compact +1.2% -6.5% +8.2% +40.0% ➖ noise
9 duckdb:vortex-file-compressed -0.5% -6.5% +6.4% +40.0% ➖ noise
10 datafusion:vortex-compact -32.6% -8.1% -26.7% +51.5% ➖ noise
10 datafusion:vortex-file-compressed -43.1% -8.1% -38.1% +40.0% ✅ faster
10 duckdb:vortex-compact -4.5% -8.1% +3.9% +40.0% ➖ noise
10 duckdb:vortex-file-compressed +8.6% -8.1% +18.2% +40.0% ➖ noise
11 datafusion:vortex-compact -21.8% +1.1% -22.7% +40.0% ➖ noise
11 datafusion:vortex-file-compressed -21.2% +1.1% -22.0% +40.0% ➖ noise
11 duckdb:vortex-compact -1.2% +1.1% -2.4% +40.0% ➖ noise
11 duckdb:vortex-file-compressed +10.5% +1.1% +9.3% +40.0% ➖ noise
12 datafusion:vortex-compact -10.1% -6.6% -3.8% +42.0% ➖ noise
12 datafusion:vortex-file-compressed -21.5% -6.6% -15.9% +41.8% ➖ noise
12 duckdb:vortex-compact -2.6% -6.6% +4.3% +40.0% ➖ noise
12 duckdb:vortex-file-compressed -12.2% -6.6% -6.1% +40.4% ➖ noise
13 datafusion:vortex-compact -9.5% +6.1% -14.7% +44.0% ➖ noise
13 datafusion:vortex-file-compressed -10.7% +6.1% -15.8% +75.9% ➖ noise
13 duckdb:vortex-compact +4.4% +6.1% -1.6% +40.0% ➖ noise
13 duckdb:vortex-file-compressed +24.5% +6.1% +17.4% +40.0% ➖ noise
14 datafusion:vortex-compact +7.2% +21.0% -11.4% +40.0% ➖ noise
14 datafusion:vortex-file-compressed +30.2% +21.0% +7.6% +40.0% ➖ noise
14 duckdb:vortex-compact +15.6% +21.0% -4.4% +40.0% ➖ noise
14 duckdb:vortex-file-compressed +5.1% +21.0% -13.1% +40.2% ➖ noise
15 datafusion:vortex-compact +1.2% -4.9% +6.4% +53.1% ➖ noise
15 datafusion:vortex-file-compressed -1.5% -4.9% +3.6% +40.0% ➖ noise
15 duckdb:vortex-compact -0.4% -4.9% +4.7% +40.0% ➖ noise
15 duckdb:vortex-file-compressed -18.1% -4.9% -13.9% +40.0% ➖ noise
16 datafusion:vortex-compact +10.9% -2.3% +13.6% +40.0% ➖ noise
16 datafusion:vortex-file-compressed -26.8% -2.3% -25.1% +40.0% ➖ noise
16 duckdb:vortex-compact +3.8% -2.3% +6.3% +40.0% ➖ noise
16 duckdb:vortex-file-compressed +2.2% -2.3% +4.7% +40.0% ➖ noise
17 datafusion:vortex-compact +0.7% -0.0% +0.7% +40.0% ➖ noise
17 datafusion:vortex-file-compressed +15.9% -0.0% +15.9% +40.0% ➖ noise
17 duckdb:vortex-compact +8.3% -0.0% +8.3% +40.0% ➖ noise
17 duckdb:vortex-file-compressed +1.6% -0.0% +1.6% +40.0% ➖ noise
18 datafusion:vortex-compact -5.6% +15.0% -17.9% +40.0% ➖ noise
18 datafusion:vortex-file-compressed +41.0% +15.0% +22.6% +40.0% ➖ noise
18 duckdb:vortex-compact -13.2% +15.0% -24.5% +40.0% ➖ noise
18 duckdb:vortex-file-compressed -4.9% +15.0% -17.3% +40.0% ➖ noise
19 datafusion:vortex-compact +9.7% -5.4% +15.9% +40.0% ➖ noise
19 datafusion:vortex-file-compressed +23.8% -5.4% +30.9% +40.0% ➖ noise
19 duckdb:vortex-compact +14.4% -5.4% +20.9% +40.0% ➖ noise
19 duckdb:vortex-file-compressed +28.7% -5.4% +36.0% +40.0% ➖ noise
20 datafusion:vortex-compact +15.6% +2.2% +13.1% +40.0% ➖ noise
20 datafusion:vortex-file-compressed +5.7% +2.2% +3.4% +47.0% ➖ noise
20 duckdb:vortex-compact -15.3% +2.2% -17.1% +40.0% ➖ noise
20 duckdb:vortex-file-compressed +13.1% +2.2% +10.7% +40.0% ➖ noise
21 datafusion:vortex-compact +14.6% +7.3% +6.8% +40.0% ➖ noise
21 datafusion:vortex-file-compressed -7.4% +7.3% -13.7% +40.0% ➖ noise
21 duckdb:vortex-compact +4.2% +7.3% -2.9% +40.0% ➖ noise
21 duckdb:vortex-file-compressed -0.4% +7.3% -7.2% +40.0% ➖ noise
22 datafusion:vortex-compact +52.9% -6.4% +63.4% +40.0% 🚨 regression
22 datafusion:vortex-file-compressed -50.3% -6.4% -46.9% +40.0% ✅ faster
22 duckdb:vortex-compact +10.4% -6.4% +17.9% +40.0% ➖ noise
22 duckdb:vortex-file-compressed +7.6% -6.4% +15.0% +40.0% ➖ noise

@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 16, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 16, 2026
@AdamGS AdamGS added changelog/performance A performance improvement action/benchmark Trigger full benchmarks to run on this PR labels Mar 16, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 16, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: Random Access

Vortex (geomean): 0.831x ✅
Parquet (geomean): 0.984x ➖


unknown / unknown (0.938x ➖, 10↑ 1↓)
name PR 3a5dc76 (ns) base 876813b (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 3218096 2623831 1.23
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1516899 1521469 1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk 14356539187 14521198663 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 13870889202 14013194470 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 6979538 8559214 0.82
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6809307 6993543 0.97
random-access/feature-vectors/uniform/lance-tokio-local-disk 1744892 1770894 0.99
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2746350 2831043 0.97
random-access/feature-vectors/uniform/parquet-tokio-local-disk 13767947442 14012805388 0.98
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 13692680728 14038615615 0.98
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀 8842303 15347057 0.58
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚀 8707383 15734032 0.55
random-access/lance-tokio-local-disk 817584 814842 1.00
random-access/lance-tokio-local-disk-footer 1534337 1561559 0.98
random-access/nested-lists/correlated/lance-tokio-local-disk 300101 310738 0.97
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 851178 877499 0.97
random-access/nested-lists/correlated/parquet-tokio-local-disk 174307470 175818229 0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 172154922 176093379 0.98
random-access/nested-lists/correlated/vortex-tokio-local-disk 764853 799868 0.96
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 813608 1013337 0.80
random-access/nested-lists/uniform/lance-tokio-local-disk 1278710 1326164 0.96
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1870389 1924798 0.97
random-access/nested-lists/uniform/parquet-tokio-local-disk 172514046 172913834 1.00
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 173124130 172185689 1.01
random-access/nested-lists/uniform/vortex-tokio-local-disk 2577637 2707826 0.95
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚀 2608350 2948777 0.88
random-access/nested-structs/correlated/lance-tokio-local-disk 475889 476299 1.00
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 729467 725547 1.01
random-access/nested-structs/correlated/parquet-tokio-local-disk 29993355 31256353 0.96
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 29928672 30649156 0.98
random-access/nested-structs/correlated/vortex-tokio-local-disk 1014078 946178 1.07
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 1013533 971126 1.04
random-access/nested-structs/uniform/lance-tokio-local-disk 3162547 3031966 1.04
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3467504 3234268 1.07
random-access/nested-structs/uniform/parquet-tokio-local-disk 30154927 30269043 1.00
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 29855381 29146822 1.02
random-access/nested-structs/uniform/vortex-tokio-local-disk 2006960 1980984 1.01
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 2034873 2026307 1.00
random-access/parquet-tokio-local-disk 198377901 202006478 0.98
random-access/parquet-tokio-local-disk-footer 200162684 202035128 0.99
random-access/taxi/correlated/lance-tokio-local-disk 1055104 1065075 0.99
random-access/taxi/correlated/lance-tokio-local-disk-footer 1862789 1805464 1.03
random-access/taxi/correlated/parquet-tokio-local-disk 293514151 300971160 0.98
random-access/taxi/correlated/parquet-tokio-local-disk-footer 296485325 302197813 0.98
random-access/taxi/correlated/vortex-tokio-local-disk 1796571 1957581 0.92
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1800855 2685718 0.67
random-access/taxi/uniform/lance-tokio-local-disk 9313018 9084140 1.03
random-access/taxi/uniform/lance-tokio-local-disk-footer 9975773 10136666 0.98
random-access/taxi/uniform/parquet-tokio-local-disk 311551574 323646932 0.96
random-access/taxi/uniform/parquet-tokio-local-disk-footer 309883292 324475625 0.96
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4474746 5857313 0.76
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4489209 6041255 0.74
random-access/vortex-tokio-local-disk 🚀 1241788 1553357 0.80
random-access/vortex-tokio-local-disk-footer 🚀 1251069 1838586 0.68

@github-actions
Copy link
Contributor

github-actions bot commented Mar 16, 2026

Benchmarks: Compression

Vortex (geomean): 0.983x ➖
Parquet (geomean): 0.963x ➖


unknown / unknown (0.950x ➖, 32↑ 2↓)
name PR 3a5dc76 (ns) base b921999 (ns) ratio (PR/base)
compress time/Arade 1140604695 1164128564 0.98
compress time/Bimbo 7016334292 7415674697 0.95
compress time/CMSprovider 2990119102 2955583959 1.01
compress time/Euro2016 440862626 458373125 0.96
compress time/Food 416879982 396352943 1.05
compress time/HashTags 933129550 1005649131 0.93
compress time/TPC-H l_comment canonical 1330866785 1381519427 0.96
compress time/TPC-H l_comment chunked 1333716532 1387987104 0.96
compress time/taxi 731020314 753239740 0.97
compress time/wide table cols=100 chunks=1 rows=1000 🚀 15146803 16902265 0.90
compress time/wide table cols=100 chunks=50 rows=1000 🚀 16084523 20916658 0.77
compress time/wide table cols=1000 chunks=1 rows=1000 🚀 156298842 182011861 0.86
compress time/wide table cols=1000 chunks=50 rows=1000 🚀 155163968 188683485 0.82
compress time/wide table cols=10000 chunks=1 rows=1000 1534751558 1697561427 0.90
compress time/wide table cols=10000 chunks=50 rows=1000 1546492617 1568389142 0.99
decompress time/Arade 28588358 31653604 0.90
decompress time/Bimbo 🚀 94471010 122744073 0.77
decompress time/CMSprovider 🚀 85859803 97227952 0.88
decompress time/Euro2016 🚀 20264279 24457025 0.83
decompress time/Food 🚀 7799879 9396254 0.83
decompress time/HashTags 🚀 69479247 84422462 0.82
decompress time/TPC-H l_comment canonical 🚀 36709602 45951382 0.80
decompress time/TPC-H l_comment chunked 🚀 37448426 49823907 0.75
decompress time/taxi 19290027 20006528 0.96
decompress time/wide table cols=100 chunks=1 rows=1000 🚀 2403134 2835409 0.85
decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2479478 2990799 0.83
decompress time/wide table cols=1000 chunks=1 rows=1000 🚀 24124974 27960058 0.86
decompress time/wide table cols=1000 chunks=50 rows=1000 23732278 24738427 0.96
decompress time/wide table cols=10000 chunks=1 rows=1000 🚀 249542774 281104593 0.89
decompress time/wide table cols=10000 chunks=50 rows=1000 244406332 268182362 0.91
parquet size/Arade 305282152 305282152 1.00
parquet size/Bimbo 388935055 388935055 1.00
parquet size/CMSprovider 384634824 384634824 1.00
parquet size/Euro2016 123042700 123042700 1.00
parquet size/Food 36177631 36177631 1.00
parquet size/HashTags 133854962 133854962 1.00
parquet size/TPC-H l_comment canonical 158411391 158411391 1.00
parquet size/TPC-H l_comment chunked 158411391 158411391 1.00
parquet size/taxi 55879185 55879185 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932204 932204 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932204 932204 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93220004 93220004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93220004 93220004 1.00
parquet_rs-zstd compress time/Arade 🚀 2468586279 2757114290 0.90
parquet_rs-zstd compress time/Bimbo 🚀 15618270257 17730387479 0.88
parquet_rs-zstd compress time/CMSprovider 🚀 7923986651 9002637107 0.88
parquet_rs-zstd compress time/Euro2016 1456248474 1507671160 0.97
parquet_rs-zstd compress time/Food 917116921 959287404 0.96
parquet_rs-zstd compress time/HashTags 2601274576 2774773663 0.94
parquet_rs-zstd compress time/TPC-H l_comment canonical 3172128013 3309489047 0.96
parquet_rs-zstd compress time/TPC-H l_comment chunked 3205758810 3432860134 0.93
parquet_rs-zstd compress time/taxi 1382068428 1441210941 0.96
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚀 6563953 8003180 0.82
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚀 6639119 8912274 0.74
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 🚀 82345087 97617049 0.84
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 80881929 86544111 0.93
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 🚀 886928431 987851959 0.90
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 870012884 918246797 0.95
parquet_rs-zstd decompress time/Arade 672091360 693962218 0.97
parquet_rs-zstd decompress time/Bimbo 2301038462 2291279510 1.00
parquet_rs-zstd decompress time/CMSprovider 2128730193 2188810990 0.97
parquet_rs-zstd decompress time/Euro2016 418579846 427599672 0.98
parquet_rs-zstd decompress time/Food 240367587 246207246 0.98
parquet_rs-zstd decompress time/HashTags 🚀 691318456 804752998 0.86
parquet_rs-zstd decompress time/TPC-H l_comment canonical 715227523 715087705 1.00
parquet_rs-zstd decompress time/TPC-H l_comment chunked 716169463 753277240 0.95
parquet_rs-zstd decompress time/taxi 289242979 297932883 0.97
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2589286 2706325 0.96
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2555512 3067466 0.83
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 🚀 28525773 34234681 0.83
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 29053051 30035113 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 338758636 363773444 0.93
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 342154031 344836633 0.99
vortex-file-compressed size/Arade 143320892 143320892 1.00
vortex-file-compressed size/Bimbo 526057964 526057964 1.00
vortex-file-compressed size/CMSprovider 448338524 448338524 1.00
vortex-file-compressed size/Euro2016 167858692 167858692 1.00
vortex-file-compressed size/Food 44162400 44162400 1.00
vortex-file-compressed size/HashTags 198700644 198700644 1.00
vortex-file-compressed size/TPC-H l_comment canonical 180408824 180408824 1.00
vortex-file-compressed size/TPC-H l_comment chunked 180408824 180408824 1.00
vortex-file-compressed size/taxi 51448740 51448740 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317584 88317584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317584 88317584 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.09
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.07
vortex:parquet-zstd ratio compress time/CMSprovider 🚨 0 0 1.15
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.00
vortex:parquet-zstd ratio compress time/Food 🚨 0 0 1.10
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.03
vortex:parquet-zstd ratio compress time/taxi 0 0 1.01
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2 2 1.09
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 2 1.03
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 🚀 1 2 0.88
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.04
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.93
vortex:parquet-zstd ratio decompress time/Bimbo 🚀 0 0 0.77
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 0.91
vortex:parquet-zstd ratio decompress time/Euro2016 🚀 0 0 0.85
vortex:parquet-zstd ratio decompress time/Food 🚀 0 0 0.85
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.96
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 🚀 0 0 0.80
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 🚀 0 0 0.79
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 🚀 0 1 0.89
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.95
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.92
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 16, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 16, 2026
@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Mar 17, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 17, 2026
@codspeed-hq
Copy link

codspeed-hq bot commented Mar 17, 2026

Merging this PR will not alter performance

✅ 1016 untouched benchmarks
⏩ 1522 skipped benchmarks1


Comparing adam/codex-try-io (cbaab6f) with develop (ea106e4)

Open in CodSpeed

Footnotes

  1. 1522 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 17, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 17, 2026
@AdamGS AdamGS force-pushed the adam/codex-try-io branch from 139e226 to 3732c5a Compare March 17, 2026 16:35
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 17, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 17, 2026
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 18, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 18, 2026
@AdamGS AdamGS force-pushed the adam/codex-try-io branch 2 times, most recently from 55a9552 to 24baf98 Compare March 18, 2026 19:07
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 18, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 18, 2026
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 19, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 19, 2026
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 19, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 19, 2026
@AdamGS AdamGS force-pushed the adam/codex-try-io branch from f477ab1 to d4979d2 Compare March 19, 2026 13:38
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 19, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 19, 2026
AdamGS added 7 commits March 19, 2026 19:47
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS force-pushed the adam/codex-try-io branch from d4979d2 to cbaab6f Compare March 19, 2026 19:47
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 19, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement do not merge Pull requests that are not intended to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants