Skip to content

[opt](distribution) support bucket shuffle for set operation #59006

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
924060929 merged 11 commits into from
Jan 5, 2026
Merged

[opt](distribution) support bucket shuffle for set operation #59006

924060929 merged 11 commits into from
Jan 5, 2026

Conversation

@924060929
Copy link
Contributor

@924060929 924060929 commented Dec 12, 2025 •
edited
Loading

What problem does this PR solve?

support bucket shuffle for set operation(union/intersect/except)

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

hello-stephen commented Dec 12, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@924060929
Copy link
Contributor Author

924060929 commented Dec 12, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Dec 12, 2025

TPC-H: Total hot run time: 35279 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d0855d6ab9fa3e2950745cce9256b1d472bb5e22, data reload: false

------ Round 1 ----------------------------------
q1	17618	4227	4115	4115
q2	2032	351	237	237
q3	10175	1339	759	759
q4	10234	964	334	334
q5	7568	2192	1911	1911
q6	187	173	139	139
q7	1009	862	709	709
q8	9358	1460	1238	1238
q9	7181	5314	5354	5314
q10	6781	2396	1968	1968
q11	523	320	305	305
q12	678	724	595	595
q13	17775	3710	3049	3049
q14	287	288	278	278
q15	586	519	520	519
q16	678	688	629	629
q17	706	841	496	496
q18	7308	7059	7051	7051
q19	919	953	624	624
q20	397	363	252	252
q21	4242	3951	3778	3778
q22	1036	1000	979	979
Total cold run time: 107278 ms
Total hot run time: 35279 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4108	4043	4037	4037
q2	340	412	332	332
q3	2153	2682	2301	2301
q4	1301	1737	1273	1273
q5	4253	4593	4855	4593
q6	224	180	132	132
q7	2039	2037	1828	1828
q8	2715	2523	2563	2523
q9	7759	7532	7465	7465
q10	3078	3376	2887	2887
q11	610	529	489	489
q12	680	748	624	624
q13	3600	3979	3347	3347
q14	306	304	270	270
q15	550	520	532	520
q16	665	728	658	658
q17	1203	1405	1527	1405
q18	8199	7830	7556	7556
q19	948	862	864	862
q20	2009	2062	1960	1960
q21	4971	4324	4230	4230
q22	1054	989	995	989
Total cold run time: 52765 ms
Total hot run time: 50281 ms

@doris-robot
Copy link

doris-robot commented Dec 12, 2025

TPC-DS: Total hot run time: 174752 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d0855d6ab9fa3e2950745cce9256b1d472bb5e22, data reload: false

query5	
query6	349	229	210	210
query7	4219	421	264	264
query8	316	271	286	271
query9	8914	2563	2568	2563
query10	540	378	336	336
query11	15826	15054	14731	14731
query12	184	120	117	117
query13	1278	514	394	394
query14	6635	3296	3025	3025
query14_1	2892	2915	2906	2906
query15	229	198	186	186
query16	860	488	464	464
query17	1415	751	612	612
query18	2445	450	371	371
query19	259	239	213	213
query20	124	114	121	114
query21	226	135	121	121
query22	3915	3900	3862	3862
query23	16638	16249	15913	15913
query23_1	16219	16125	16088	16088
query24	7500	1671	1201	1201
query24_1	1251	1244	1281	1244
query25	683	509	442	442
query26	1256	289	175	175
query27	2742	479	342	342
query28	4491	2159	2146	2146
query29	840	579	480	480
query30	400	251	217	217
query31	837	709	626	626
query32	79	71	69	69
query33	576	348	341	341
query34	908	904	538	538
query35	792	829	720	720
query36	897	917	847	847
query37	181	88	75	75
query38	2931	2895	2829	2829
query39	765	755	720	720
query39_1	789	696	693	693
query40	226	135	125	125
query41	67	65	62	62
query42	107	103	101	101
query43	437	433	406	406
query44	1326	749	740	740
query45	197	193	183	183
query46	883	999	620	620
query47	1628	1689	1605	1605
query48	333	333	249	249
query49	1050	431	351	351
query50	677	298	217	217
query51	3837	3911	3802	3802
query52	119	111	95	95
query53	313	356	300	300
query54	
query55	80	76	73	73
query56	297	299	289	289
query57	1145	1149	1095	1095
query58	280	257	254	254
query59	2396	2584	2425	2425
query60	314	311	298	298
query61	163	155	160	155
query62	751	688	641	641
query63	346	305	301	301
query64	5032	1303	1053	1053
query65	4061	3941	3955	3941
query66	1523	448	336	336
query67	15323	15172	14947	14947
query68	8517	999	741	741
query69	499	359	329	329
query70	1086	985	990	985
query71	
query72	6068	4955	5268	4955
query73	724	611	310	310
query74	8545	8871	8582	8582
query75	
query76	
query77	753	406	290	290
query78	9286	9520	8899	8899
query79	1204	905	622	622
query80	740	659	574	574
query81	490	281	236	236
query82	711	135	103	103
query83	266	265	250	250
query84	251	133	101	101
query85	943	515	459	459
query86	382	288	285	285
query87	3117	3150	3027	3027
query88	3295	2306	2277	2277
query89	478	431	389	389
query90	2144	166	166	166
query91	180	168	147	147
query92	93	65	69	65
query93	1107	955	561	561
query94	602	275	293	275
query95	576	389	311	311
query96	613	469	212	212
query97	2273	2298	2231	2231
query98	213	199	195	195
query99	1313	1371	1232	1232
Total cold run time: 250934 ms
Total hot run time: 174752 ms

@doris-robot
Copy link

doris-robot commented Dec 12, 2025

ClickBench: Total hot run time: 27.45 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d0855d6ab9fa3e2950745cce9256b1d472bb5e22, data reload: false

query1	0.05	0.05	0.04
query2	0.09	0.04	0.04
query3	0.25	0.08	0.08
query4	1.61	0.10	0.12
query5	0.29	0.26	0.28
query6	1.17	0.66	0.65
query7	0.03	0.03	0.02
query8	0.05	0.04	0.04
query9	0.57	0.52	0.50
query10	0.54	0.55	0.56
query11	0.16	0.10	0.12
query12	0.15	0.11	0.12
query13	0.62	0.60	0.60
query14	0.99	0.97	0.98
query15	0.83	0.82	0.81
query16	0.39	0.38	0.39
query17	1.07	1.06	1.03
query18	0.23	0.22	0.22
query19	1.97	1.90	1.81
query20	0.02	0.02	0.01
query21	15.41	0.29	0.15
query22	4.85	0.04	0.04
query23	16.03	0.29	0.11
query24	1.22	0.31	0.41
query25	0.09	0.08	0.08
query26	0.14	0.13	0.14
query27	0.11	0.05	0.04
query28	3.70	1.22	1.02
query29	12.62	4.06	3.39
query30	0.27	0.14	0.11
query31	2.82	0.63	0.41
query32	3.23	0.56	0.45
query33	3.03	3.16	3.02
query34	16.77	5.20	4.51
query35	4.54	4.50	4.57
query36	0.66	0.50	0.51
query37	0.11	0.07	0.06
query38	0.07	0.05	0.04
query39	0.04	0.03	0.03
query40	0.18	0.14	0.14
query41	0.09	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.03	0.03
Total cold run time: 97.14 s
Total hot run time: 27.45 s

@924060929
Copy link
Contributor Author

924060929 commented Dec 12, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Dec 12, 2025

TPC-H: Total hot run time: 34987 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 48c5f71eb30a8e76717d7f1cfaac067182a0dbcf, data reload: false

------ Round 1 ----------------------------------
q1	17618	4135	4058	4058
q2	2019	354	239	239
q3	10142	1354	730	730
q4	10229	941	319	319
q5	7526	2087	1978	1978
q6	189	168	134	134
q7	999	864	716	716
q8	9350	1439	1099	1099
q9	7086	5387	5350	5350
q10	6844	2373	1985	1985
q11	531	332	297	297
q12	659	729	569	569
q13	17787	3714	3015	3015
q14	291	311	286	286
q15	588	517	516	516
q16	680	664	627	627
q17	695	807	511	511
q18	7538	7098	7099	7098
q19	1118	961	621	621
q20	400	359	254	254
q21	4170	3842	3632	3632
q22	1066	1005	953	953
Total cold run time: 107525 ms
Total hot run time: 34987 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4093	4008	3999	3999
q2	325	410	322	322
q3	2150	2666	2320	2320
q4	1330	1745	1305	1305
q5	4233	4485	4815	4485
q6	230	171	131	131
q7	2114	1903	1855	1855
q8	2663	2554	2470	2470
q9	7547	7510	7589	7510
q10	3155	3289	2810	2810
q11	583	508	504	504
q12	670	743	758	743
q13	3560	3942	3370	3370
q14	309	450	357	357
q15	546	510	503	503
q16	644	674	603	603
q17	1174	1428	1405	1405
q18	7963	7621	7631	7621
q19	891	867	899	867
q20	1980	2170	1910	1910
q21	4852	4267	4139	4139
q22	1055	1030	973	973
Total cold run time: 52067 ms
Total hot run time: 50202 ms

@doris-robot
Copy link

doris-robot commented Dec 12, 2025

TPC-DS: Total hot run time: 178993 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 48c5f71eb30a8e76717d7f1cfaac067182a0dbcf, data reload: false

query5	4900	638	472	472
query6	371	227	240	227
query7	4232	469	279	279
query8	299	257	264	257
query9	8764	2549	2570	2549
query10	510	383	340	340
query11	15468	15187	14912	14912
query12	193	117	115	115
query13	1283	500	397	397
query14	6734	3311	2980	2980
query14_1	2910	2919	2901	2901
query15	218	204	181	181
query16	896	485	499	485
query17	1153	733	607	607
query18	2753	450	354	354
query19	235	229	211	211
query20	122	117	125	117
query21	223	151	120	120
query22	4037	4170	3827	3827
query23	16674	16373	15899	15899
query23_1	16068	16169	16070	16070
query24	7312	1665	1253	1253
query24_1	1262	1233	1268	1233
query25	594	495	443	443
query26	1009	273	162	162
query27	2733	466	311	311
query28	4411	2149	2171	2149
query29	773	542	428	428
query30	327	245	215	215
query31	869	694	617	617
query32	80	67	63	63
query33	538	337	293	293
query34	888	885	524	524
query35	788	826	725	725
query36	847	893	825	825
query37	136	95	79	79
query38	2901	2889	2837	2837
query39	758	743	726	726
query39_1	716	709	714	709
query40	226	135	127	127
query41	68	102	62	62
query42	105	105	109	105
query43	446	436	399	399
query44	1314	743	747	743
query45	194	194	185	185
query46	872	981	625	625
query47	1670	1705	1641	1641
query48	316	323	245	245
query49	649	433	379	379
query50	661	300	225	225
query51	3792	3882	3793	3793
query52	106	108	94	94
query53	320	353	288	288
query54	316	275	262	262
query55	80	77	69	69
query56	290	297	302	297
query57	1121	1144	1069	1069
query58	273	259	248	248
query59	2376	2547	2345	2345
query60	310	309	314	309
query61	162	160	162	160
query62	718	677	633	633
query63	331	296	306	296
query64	4541	1350	1005	1005
query65	4044	3971	3937	3937
query66	1334	451	313	313
query67	15179	15111	14945	14945
query68	8441	1003	726	726
query69	486	351	309	309
query70	1124	987	962	962
query71	372	312	284	284
query72	6071	5233	5078	5078
query73	701	646	313	313
query74	8934	8791	8610	8610
query75	3251	3389	2782	2782
query76	3921	1143	741	741
query77	655	399	307	307
query78	9415	9607	8978	8978
query79	1373	866	620	620
query80	687	638	546	546
query81	514	266	231	231
query82	204	134	110	110
query83	262	251	240	240
query84	257	125	105	105
query85	912	517	484	484
query86	387	301	294	294
query87	3093	3101	2996	2996
query88	3847	2267	2254	2254
query89	470	435	394	394
query90	2191	160	161	160
query91	172	177	146	146
query92	82	70	67	67
query93	1606	927	558	558
query94	464	288	274	274
query95	570	382	299	299
query96	585	484	210	210
query97	2230	2345	2223	2223
query98	225	199	189	189
query99	1289	1306	1269	1269
Total cold run time: 261651 ms
Total hot run time: 178993 ms

@doris-robot
Copy link

doris-robot commented Dec 12, 2025

ClickBench: Total hot run time: 27.11 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 48c5f71eb30a8e76717d7f1cfaac067182a0dbcf, data reload: false

query1	0.06	0.05	0.05
query2	0.10	0.05	0.05
query3	0.26	0.08	0.08
query4	1.60	0.11	0.11
query5	0.26	0.26	0.26
query6	1.15	0.64	0.63
query7	0.03	0.03	0.03
query8	0.06	0.04	0.04
query9	0.57	0.50	0.50
query10	0.56	0.55	0.56
query11	0.17	0.11	0.11
query12	0.15	0.12	0.11
query13	0.62	0.61	0.60
query14	1.00	0.98	0.99
query15	0.82	0.79	0.81
query16	0.40	0.39	0.41
query17	1.01	0.99	1.01
query18	0.24	0.21	0.21
query19	1.80	1.71	1.76
query20	0.01	0.01	0.01
query21	15.46	0.33	0.14
query22	4.69	0.05	0.05
query23	16.11	0.27	0.10
query24	0.98	0.29	0.24
query25	0.08	0.07	0.06
query26	0.14	0.12	0.14
query27	0.07	0.06	0.06
query28	3.07	1.24	1.03
query29	12.58	4.10	3.21
query30	0.31	0.14	0.13
query31	2.81	0.64	0.39
query32	3.24	0.55	0.46
query33	3.02	3.08	3.03
query34	17.04	5.20	4.51
query35	4.57	4.56	4.58
query36	0.68	0.50	0.49
query37	0.12	0.07	0.06
query38	0.08	0.04	0.04
query39	0.04	0.02	0.03
query40	0.17	0.15	0.12
query41	0.09	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 96.3 s
Total hot run time: 27.11 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Dec 12, 2025

FE UT Coverage Report

Increment line coverage 46.36% (51/110) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Contributor

hello-stephen commented Dec 12, 2025

FE Regression Coverage Report

Increment line coverage 50.91% (56/110) 🎉
Increment coverage report
Complete coverage report

@924060929
Copy link
Contributor Author

924060929 commented Dec 15, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Dec 15, 2025

TPC-H: Total hot run time: 36722 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3d8029fabf02b4ce727baa508757e689dcbe2d47, data reload: false

------ Round 1 ----------------------------------
q1	17660	4242	4161	4161
q2	2059	354	243	243
q3	10136	1306	749	749
q4	10234	938	327	327
q5	7490	2141	1989	1989
q6	185	166	135	135
q7	1012	864	731	731
q8	9363	1513	1144	1144
q9	6931	5344	5398	5344
q10	6798	2415	1976	1976
q11	527	336	300	300
q12	677	713	574	574
q13	17762	3678	3074	3074
q14	300	306	271	271
q15	596	517	520	517
q16	699	674	627	627
q17	682	838	567	567
q18	8098	7848	7988	7848
q19	1101	1019	638	638
q20	428	384	296	296
q21	4820	4194	4259	4194
q22	1136	1017	1054	1017
Total cold run time: 108694 ms
Total hot run time: 36722 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4420	4321	4327	4321
q2	326	425	362	362
q3	2392	2789	2324	2324
q4	1475	1909	1390	1390
q5	4599	4531	4613	4531
q6	221	167	128	128
q7	2045	1958	1827	1827
q8	2636	2567	2554	2554
q9	7522	7478	7598	7478
q10	3109	3262	2803	2803
q11	584	519	491	491
q12	664	744	567	567
q13	3273	3699	3074	3074
q14	263	281	263	263
q15	529	494	492	492
q16	615	659	598	598
q17	1141	1362	1383	1362
q18	7345	7028	6981	6981
q19	866	843	870	843
q20	1973	2027	1794	1794
q21	4645	4253	4170	4170
q22	1053	1023	992	992
Total cold run time: 51696 ms
Total hot run time: 49345 ms

@doris-robot
Copy link

doris-robot commented Dec 15, 2025

TPC-DS: Total hot run time: 166770 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3d8029fabf02b4ce727baa508757e689dcbe2d47, data reload: false

query5	5881	630	481	481
query6	328	237	218	218
query7	4219	463	276	276
query8	
query9	8995	2576	2546	2546
query10	569	398	334	334
query11	15462	14729	14859	14729
query12	185	119	115	115
query13	1271	528	402	402
query14	
query14_1	
query15	224	211	181	181
query16	1002	527	488	488
query17	2161	680	593	593
query18	2685	430	343	343
query19	346	227	206	206
query20	123	114	111	111
query21	215	137	118	118
query22	3901	3964	3900	3900
query23	16655	16069	15828	15828
query23_1	16032	16016	15853	15853
query24	7152	1653	1254	1254
query24_1	1268	1265	1238	1238
query25	652	475	417	417
query26	1797	268	161	161
query27	2957	458	311	311
query28	5391	2154	2140	2140
query29	942	560	482	482
query30	327	250	213	213
query31	841	730	620	620
query32	79	78	75	75
query33	534	359	314	314
query34	915	919	554	554
query35	800	819	747	747
query36	885	888	824	824
query37	160	100	77	77
query38	
query39	794	764	746	746
query39_1	729	718	701	701
query40	230	152	132	132
query41	74	69	67	67
query42	110	105	107	105
query43	436	430	403	403
query44	1349	781	760	760
query45	200	193	180	180
query46	902	1010	633	633
query47	1683	1676	1653	1653
query48	350	357	269	269
query49	657	466	360	360
query50	693	308	229	229
query51	3883	3887	3866	3866
query52	111	120	104	104
query53	324	360	305	305
query54	317	284	276	276
query55	86	73	76	73
query56	312	313	299	299
query57	1133	1173	1088	1088
query58	273	270	264	264
query59	2387	2481	2322	2322
query60	327	325	315	315
query61	188	195	183	183
query62	724	656	641	641
query63	336	318	313	313
query64	4963	1314	1002	1002
query65	4079	3967	3980	3967
query66	1479	427	314	314
query67	15073	14957	14860	14860
query68	7914	1026	742	742
query69	511	351	307	307
query70	1093	1028	970	970
query71	387	350	289	289
query72	6679	4911	5087	4911
query73	672	582	306	306
query74	8669	8818	8592	8592
query75	3169	3159	2784	2784
query76	3762	1160	809	809
query77	525	413	301	301
query78	9438	9418	8784	8784
query79	1714	889	641	641
query80	720	629	550	550
query81	509	272	238	238
query82	201	136	103	103
query83	272	254	246	246
query84	262	123	106	106
query85	896	485	462	462
query86	343	276	292	276
query87	
query88	4278	2264	2262	2262
query89	491	434	390	390
query90	2369	158	161	158
query91	175	170	142	142
query92	86	71	67	67
query93	2011	943	555	555
query94	475	298	281	281
query95	555	386	315	315
query96	592	471	218	218
query97	2266	2362	2256	2256
query98	226	211	199	199
query99	1323	1308	1225	1225
Total cold run time: 251588 ms
Total hot run time: 166770 ms

@doris-robot
Copy link

doris-robot commented Dec 15, 2025

ClickBench: Total hot run time: 27.21 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3d8029fabf02b4ce727baa508757e689dcbe2d47, data reload: false

query1	0.06	0.05	0.04
query2	0.09	0.05	0.05
query3	0.26	0.09	0.09
query4	1.60	0.11	0.11
query5	0.28	0.25	0.26
query6	1.17	0.67	0.63
query7	0.03	0.03	0.03
query8	0.06	0.05	0.04
query9	0.58	0.52	0.51
query10	0.56	0.56	0.56
query11	0.17	0.10	0.12
query12	0.14	0.11	0.12
query13	0.64	0.60	0.61
query14	0.99	0.99	0.98
query15	0.80	0.80	0.79
query16	0.38	0.39	0.39
query17	1.07	1.05	1.08
query18	0.24	0.22	0.21
query19	1.88	1.78	1.75
query20	0.02	0.02	0.01
query21	15.45	0.30	0.14
query22	4.74	0.05	0.05
query23	16.24	0.30	0.11
query24	1.41	0.61	0.22
query25	0.08	0.10	0.06
query26	0.14	0.13	0.14
query27	0.06	0.05	0.11
query28	4.22	1.23	1.02
query29	12.63	4.10	3.28
query30	0.28	0.14	0.15
query31	2.81	0.62	0.39
query32	3.24	0.55	0.45
query33	3.00	2.98	3.01
query34	17.00	5.19	4.50
query35	4.61	4.56	4.62
query36	0.66	0.50	0.52
query37	0.11	0.06	0.07
query38	0.07	0.05	0.04
query39	0.05	0.03	0.03
query40	0.17	0.15	0.12
query41	0.09	0.03	0.03
query42	0.04	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 98.16 s
Total hot run time: 27.21 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Dec 15, 2025

FE Regression Coverage Report

Increment line coverage 56.90% (66/116) 🎉
Increment coverage report
Complete coverage report

@924060929
Copy link
Contributor Author

924060929 commented Dec 16, 2025

run buildall

@924060929 924060929 force-pushed the bucket-shuffle-union branch from f6f2b15 to 857a966 Compare December 16, 2025 06:54
@924060929
Copy link
Contributor Author

924060929 commented Dec 16, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Dec 16, 2025

TPC-H: Total hot run time: 35327 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 857a966eb4535c85fb9ea60e8e310e1f890f26e6, data reload: false

------ Round 1 ----------------------------------
q1	17610	4227	4025	4025
q2	2033	356	246	246
q3	10156	1305	739	739
q4	10204	870	311	311
q5	7724	2199	1919	1919
q6	229	169	137	137
q7	1007	871	709	709
q8	9366	1477	1164	1164
q9	7263	5317	5397	5317
q10	6854	2403	1970	1970
q11	530	332	299	299
q12	726	723	583	583
q13	17825	3675	3050	3050
q14	288	291	268	268
q15	595	513	515	513
q16	702	673	620	620
q17	707	822	515	515
q18	8237	7294	7221	7221
q19	1110	958	616	616
q20	398	362	245	245
q21	4307	3909	3924	3909
q22	1036	994	951	951
Total cold run time: 108907 ms
Total hot run time: 35327 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4088	4034	4032	4032
q2	329	395	316	316
q3	2137	2685	2315	2315
q4	1330	1753	1294	1294
q5	4248	4772	4657	4657
q6	226	179	130	130
q7	2030	2021	1853	1853
q8	2659	2594	2474	2474
q9	7532	7627	7640	7627
q10	3048	3294	2832	2832
q11	604	512	569	512
q12	710	742	630	630
q13	3644	4141	3189	3189
q14	300	299	283	283
q15	542	501	523	501
q16	676	720	622	622
q17	1239	1455	1436	1436
q18	8060	7565	7705	7565
q19	875	871	913	871
q20	2037	2125	1902	1902
q21	4665	4377	4199	4199
q22	1098	1045	993	993
Total cold run time: 52077 ms
Total hot run time: 50233 ms

@doris-robot
Copy link

doris-robot commented Dec 16, 2025

TPC-DS: Total hot run time: 178675 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 857a966eb4535c85fb9ea60e8e310e1f890f26e6, data reload: false

query5	4444	588	444	444
query6	335	235	221	221
query7	4226	464	273	273
query8	319	259	243	243
query9	8780	2488	2536	2488
query10	510	378	325	325
query11	15368	15207	14956	14956
query12	179	119	124	119
query13	1262	510	389	389
query14	6141	3020	2727	2727
query14_1	2634	2615	2634	2615
query15	211	197	183	183
query16	884	475	437	437
query17	1146	715	616	616
query18	2496	446	356	356
query19	234	229	206	206
query20	127	118	111	111
query21	221	137	121	121
query22	3999	3974	3873	3873
query23	16662	16193	16124	16124
query23_1	16130	16053	16224	16053
query24	7376	1689	1218	1218
query24_1	1250	1221	1270	1221
query25	600	512	439	439
query26	1261	270	157	157
query27	2774	464	311	311
query28	4486	2125	2117	2117
query29	862	574	466	466
query30	321	255	215	215
query31	867	731	664	664
query32	79	67	73	67
query33	539	329	290	290
query34	931	908	529	529
query35	788	836	714	714
query36	860	909	839	839
query37	126	90	79	79
query38	2884	2885	2866	2866
query39	766	746	724	724
query39_1	722	704	709	704
query40	223	135	116	116
query41	80	65	61	61
query42	105	105	108	105
query43	436	427	409	409
query44	1319	742	745	742
query45	188	195	182	182
query46	877	985	613	613
query47	1679	1720	1638	1638
query48	311	320	245	245
query49	675	421	351	351
query50	652	294	218	218
query51	3823	3797	3827	3797
query52	105	110	96	96
query53	321	348	287	287
query54	281	260	251	251
query55	87	76	72	72
query56	289	294	298	294
query57	1167	1178	1094	1094
query58	278	248	245	245
query59	2425	2445	2394	2394
query60	305	299	286	286
query61	192	158	161	158
query62	723	670	618	618
query63	326	288	293	288
query64	5106	1296	1003	1003
query65	3987	3960	3954	3954
query66	1489	447	318	318
query67	15550	15078	14781	14781
query68	7634	1013	715	715
query69	504	353	313	313
query70	1080	1031	967	967
query71	371	311	276	276
query72	6033	5009	4999	4999
query73	698	595	306	306
query74	8920	8826	8622	8622
query75	3201	3159	2811	2811
query76	3896	1141	728	728
query77	526	386	293	293
query78	9514	9731	8933	8933
query79	1813	841	598	598
query80	1363	658	557	557
query81	543	268	234	234
query82	418	131	103	103
query83	267	253	235	235
query84	258	119	110	110
query85	961	520	475	475
query86	350	282	304	282
query87	2999	3011	2962	2962
query88	3225	2282	2295	2282
query89	473	424	389	389
query90	2008	154	155	154
query91	176	169	152	152
query92	73	65	62	62
query93	1122	885	562	562
query94	547	301	282	282
query95	573	380	309	309
query96	594	464	211	211
query97	2328	2326	2226	2226
query98	212	195	188	188
query99	1305	1298	1182	1182
Total cold run time: 260792 ms
Total hot run time: 178675 ms

@doris-robot
Copy link

doris-robot commented Dec 16, 2025

ClickBench: Total hot run time: 27.18 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 857a966eb4535c85fb9ea60e8e310e1f890f26e6, data reload: false

query1	0.05	0.05	0.05
query2	0.10	0.05	0.04
query3	0.25	0.09	0.08
query4	1.60	0.11	0.12
query5	0.27	0.26	0.25
query6	1.16	0.65	0.62
query7	0.02	0.02	0.02
query8	0.05	0.05	0.04
query9	0.56	0.50	0.51
query10	0.55	0.55	0.55
query11	0.17	0.11	0.10
query12	0.14	0.11	0.12
query13	0.62	0.61	0.61
query14	0.99	1.00	0.97
query15	0.82	0.79	0.81
query16	0.40	0.41	0.42
query17	0.97	1.00	0.99
query18	0.23	0.22	0.22
query19	1.94	1.88	1.80
query20	0.02	0.01	0.01
query21	15.44	0.29	0.15
query22	4.87	0.06	0.05
query23	16.07	0.28	0.10
query24	1.96	0.29	0.64
query25	0.11	0.08	0.05
query26	0.13	0.14	0.13
query27	0.08	0.04	0.06
query28	4.50	1.19	1.02
query29	12.62	3.94	3.18
query30	0.28	0.14	0.11
query31	2.84	0.61	0.39
query32	3.24	0.54	0.47
query33	2.94	3.04	3.11
query34	16.77	5.18	4.52
query35	4.56	4.65	4.53
query36	0.65	0.50	0.48
query37	0.11	0.07	0.06
query38	0.07	0.04	0.04
query39	0.04	0.03	0.04
query40	0.17	0.14	0.13
query41	0.08	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 98.52 s
Total hot run time: 27.18 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Dec 16, 2025

FE UT Coverage Report

Increment line coverage 52.68% (59/112) 🎉
Increment coverage report
Complete coverage report

@924060929
Copy link
Contributor Author

924060929 commented Dec 16, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Dec 16, 2025

TPC-H: Total hot run time: 35367 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fee457e70de22f8e9a52857742b04a88d7b44a45, data reload: false

------ Round 1 ----------------------------------
q1	17674	4340	4103	4103
q2	2032	349	241	241
q3	10167	1323	765	765
q4	10211	845	323	323
q5	7524	2157	1895	1895
q6	194	169	142	142
q7	1014	877	723	723
q8	9377	1434	1198	1198
q9	7082	5352	5363	5352
q10	6881	2403	1987	1987
q11	519	332	301	301
q12	652	709	596	596
q13	18355	3739	3077	3077
q14	296	304	284	284
q15	598	534	519	519
q16	723	688	653	653
q17	740	857	563	563
q18	7856	7172	6980	6980
q19	1146	964	613	613
q20	407	371	250	250
q21	4270	4032	3826	3826
q22	1091	989	976	976
Total cold run time: 108809 ms
Total hot run time: 35367 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4175	4188	4117	4117
q2	340	430	328	328
q3	2112	2709	2323	2323
q4	1342	1769	1303	1303
q5	4276	5033	4478	4478
q6	241	190	134	134
q7	2069	1990	1830	1830
q8	2668	2628	2516	2516
q9	7619	7587	7506	7506
q10	3067	3247	2835	2835
q11	614	529	500	500
q12	835	776	648	648
q13	3560	4013	3295	3295
q14	305	324	321	321
q15	591	530	524	524
q16	665	718	685	685
q17	1260	1518	1440	1440
q18	7877	7819	7492	7492
q19	901	821	854	821
q20	1887	1964	1843	1843
q21	4704	4279	4179	4179
q22	1099	1027	991	991
Total cold run time: 52207 ms
Total hot run time: 50109 ms

@doris-robot
Copy link

doris-robot commented Dec 16, 2025

TPC-DS: Total hot run time: 178363 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fee457e70de22f8e9a52857742b04a88d7b44a45, data reload: false

query5	4384	571	438	438
query6	342	241	233	233
query7	4232	490	277	277
query8	305	254	256	254
query9	8772	2569	2573	2569
query10	500	391	348	348
query11	15274	14799	14581	14581
query12	170	119	116	116
query13	1279	515	403	403
query14	5729	3009	2733	2733
query14_1	2679	2632	2683	2632
query15	209	204	180	180
query16	847	466	448	448
query17	1144	738	617	617
query18	2439	447	357	357
query19	241	253	215	215
query20	121	116	115	115
query21	224	148	117	117
query22	4019	4191	3933	3933
query23	16561	16266	15976	15976
query23_1	15958	16116	16002	16002
query24	7374	1648	1271	1271
query24_1	1239	1236	1197	1197
query25	624	472	426	426
query26	1242	270	158	158
query27	2784	455	317	317
query28	4454	2122	2117	2117
query29	796	533	440	440
query30	315	244	218	218
query31	807	704	607	607
query32	77	70	64	64
query33	544	346	291	291
query34	902	898	537	537
query35	781	832	725	725
query36	874	900	830	830
query37	129	93	79	79
query38	2813	2896	2875	2875
query39	757	746	723	723
query39_1	712	706	692	692
query40	227	141	124	124
query41	72	64	66	64
query42	106	107	105	105
query43	435	427	400	400
query44	1334	755	764	755
query45	194	195	182	182
query46	873	986	613	613
query47	1654	1705	1592	1592
query48	320	330	244	244
query49	640	428	352	352
query50	656	291	221	221
query51	3860	3854	3859	3854
query52	104	109	95	95
query53	324	358	302	302
query54	285	257	258	257
query55	89	77	73	73
query56	305	286	298	286
query57	1133	1126	1069	1069
query58	277	255	253	253
query59	2431	2484	2395	2395
query60	306	300	301	300
query61	165	158	163	158
query62	690	699	642	642
query63	329	298	300	298
query64	4969	1327	1035	1035
query65	4031	3927	3947	3927
query66	1471	436	324	324
query67	15102	15020	14848	14848
query68	5173	1021	743	743
query69	514	358	315	315
query70	1081	976	970	970
query71	380	306	282	282
query72	6260	5225	5030	5030
query73	668	583	307	307
query74	8772	8864	8573	8573
query75	3180	3164	2800	2800
query76	3845	1134	722	722
query77	531	393	293	293
query78	9743	9692	8896	8896
query79	1184	856	634	634
query80	1531	674	552	552
query81	553	269	237	237
query82	440	135	105	105
query83	360	255	242	242
query84	262	129	114	114
query85	945	518	465	465
query86	382	298	271	271
query87	3029	3114	3005	3005
query88	3219	2275	2261	2261
query89	470	423	388	388
query90	1951	163	153	153
query91	175	169	145	145
query92	71	68	69	68
query93	1076	892	563	563
query94	531	308	273	273
query95	578	328	314	314
query96	582	460	220	220
query97	2317	2367	2262	2262
query98	211	202	188	188
query99	1276	1283	1175	1175
Total cold run time: 256399 ms
Total hot run time: 178363 ms

@doris-robot
Copy link

doris-robot commented Dec 16, 2025

ClickBench: Total hot run time: 27.65 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit fee457e70de22f8e9a52857742b04a88d7b44a45, data reload: false

query1	0.05	0.04	0.04
query2	0.10	0.05	0.05
query3	0.26	0.09	0.09
query4	1.61	0.12	0.11
query5	0.26	0.26	0.25
query6	1.18	0.64	0.64
query7	0.03	0.02	0.03
query8	0.05	0.04	0.04
query9	0.58	0.52	0.50
query10	0.57	0.54	0.55
query11	0.17	0.11	0.12
query12	0.16	0.12	0.12
query13	0.64	0.61	0.60
query14	1.01	1.00	0.99
query15	0.82	0.80	0.82
query16	0.41	0.40	0.40
query17	1.05	1.04	0.98
query18	0.23	0.21	0.22
query19	1.96	1.78	1.89
query20	0.02	0.01	0.01
query21	15.49	0.32	0.14
query22	4.69	0.06	0.05
query23	15.99	0.29	0.11
query24	1.76	0.67	0.70
query25	0.12	0.09	0.09
query26	0.14	0.14	0.13
query27	0.06	0.06	0.07
query28	6.35	1.24	1.04
query29	12.64	4.17	3.22
query30	0.28	0.14	0.12
query31	2.82	0.63	0.40
query32	3.24	0.55	0.45
query33	3.08	2.98	3.05
query34	16.96	5.18	4.53
query35	4.61	4.58	4.56
query36	0.68	0.52	0.49
query37	0.11	0.07	0.06
query38	0.07	0.05	0.04
query39	0.04	0.04	0.03
query40	0.16	0.14	0.13
query41	0.09	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 100.62 s
Total hot run time: 27.65 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Dec 16, 2025

FE UT Coverage Report

Increment line coverage 52.68% (59/112) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Contributor

hello-stephen commented Dec 16, 2025

FE Regression Coverage Report

Increment line coverage 66.07% (74/112) 🎉
Increment coverage report
Complete coverage report

@924060929
Copy link
Contributor Author

924060929 commented Dec 17, 2025

run buildall

@924060929
Copy link
Contributor Author

924060929 commented Dec 31, 2025

run buildall

@doris-robot
Copy link

doris-robot commented Dec 31, 2025

TPC-H: Total hot run time: 35258 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b2e0198031172db18da6bc9fa4273f0ba3c48f7a, data reload: false

------ Round 1 ----------------------------------
q1	17608	4254	4031	4031
q2	2031	361	237	237
q3	10180	1291	762	762
q4	10209	854	319	319
q5	7550	2158	1881	1881
q6	186	168	138	138
q7	951	772	657	657
q8	9300	1433	1157	1157
q9	6769	5185	5241	5185
q10	6760	1824	1421	1421
q11	495	303	282	282
q12	689	725	604	604
q13	17767	3797	3079	3079
q14	286	316	288	288
q15	568	509	510	509
q16	696	684	630	630
q17	715	740	630	630
q18	7334	7497	8060	7497
q19	1111	986	712	712
q20	455	420	263	263
q21	4587	4321	3919	3919
q22	1150	1111	1057	1057
Total cold run time: 107397 ms
Total hot run time: 35258 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4315	4205	4258	4205
q2	333	415	349	349
q3	2511	2828	2442	2442
q4	1415	1884	1418	1418
q5	4402	4357	4527	4357
q6	211	166	124	124
q7	1930	1919	1701	1701
q8	2555	2393	2322	2322
q9	7222	7108	7165	7108
q10	2514	2717	2280	2280
q11	525	487	473	473
q12	770	748	638	638
q13	3395	3762	3051	3051
q14	273	275	255	255
q15	532	486	481	481
q16	622	646	591	591
q17	1051	1209	1240	1209
q18	7317	7415	7222	7222
q19	862	861	873	861
q20	1919	1985	1796	1796
q21	4520	4244	4161	4161
q22	1069	1039	982	982
Total cold run time: 50263 ms
Total hot run time: 48026 ms

@doris-robot
Copy link

doris-robot commented Dec 31, 2025

TPC-DS: Total hot run time: 174426 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b2e0198031172db18da6bc9fa4273f0ba3c48f7a, data reload: false

query5	5906	582	437	437
query6	325	221	209	209
query7	4207	474	271	271
query8	333	258	240	240
query9	8798	2588	2626	2588
query10	555	378	334	334
query11	15083	15121	14789	14789
query12	185	120	117	117
query13	1259	523	389	389
query14	7743	2963	2706	2706
query14_1	2632	2591	2668	2591
query15	256	192	181	181
query16	997	506	455	455
query17	1294	708	594	594
query18	2730	448	352	352
query19	273	226	207	207
query20	124	120	120	120
query21	217	138	122	122
query22	4123	4121	4208	4121
query23	16078	15931	15511	15511
query23_1	15649	15320	15438	15320
query24	7031	1594	1240	1240
query24_1	1234	1209	1234	1209
query25	584	484	446	446
query26	1226	265	171	171
query27	2699	455	302	302
query28	4550	2207	2201	2201
query29	841	556	457	457
query30	308	245	219	219
query31	766	642	536	536
query32	79	73	72	72
query33	544	355	313	313
query34	878	902	536	536
query35	767	802	688	688
query36	856	927	748	748
query37	126	94	81	81
query38	2672	2663	2733	2663
query39	790	772	723	723
query39_1	722	708	721	708
query40	225	137	126	126
query41	77	114	63	63
query42	105	115	115	115
query43	473	436	425	425
query44	1397	750	749	749
query45	182	177	176	176
query46	873	978	626	626
query47	1459	1485	1344	1344
query48	322	340	257	257
query49	606	409	332	332
query50	645	275	219	219
query51	3731	3764	3724	3724
query52	108	105	97	97
query53	306	329	271	271
query54	289	262	246	246
query55	83	75	74	74
query56	284	289	283	283
query57	1030	1007	904	904
query58	270	261	249	249
query59	2036	2222	1955	1955
query60	319	322	304	304
query61	162	160	160	160
query62	376	349	326	326
query63	298	266	273	266
query64	4924	1321	993	993
query65	3841	3707	3652	3652
query66	1339	429	312	312
query67	15956	15846	14854	14854
query68	6160	1025	740	740
query69	501	343	313	313
query70	1083	968	922	922
query71	410	300	274	274
query72	6130	4742	5128	4742
query73	710	599	316	316
query74	8750	8804	8523	8523
query75	2926	2903	2493	2493
query76	3778	1059	675	675
query77	527	384	282	282
query78	9647	9881	9163	9163
query79	1271	915	618	618
query80	667	605	484	484
query81	509	267	234	234
query82	211	144	107	107
query83	264	254	239	239
query84	257	116	106	106
query85	892	518	469	469
query86	367	290	287	287
query87	2814	2871	2761	2761
query88	3166	2257	2242	2242
query89	378	359	324	324
query90	2204	158	147	147
query91	177	166	141	141
query92	76	70	62	62
query93	1104	917	570	570
query94	569	346	299	299
query95	548	366	307	307
query96	574	451	211	211
query97	2348	2423	2281	2281
query98	241	205	204	204
query99	576	595	510	510
Total cold run time: 256011 ms
Total hot run time: 174426 ms

@doris-robot
Copy link

doris-robot commented Dec 31, 2025

ClickBench: Total hot run time: 26.94 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b2e0198031172db18da6bc9fa4273f0ba3c48f7a, data reload: false

query1	0.05	0.04	0.04
query2	0.10	0.05	0.04
query3	0.26	0.09	0.08
query4	1.60	0.11	0.11
query5	0.27	0.25	0.26
query6	1.15	0.66	0.66
query7	0.04	0.03	0.02
query8	0.05	0.04	0.04
query9	0.57	0.50	0.50
query10	0.53	0.54	0.55
query11	0.17	0.11	0.11
query12	0.16	0.13	0.13
query13	0.62	0.60	0.62
query14	0.99	1.00	0.99
query15	0.80	0.80	0.80
query16	0.38	0.40	0.39
query17	1.03	1.07	1.05
query18	0.23	0.22	0.21
query19	1.87	1.83	1.88
query20	0.01	0.01	0.02
query21	15.44	0.28	0.13
query22	4.72	0.04	0.04
query23	16.02	0.30	0.10
query24	1.14	0.60	0.24
query25	0.07	0.06	0.05
query26	0.14	0.13	0.14
query27	0.12	0.05	0.06
query28	3.83	1.05	0.88
query29	12.57	3.95	3.17
query30	0.28	0.14	0.12
query31	2.80	0.62	0.39
query32	3.23	0.56	0.45
query33	2.97	3.03	3.05
query34	16.72	5.14	4.46
query35	4.48	4.57	4.47
query36	0.67	0.50	0.49
query37	0.12	0.07	0.06
query38	0.07	0.04	0.04
query39	0.05	0.03	0.03
query40	0.17	0.14	0.13
query41	0.09	0.04	0.03
query42	0.05	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 96.67 s
Total hot run time: 26.94 s

@doris-robot
Copy link

doris-robot commented Dec 31, 2025

BE UT Coverage Report

Increment line coverage 0.00% (0/7) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 53.38% (18955/35510)
Line Coverage 39.27% (175953/448088)
Region Coverage 33.82% (136102/402431)
Branch Coverage 34.76% (58798/169142)

@hello-stephen
Copy link
Contributor

hello-stephen commented Dec 31, 2025

BE Regression && UT Coverage Report

Increment line coverage 71.43% (5/7) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 72.27% (25093/34723)
Line Coverage 58.99% (263694/446981)
Region Coverage 53.82% (218863/406642)
Branch Coverage 55.39% (94006/169726)

@hello-stephen
Copy link
Contributor

hello-stephen commented Dec 31, 2025

FE Regression Coverage Report

Increment line coverage 74.47% (140/188) 🎉
Increment coverage report
Complete coverage report

@924060929
Copy link
Contributor Author

924060929 commented Jan 4, 2026

run buildall

@924060929
Copy link
Contributor Author

924060929 commented Jan 4, 2026

run buildall

@doris-robot
Copy link

doris-robot commented Jan 4, 2026

TPC-H: Total hot run time: 32053 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dce6dff1cb764b1b9c6337941c86b2b677ddc561, data reload: false

------ Round 1 ----------------------------------
q1	17604	4259	4056	4056
q2	2072	364	251	251
q3	10113	1330	722	722
q4	10201	835	312	312
q5	7517	2107	1857	1857
q6	183	168	138	138
q7	970	775	645	645
q8	9274	1450	1181	1181
q9	4894	4611	4561	4561
q10	6749	1809	1415	1415
q11	523	314	287	287
q12	686	745	579	579
q13	17803	3834	3095	3095
q14	300	302	267	267
q15	561	508	500	500
q16	699	696	614	614
q17	687	815	496	496
q18	6738	6536	6931	6536
q19	1175	1015	686	686
q20	457	404	267	267
q21	3231	2566	2566	2566
q22	1146	1124	1022	1022
Total cold run time: 103583 ms
Total hot run time: 32053 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4525	4282	4221	4221
q2	347	408	345	345
q3	2504	2736	2350	2350
q4	1453	1856	1440	1440
q5	4449	4334	4379	4334
q6	226	169	127	127
q7	1967	1886	1715	1715
q8	2521	2427	2396	2396
q9	7308	7165	7143	7143
q10	2467	2763	2258	2258
q11	598	512	463	463
q12	682	796	588	588
q13	3696	4033	3440	3440
q14	296	285	295	285
q15	557	501	498	498
q16	643	668	594	594
q17	1074	1307	1338	1307
q18	7524	7247	7176	7176
q19	810	783	811	783
q20	1879	1983	1814	1814
q21	4609	4146	4160	4146
q22	1108	1043	1002	1002
Total cold run time: 51243 ms
Total hot run time: 48425 ms

@doris-robot
Copy link

doris-robot commented Jan 4, 2026

TPC-DS: Total hot run time: 173216 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dce6dff1cb764b1b9c6337941c86b2b677ddc561, data reload: false

query5	5900	597	443	443
query6	336	234	205	205
query7	4231	458	277	277
query8	362	246	232	232
query9	8822	2600	2647	2600
query10	575	353	333	333
query11	15285	15218	14849	14849
query12	189	119	117	117
query13	1246	480	383	383
query14	7789	3088	2870	2870
query14_1	2718	2726	2723	2723
query15	264	193	177	177
query16	981	475	380	380
query17	1265	657	548	548
query18	2707	419	337	337
query19	295	222	211	211
query20	131	119	119	119
query21	219	137	117	117
query22	3816	3972	3786	3786
query23	16012	15539	15360	15360
query23_1	15401	15492	15346	15346
query24	6992	1531	1164	1164
query24_1	1206	1170	1205	1170
query25	526	442	393	393
query26	1221	259	161	161
query27	2708	461	298	298
query28	4567	2143	2152	2143
query29	760	556	425	425
query30	312	239	214	214
query31	779	653	540	540
query32	75	69	69	69
query33	526	330	286	286
query34	877	883	528	528
query35	775	807	695	695
query36	905	913	774	774
query37	129	106	79	79
query38	2690	2729	2692	2692
query39	778	770	728	728
query39_1	708	699	716	699
query40	213	136	118	118
query41	67	65	67	65
query42	108	106	102	102
query43	444	440	391	391
query44	1321	724	736	724
query45	188	184	177	177
query46	877	952	593	593
query47	1330	1404	1396	1396
query48	312	329	245	245
query49	610	445	341	341
query50	634	277	215	215
query51	3773	3757	3828	3757
query52	107	113	103	103
query53	305	328	279	279
query54	285	262	252	252
query55	83	74	72	72
query56	298	291	310	291
query57	1010	983	927	927
query58	272	258	271	258
query59	2089	2244	2192	2192
query60	350	335	314	314
query61	190	191	188	188
query62	376	365	316	316
query63	302	275	278	275
query64	4973	1438	1110	1110
query65	3813	3745	3755	3745
query66	1375	422	322	322
query67	15206	15174	15566	15174
query68	3537	1065	743	743
query69	505	368	320	320
query70	1025	936	956	936
query71	372	321	290	290
query72	6543	3544	3471	3471
query73	755	731	304	304
query74	8774	8779	8621	8621
query75	2827	2793	2468	2468
query76	3634	1084	683	683
query77	528	374	283	283
query78	9718	10050	9236	9236
query79	1075	848	590	590
query80	1221	558	476	476
query81	551	265	237	237
query82	407	145	110	110
query83	371	257	246	246
query84	260	118	105	105
query85	947	507	460	460
query86	468	322	287	287
query87	2919	2969	2759	2759
query88	3173	2234	2240	2234
query89	379	341	324	324
query90	1907	151	149	149
query91	173	168	148	148
query92	74	72	67	67
query93	1041	871	535	535
query94	649	312	281	281
query95	554	384	310	310
query96	580	477	204	204
query97	2323	2378	2291	2291
query98	205	195	197	195
query99	574	603	506	506
Total cold run time: 253449 ms
Total hot run time: 173216 ms

@doris-robot
Copy link

doris-robot commented Jan 4, 2026

ClickBench: Total hot run time: 26.85 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dce6dff1cb764b1b9c6337941c86b2b677ddc561, data reload: false

query1	0.05	0.04	0.04
query2	0.11	0.05	0.04
query3	0.26	0.09	0.08
query4	1.60	0.12	0.11
query5	0.27	0.27	0.26
query6	1.15	0.66	0.64
query7	0.04	0.03	0.03
query8	0.06	0.04	0.04
query9	0.56	0.50	0.50
query10	0.54	0.52	0.54
query11	0.14	0.10	0.10
query12	0.15	0.11	0.11
query13	0.59	0.58	0.59
query14	0.95	0.95	0.95
query15	0.79	0.78	0.78
query16	0.39	0.38	0.41
query17	1.01	1.01	0.98
query18	0.22	0.21	0.21
query19	1.86	1.84	1.87
query20	0.02	0.01	0.01
query21	15.47	0.25	0.13
query22	5.17	0.05	0.04
query23	15.93	0.27	0.10
query24	0.99	0.23	0.23
query25	0.13	0.06	0.06
query26	0.13	0.14	0.14
query27	0.05	0.06	0.06
query28	3.26	1.06	0.89
query29	12.55	3.94	3.18
query30	0.27	0.13	0.12
query31	2.83	0.64	0.40
query32	3.23	0.57	0.47
query33	2.95	3.02	3.01
query34	16.88	5.13	4.49
query35	4.47	4.53	4.51
query36	0.66	0.50	0.48
query37	0.11	0.07	0.06
query38	0.08	0.04	0.04
query39	0.04	0.02	0.02
query40	0.17	0.15	0.14
query41	0.09	0.03	0.03
query42	0.04	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 96.3 s
Total hot run time: 26.85 s

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 4, 2026

FE UT Coverage Report

Increment line coverage 50.80% (95/187) 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link

doris-robot commented Jan 4, 2026

BE UT Coverage Report

Increment line coverage 0.00% (0/12) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 53.27% (18968/35605)
Line Coverage 39.24% (176008/448565)
Region Coverage 33.79% (136240/403231)
Branch Coverage 34.74% (58812/169306)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 4, 2026

BE Regression && UT Coverage Report

Increment line coverage 83.33% (10/12) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 73.99% (25757/34810)
Line Coverage 61.36% (274514/447381)
Region Coverage 56.06% (228390/407415)
Branch Coverage 58.10% (98694/169870)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 4, 2026

BE Regression && UT Coverage Report

Increment line coverage 83.33% (10/12) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 72.31% (25171/34810)
Line Coverage 59.02% (264050/447381)
Region Coverage 53.60% (218393/407415)
Branch Coverage 55.38% (94070/169870)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 4, 2026

BE Regression && UT Coverage Report

Increment line coverage 83.33% (10/12) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 72.30% (25167/34810)
Line Coverage 59.01% (263991/447381)
Region Coverage 53.59% (218320/407415)
Branch Coverage 55.36% (94040/169870)

1 similar comment
@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 4, 2026

BE Regression && UT Coverage Report

Increment line coverage 83.33% (10/12) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 72.30% (25167/34810)
Line Coverage 59.01% (263991/447381)
Region Coverage 53.59% (218320/407415)
Branch Coverage 55.36% (94040/169870)

@hello-stephen
Copy link
Contributor

hello-stephen commented Jan 4, 2026

FE Regression Coverage Report

Increment line coverage 74.87% (140/187) 🎉
Increment coverage report
Complete coverage report

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 5, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Jan 5, 2026

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 5, 2026

PR approved by anyone and no changes requested.

@924060929 924060929 merged commit bf2e1c2 into apache:master Jan 5, 2026
27 of 29 checks passed
@924060929 924060929 deleted the bucket-shuffle-union branch January 5, 2026 07:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@starocean999 starocean999 starocean999 approved these changes

@morrySnow morrySnow morrySnow approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@924060929 @hello-stephen @doris-robot @starocean999 @morrySnow