Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fix](mtmv) regression test unstable and error #41145

Draft
wants to merge 8 commits into
base: master
Choose a base branch
from
Draft

[fix](mtmv) regression test unstable and error #41145

wants to merge 8 commits into from

Conversation

seawinde
Copy link
Contributor

@seawinde seawinde commented Sep 23, 2024 •
edited
Loading

Proposed changes

This is brought by #39265

  1. Some test fail because MaterializedViewRewriteSuccessButNotChose, because in these tests materialized view are not analyzed after create, So Add analyze clause when waite materialized view task finished
  2. No signature of method: org.apache.doris.regression.suite.Suite.check_mv_rewrite_success(), because check_mv_rewrite_success is not available in Suite.groovy. Fix this by using correct method.

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@seawinde
Copy link
Contributor Author

run buildall

@morningman morningman changed the title Fix regression test unstable and error [fix](mtmv) regression test unstable and error Sep 23, 2024
morningman
morningman previously approved these changes Sep 23, 2024
View reviewed changes
Copy link
Contributor

@morningman morningman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 23, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

morrySnow
morrySnow previously approved these changes Sep 23, 2024
View reviewed changes
@seawinde seawinde dismissed stale reviews from morrySnow and morningman via 120c66f September 23, 2024 12:36
@seawinde
Copy link
Contributor Author

run buildall

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Sep 23, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 41676 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 120c66f202726f25478b09f25b2eff4dd2f182a6, data reload: false

------ Round 1 ----------------------------------
q1	17616	7462	7314	7314
q2	2002	283	279	279
q3	12290	1074	1274	1074
q4	10568	811	774	774
q5	7792	3119	3119	3119
q6	244	154	148	148
q7	1031	618	602	602
q8	9503	2082	2055	2055
q9	7876	6450	6443	6443
q10	7006	2339	2313	2313
q11	440	242	243	242
q12	422	217	209	209
q13	17792	2943	2948	2943
q14	245	208	221	208
q15	579	533	511	511
q16	685	623	623	623
q17	976	823	870	823
q18	7181	6685	6782	6685
q19	1398	1004	971	971
q20	566	270	282	270
q21	3984	3354	3082	3082
q22	1098	988	1001	988
Total cold run time: 111294 ms
Total hot run time: 41676 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7432	7332	8104	7332
q2	328	238	251	238
q3	3101	2957	2974	2957
q4	2077	1810	1741	1741
q5	5720	5536	5718	5536
q6	235	148	145	145
q7	2185	1828	1797	1797
q8	3320	3500	3438	3438
q9	8876	8839	8782	8782
q10	3477	3506	3480	3480
q11	583	470	458	458
q12	829	623	608	608
q13	10949	3154	3136	3136
q14	305	288	285	285
q15	556	552	525	525
q16	706	683	684	683
q17	1814	1624	1622	1622
q18	8189	7672	7830	7672
q19	1742	1634	1709	1634
q20	2132	1902	1885	1885
q21	5359	5370	5373	5370
q22	1155	1042	1012	1012
Total cold run time: 71070 ms
Total hot run time: 60336 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191859 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 120c66f202726f25478b09f25b2eff4dd2f182a6, data reload: false

query1	934	382	382	382
query2	6339	1970	1975	1970
query3	8694	203	198	198
query4	33892	23558	23609	23558
query5	3462	470	466	466
query6	286	174	165	165
query7	4188	297	309	297
query8	290	226	218	218
query9	9251	2632	2625	2625
query10	458	278	274	274
query11	18425	15267	15192	15192
query12	153	100	101	100
query13	1538	435	424	424
query14	9526	7444	7286	7286
query15	250	168	171	168
query16	8103	501	484	484
query17	1671	628	574	574
query18	2215	317	324	317
query19	367	161	156	156
query20	123	121	114	114
query21	210	103	105	103
query22	4642	4651	4495	4495
query23	35231	34804	34397	34397
query24	11045	2857	2883	2857
query25	624	427	408	408
query26	1138	161	156	156
query27	2357	287	283	283
query28	7485	2436	2436	2436
query29	815	432	426	426
query30	259	157	157	157
query31	1008	793	784	784
query32	102	52	53	52
query33	749	302	293	293
query34	926	503	471	471
query35	867	721	727	721
query36	1092	939	941	939
query37	161	88	87	87
query38	4024	3901	3853	3853
query39	1497	1413	1411	1411
query40	213	95	96	95
query41	50	48	48	48
query42	120	96	97	96
query43	511	472	474	472
query44	1246	827	796	796
query45	202	163	162	162
query46	1134	763	749	749
query47	1933	1821	1886	1821
query48	475	387	351	351
query49	872	384	383	383
query50	814	396	407	396
query51	7045	6921	6948	6921
query52	101	86	82	82
query53	250	174	171	171
query54	1128	465	470	465
query55	77	72	79	72
query56	269	257	249	249
query57	1211	1110	1101	1101
query58	235	236	227	227
query59	3191	3004	2835	2835
query60	295	257	249	249
query61	104	104	108	104
query62	799	685	674	674
query63	220	183	182	182
query64	3928	641	617	617
query65	3257	3179	3167	3167
query66	765	299	294	294
query67	15778	15587	15572	15572
query68	4925	573	561	561
query69	551	286	287	286
query70	1191	1111	1131	1111
query71	379	267	268	267
query72	7577	4184	4024	4024
query73	755	320	334	320
query74	10380	8903	9040	8903
query75	3994	2635	2648	2635
query76	3308	970	884	884
query77	721	286	292	286
query78	9954	10094	9554	9554
query79	2105	538	541	538
query80	1209	443	448	443
query81	588	243	250	243
query82	483	145	150	145
query83	356	131	139	131
query84	286	82	73	73
query85	1318	284	274	274
query86	447	314	298	298
query87	4522	4404	4368	4368
query88	3521	2339	2307	2307
query89	395	277	289	277
query90	2045	186	187	186
query91	176	145	148	145
query92	63	46	48	46
query93	1267	528	534	528
query94	930	291	290	290
query95	353	249	253	249
query96	608	271	279	271
query97	3312	3098	3088	3088
query98	221	204	195	195
query99	1530	1307	1285	1285
Total cold run time: 300090 ms
Total hot run time: 191859 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.68 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 120c66f202726f25478b09f25b2eff4dd2f182a6, data reload: false

query1	0.05	0.05	0.05
query2	0.06	0.02	0.03
query3	0.23	0.07	0.07
query4	1.65	0.11	0.10
query5	0.52	0.51	0.52
query6	1.14	0.71	0.73
query7	0.02	0.02	0.01
query8	0.04	0.03	0.02
query9	0.58	0.50	0.49
query10	0.55	0.55	0.54
query11	0.14	0.11	0.10
query12	0.14	0.11	0.11
query13	0.60	0.59	0.59
query14	2.98	2.95	2.99
query15	0.88	0.81	0.82
query16	0.38	0.39	0.37
query17	1.08	1.04	1.04
query18	0.20	0.19	0.19
query19	1.92	1.78	1.92
query20	0.01	0.01	0.01
query21	15.36	0.59	0.57
query22	2.69	1.88	1.90
query23	17.32	0.76	0.68
query24	2.90	0.99	1.67
query25	0.26	0.13	0.19
query26	0.36	0.14	0.13
query27	0.03	0.04	0.05
query28	10.38	1.12	1.11
query29	12.54	3.26	3.27
query30	0.25	0.06	0.06
query31	2.88	0.39	0.37
query32	3.28	0.47	0.46
query33	3.06	2.98	3.01
query34	17.07	4.37	4.36
query35	4.44	4.42	4.44
query36	0.65	0.48	0.48
query37	0.08	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.12	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.02	0.03
Total cold run time: 107.09 s
Total hot run time: 32.68 s

@seawinde
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40878 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b4144844d0786f7c21f8669ccc979481e5a950ff, data reload: false

------ Round 1 ----------------------------------
q1	17569	7509	7235	7235
q2	2040	288	269	269
q3	12151	1061	1097	1061
q4	10552	699	714	699
q5	7742	2893	2831	2831
q6	242	150	148	148
q7	1001	623	605	605
q8	9352	1932	1943	1932
q9	6633	6450	6399	6399
q10	7017	2261	2351	2261
q11	445	243	240	240
q12	426	218	222	218
q13	17788	2984	2965	2965
q14	248	221	220	220
q15	571	544	518	518
q16	664	610	602	602
q17	978	615	601	601
q18	7090	6721	6753	6721
q19	1396	985	1057	985
q20	574	296	287	287
q21	4192	3254	3098	3098
q22	1102	983	1001	983
Total cold run time: 109773 ms
Total hot run time: 40878 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7230	7270	7187	7187
q2	330	235	236	235
q3	3043	2958	3005	2958
q4	2086	1865	1841	1841
q5	5686	5672	5738	5672
q6	235	149	147	147
q7	2220	1824	1812	1812
q8	3349	3531	3508	3508
q9	8835	9042	8947	8947
q10	3528	3526	3573	3526
q11	593	496	504	496
q12	829	641	622	622
q13	7694	3199	3149	3149
q14	316	279	296	279
q15	579	527	533	527
q16	721	685	667	667
q17	1872	1658	1633	1633
q18	8285	7978	7818	7818
q19	1712	1670	1494	1494
q20	2133	1845	1908	1845
q21	5559	5400	5518	5400
q22	1108	1057	1057	1057
Total cold run time: 67943 ms
Total hot run time: 60820 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191885 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b4144844d0786f7c21f8669ccc979481e5a950ff, data reload: false

query1	945	389	398	389
query2	6375	2153	2094	2094
query3	8678	194	210	194
query4	33734	23712	23482	23482
query5	3543	475	478	475
query6	276	171	172	171
query7	4198	307	310	307
query8	295	237	233	233
query9	9589	2699	2674	2674
query10	470	284	267	267
query11	18034	15108	15024	15024
query12	159	97	97	97
query13	1533	440	421	421
query14	9783	7094	7421	7094
query15	270	171	186	171
query16	7354	457	484	457
query17	1823	591	578	578
query18	1930	312	320	312
query19	370	154	153	153
query20	122	109	112	109
query21	209	104	104	104
query22	4870	4582	4371	4371
query23	35128	34586	34718	34586
query24	11168	2796	2806	2796
query25	623	399	416	399
query26	922	166	166	166
query27	2182	293	301	293
query28	7584	2457	2420	2420
query29	720	425	406	406
query30	254	153	156	153
query31	1029	786	795	786
query32	99	51	57	51
query33	735	282	295	282
query34	936	495	496	495
query35	881	743	733	733
query36	1113	952	949	949
query37	151	76	85	76
query38	3976	3939	3930	3930
query39	1482	1448	1425	1425
query40	203	95	93	93
query41	51	46	49	46
query42	117	97	95	95
query43	537	496	501	496
query44	1221	807	791	791
query45	196	166	162	162
query46	1142	703	702	702
query47	1941	1824	1840	1824
query48	467	373	367	367
query49	863	393	408	393
query50	806	422	435	422
query51	7032	6987	6980	6980
query52	96	91	88	88
query53	253	181	181	181
query54	1202	468	471	468
query55	77	79	77	77
query56	285	269	280	269
query57	1241	1112	1088	1088
query58	250	224	235	224
query59	3447	2972	3021	2972
query60	302	273	278	273
query61	101	102	121	102
query62	843	675	667	667
query63	227	190	185	185
query64	3974	647	607	607
query65	3294	3183	3206	3183
query66	768	317	312	312
query67	16117	15710	15576	15576
query68	4042	571	574	571
query69	491	298	299	298
query70	1173	1102	1098	1098
query71	364	275	275	275
query72	7236	4116	4003	4003
query73	784	355	349	349
query74	9999	9058	9020	9020
query75	3457	2700	2692	2692
query76	2944	931	934	931
query77	598	315	298	298
query78	9903	9183	9258	9183
query79	1969	594	615	594
query80	1180	454	445	445
query81	595	243	244	243
query82	638	144	135	135
query83	301	140	134	134
query84	273	79	81	79
query85	1378	290	285	285
query86	445	283	264	264
query87	4504	4218	4322	4218
query88	3037	2456	2415	2415
query89	410	290	287	287
query90	1850	191	187	187
query91	180	144	142	142
query92	59	52	48	48
query93	2582	545	548	545
query94	899	268	293	268
query95	358	254	254	254
query96	624	283	283	283
query97	3281	3088	3101	3088
query98	220	210	195	195
query99	1568	1328	1292	1292
Total cold run time: 297938 ms
Total hot run time: 191885 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.83 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b4144844d0786f7c21f8669ccc979481e5a950ff, data reload: false

query1	0.05	0.05	0.04
query2	0.07	0.03	0.03
query3	0.23	0.07	0.06
query4	1.65	0.11	0.09
query5	0.50	0.49	0.51
query6	1.14	0.74	0.71
query7	0.02	0.01	0.04
query8	0.04	0.03	0.03
query9	0.55	0.50	0.48
query10	0.55	0.55	0.53
query11	0.14	0.10	0.10
query12	0.13	0.11	0.10
query13	0.61	0.60	0.60
query14	2.93	2.96	2.97
query15	0.90	0.83	0.83
query16	0.37	0.39	0.38
query17	1.03	1.04	1.04
query18	0.20	0.20	0.20
query19	1.98	1.83	2.02
query20	0.01	0.01	0.00
query21	15.35	0.57	0.58
query22	2.32	1.81	2.11
query23	17.27	1.03	0.79
query24	2.49	1.00	0.95
query25	0.34	0.06	0.14
query26	0.42	0.14	0.14
query27	0.04	0.04	0.04
query28	11.08	1.09	1.07
query29	12.54	3.28	3.26
query30	0.24	0.06	0.06
query31	2.86	0.39	0.38
query32	3.28	0.48	0.46
query33	3.00	3.06	3.03
query34	17.08	4.49	4.53
query35	4.52	4.51	4.45
query36	0.67	0.48	0.49
query37	0.09	0.06	0.05
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.15	0.12	0.11
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 107.06 s
Total hot run time: 32.83 s

@seawinde
Copy link
Contributor Author

run buildall

1 similar comment
@seawinde
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41151 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 689462e72d1dc1485db8beae9ea206294a6ceb62, data reload: false

------ Round 1 ----------------------------------
q1	17567	7558	7318	7318
q2	2016	282	275	275
q3	12110	1090	1206	1090
q4	10596	760	754	754
q5	7759	2871	2867	2867
q6	240	155	148	148
q7	1002	620	626	620
q8	9371	1969	1984	1969
q9	6560	6434	6457	6434
q10	6943	2290	2301	2290
q11	446	247	248	247
q12	418	221	220	220
q13	17826	3017	2988	2988
q14	237	207	208	207
q15	585	534	513	513
q16	678	606	610	606
q17	977	534	478	478
q18	7302	6769	6710	6710
q19	1397	966	1082	966
q20	574	286	281	281
q21	3991	3180	3266	3180
q22	1109	990	1015	990
Total cold run time: 109704 ms
Total hot run time: 41151 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7296	7246	7254	7246
q2	324	241	230	230
q3	3068	2957	2953	2953
q4	2066	1822	1833	1822
q5	5701	5683	5693	5683
q6	233	147	141	141
q7	2223	1837	1813	1813
q8	3364	3490	3542	3490
q9	8886	9068	8933	8933
q10	3588	3507	3586	3507
q11	589	495	482	482
q12	821	596	616	596
q13	8958	3156	3156	3156
q14	295	284	287	284
q15	587	512	539	512
q16	739	682	655	655
q17	1836	1619	1605	1605
q18	8293	7916	7814	7814
q19	1727	1647	1530	1530
q20	2145	1886	1875	1875
q21	5658	5144	5444	5144
q22	1139	1043	1053	1043
Total cold run time: 69536 ms
Total hot run time: 60514 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190767 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 689462e72d1dc1485db8beae9ea206294a6ceb62, data reload: false

query1	933	386	386	386
query2	6404	2069	1987	1987
query3	8688	201	199	199
query4	33862	23686	23388	23388
query5	3450	480	455	455
query6	290	184	174	174
query7	4191	304	300	300
query8	290	228	230	228
query9	9229	2670	2674	2670
query10	468	282	276	276
query11	17878	15147	15232	15147
query12	163	96	99	96
query13	1522	443	412	412
query14	9666	7451	7277	7277
query15	304	173	169	169
query16	7935	442	429	429
query17	1703	592	585	585
query18	2141	299	306	299
query19	380	154	155	154
query20	130	119	111	111
query21	211	114	112	112
query22	4940	4678	4736	4678
query23	35353	34621	35116	34621
query24	11043	2941	2919	2919
query25	613	408	416	408
query26	1101	168	164	164
query27	2252	298	308	298
query28	7339	2455	2442	2442
query29	813	444	429	429
query30	253	155	161	155
query31	1003	777	791	777
query32	93	55	55	55
query33	739	305	304	304
query34	980	507	513	507
query35	865	741	759	741
query36	1115	956	933	933
query37	156	89	84	84
query38	3970	3933	3889	3889
query39	1476	1430	1428	1428
query40	213	96	97	96
query41	50	49	50	49
query42	120	100	94	94
query43	537	484	480	480
query44	1194	807	795	795
query45	192	167	164	164
query46	1132	711	729	711
query47	1918	1802	1861	1802
query48	465	365	368	365
query49	883	412	402	402
query50	821	420	416	416
query51	7167	6973	6804	6804
query52	97	89	87	87
query53	263	186	189	186
query54	1106	467	475	467
query55	83	77	77	77
query56	276	284	268	268
query57	1225	1110	1073	1073
query58	264	249	241	241
query59	3319	2950	2914	2914
query60	316	283	285	283
query61	129	124	133	124
query62	817	664	679	664
query63	218	191	184	184
query64	4056	636	603	603
query65	3289	3364	3177	3177
query66	698	301	317	301
query67	15964	15700	15569	15569
query68	4651	564	552	552
query69	627	299	300	299
query70	1171	1076	1057	1057
query71	404	278	277	277
query72	7602	2470	3812	2470
query73	758	340	343	340
query74	10486	9115	8922	8922
query75	4565	2711	2749	2711
query76	3675	957	937	937
query77	741	302	290	290
query78	10152	9486	9272	9272
query79	2468	581	617	581
query80	2397	453	459	453
query81	597	240	242	240
query82	667	141	140	140
query83	315	134	135	134
query84	286	83	81	81
query85	1546	297	293	293
query86	446	295	302	295
query87	4500	4336	4332	4332
query88	3560	2414	2380	2380
query89	404	310	289	289
query90	2107	187	187	187
query91	176	143	138	138
query92	63	48	48	48
query93	2160	546	537	537
query94	1057	306	299	299
query95	360	259	256	256
query96	623	276	280	276
query97	3303	3140	3145	3140
query98	222	205	194	194
query99	1688	1312	1265	1265
Total cold run time: 304531 ms
Total hot run time: 190767 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.79 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 689462e72d1dc1485db8beae9ea206294a6ceb62, data reload: false

query1	0.04	0.05	0.04
query2	0.07	0.03	0.02
query3	0.23	0.06	0.07
query4	1.64	0.11	0.10
query5	0.52	0.52	0.51
query6	1.15	0.72	0.72
query7	0.02	0.01	0.01
query8	0.04	0.03	0.04
query9	0.58	0.51	0.50
query10	0.57	0.61	0.57
query11	0.14	0.10	0.11
query12	0.14	0.11	0.11
query13	0.62	0.60	0.59
query14	2.96	2.96	2.96
query15	0.90	0.83	0.82
query16	0.39	0.40	0.36
query17	1.05	1.05	1.07
query18	0.19	0.20	0.20
query19	2.01	1.88	2.00
query20	0.02	0.01	0.01
query21	15.35	0.62	0.60
query22	2.69	2.91	1.84
query23	17.43	0.78	0.83
query24	3.33	0.74	1.19
query25	0.28	0.12	0.09
query26	0.48	0.14	0.12
query27	0.05	0.04	0.03
query28	10.69	1.09	1.07
query29	12.53	3.25	3.22
query30	0.24	0.06	0.06
query31	2.90	0.37	0.38
query32	3.29	0.47	0.45
query33	2.99	3.04	3.06
query34	16.97	4.47	4.47
query35	4.52	4.49	4.52
query36	0.69	0.49	0.48
query37	0.09	0.05	0.06
query38	0.05	0.03	0.03
query39	0.03	0.03	0.03
query40	0.15	0.13	0.12
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 108.17 s
Total hot run time: 32.79 s

@seawinde
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41199 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit efe16cf37dfbb925371e766c1034293e2e1cd7bc, data reload: false

------ Round 1 ----------------------------------
q1	18146	7451	7321	7321
q2	2499	165	167	165
q3	11668	1345	1205	1205
q4	11175	738	773	738
q5	8096	2943	2951	2943
q6	244	153	159	153
q7	999	637	613	613
q8	9362	1975	1940	1940
q9	6619	6441	6469	6441
q10	6953	2311	2321	2311
q11	440	241	264	241
q12	426	224	210	210
q13	17815	2986	2967	2967
q14	249	216	211	211
q15	560	519	535	519
q16	658	620	612	612
q17	983	605	607	605
q18	7268	6802	6739	6739
q19	1396	971	993	971
q20	503	202	194	194
q21	4076	3105	3234	3105
q22	1102	1003	995	995
Total cold run time: 111237 ms
Total hot run time: 41199 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7244	7228	7222	7222
q2	330	239	232	232
q3	2883	2812	2772	2772
q4	1948	1782	1722	1722
q5	5437	5465	5488	5465
q6	227	137	141	137
q7	2100	1685	1737	1685
q8	3212	3407	3399	3399
q9	8604	8594	8510	8510
q10	3490	3459	3431	3431
q11	594	475	468	468
q12	779	592	618	592
q13	5904	2982	2984	2982
q14	308	285	261	261
q15	568	518	508	508
q16	692	695	666	666
q17	1776	1578	1554	1554
q18	7806	7532	7325	7325
q19	1669	1544	1532	1532
q20	2050	1806	1874	1806
q21	5403	5199	5246	5199
q22	1130	1043	1021	1021
Total cold run time: 64154 ms
Total hot run time: 58489 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192372 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit efe16cf37dfbb925371e766c1034293e2e1cd7bc, data reload: false

query1	988	376	373	373
query2	6513	2057	2060	2057
query3	6700	211	225	211
query4	34508	23376	23365	23365
query5	4401	484	462	462
query6	259	174	160	160
query7	4618	311	318	311
query8	296	241	224	224
query9	9794	2713	2687	2687
query10	478	279	285	279
query11	18253	15206	15186	15186
query12	153	97	104	97
query13	1635	436	419	419
query14	10868	6674	7455	6674
query15	252	172	178	172
query16	7375	442	479	442
query17	1658	574	599	574
query18	2010	319	313	313
query19	354	152	152	152
query20	126	108	106	106
query21	214	110	108	108
query22	4633	4691	4407	4407
query23	34892	33933	34104	33933
query24	11156	2817	2831	2817
query25	671	415	423	415
query26	1251	168	166	166
query27	2719	303	301	301
query28	8079	2473	2448	2448
query29	857	451	446	446
query30	322	164	160	160
query31	1029	786	847	786
query32	101	58	58	58
query33	768	306	315	306
query34	946	503	497	497
query35	881	749	725	725
query36	1106	977	951	951
query37	163	94	84	84
query38	4073	3937	3995	3937
query39	1477	1474	1424	1424
query40	211	100	99	99
query41	52	51	51	51
query42	121	99	96	96
query43	526	481	490	481
query44	1308	817	800	800
query45	198	169	173	169
query46	1143	729	743	729
query47	1933	1838	1892	1838
query48	462	377	388	377
query49	1156	425	427	425
query50	844	407	420	407
query51	7165	7000	7132	7000
query52	99	86	89	86
query53	262	192	186	186
query54	1166	474	473	473
query55	80	77	79	77
query56	302	261	268	261
query57	1237	1116	1142	1116
query58	251	239	258	239
query59	3225	3007	2983	2983
query60	323	277	280	277
query61	138	104	106	104
query62	888	674	668	668
query63	216	192	186	186
query64	4876	647	624	624
query65	3308	3235	3219	3219
query66	1441	310	303	303
query67	16104	15636	15796	15636
query68	5027	581	563	563
query69	510	288	306	288
query70	1136	1132	1143	1132
query71	361	263	282	263
query72	7397	3982	3996	3982
query73	772	346	349	346
query74	10416	9191	9130	9130
query75	3446	2648	2674	2648
query76	3529	924	918	918
query77	618	300	292	292
query78	11472	11802	10110	10110
query79	7423	585	587	585
query80	987	454	438	438
query81	587	242	241	241
query82	944	140	145	140
query83	322	142	143	142
query84	296	81	75	75
query85	752	297	275	275
query86	497	309	255	255
query87	4612	4361	4383	4361
query88	4890	2416	2407	2407
query89	423	288	289	288
query90	2095	198	192	192
query91	184	149	145	145
query92	63	51	49	49
query93	4027	574	556	556
query94	1046	300	316	300
query95	360	259	256	256
query96	663	290	285	285
query97	3299	3097	3102	3097
query98	237	197	202	197
query99	1797	1304	1273	1273
Total cold run time: 315800 ms
Total hot run time: 192372 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.04 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit efe16cf37dfbb925371e766c1034293e2e1cd7bc, data reload: false

query1	0.05	0.04	0.04
query2	0.07	0.03	0.03
query3	0.22	0.06	0.06
query4	1.65	0.10	0.10
query5	0.54	0.52	0.51
query6	1.13	0.72	0.72
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.57	0.49	0.50
query10	0.55	0.58	0.55
query11	0.13	0.10	0.10
query12	0.14	0.10	0.11
query13	0.61	0.60	0.59
query14	2.93	3.02	3.12
query15	0.91	0.82	0.84
query16	0.38	0.38	0.39
query17	1.03	1.04	1.00
query18	0.24	0.22	0.22
query19	1.87	1.86	2.05
query20	0.01	0.02	0.01
query21	15.35	0.59	0.59
query22	2.72	2.99	1.86
query23	17.56	0.85	0.84
query24	2.51	1.05	0.99
query25	0.35	0.11	0.04
query26	0.48	0.14	0.14
query27	0.05	0.04	0.03
query28	11.03	1.10	1.06
query29	12.57	3.28	3.30
query30	0.25	0.06	0.06
query31	2.89	0.38	0.38
query32	3.27	0.48	0.45
query33	3.06	3.00	3.04
query34	17.36	4.47	4.44
query35	4.50	4.46	4.49
query36	0.66	0.48	0.48
query37	0.08	0.06	0.06
query38	0.04	0.03	0.03
query39	0.03	0.02	0.02
query40	0.16	0.14	0.13
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.02	0.03
Total cold run time: 108.14 s
Total hot run time: 33.04 s

@seawinde
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40793 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit be158f56334ad21d6e08b581f7dc91775168f474, data reload: false

------ Round 1 ----------------------------------
q1	17579	7380	7296	7296
q2	2017	306	277	277
q3	12246	1045	1169	1045
q4	10568	754	755	754
q5	7777	2884	2809	2809
q6	239	152	148	148
q7	972	613	610	610
q8	9361	1917	1907	1907
q9	7746	6435	6444	6435
q10	6938	2282	2278	2278
q11	449	249	247	247
q12	425	219	224	219
q13	17794	2965	3012	2965
q14	249	222	207	207
q15	576	531	520	520
q16	664	592	579	579
q17	967	539	520	520
q18	7101	6596	6664	6596
q19	1386	1087	1067	1067
q20	465	209	208	208
q21	3938	3120	3165	3120
q22	1112	1002	986	986
Total cold run time: 110569 ms
Total hot run time: 40793 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7303	7236	7275	7236
q2	332	229	230	229
q3	3037	2892	2906	2892
q4	2082	1877	1793	1793
q5	5720	5736	5718	5718
q6	225	142	147	142
q7	2219	1820	1790	1790
q8	3372	3598	3400	3400
q9	8954	8907	8828	8828
q10	3584	3568	3530	3530
q11	573	485	498	485
q12	800	597	647	597
q13	9896	3226	3232	3226
q14	308	265	271	265
q15	578	511	520	511
q16	688	663	646	646
q17	1846	1608	1588	1588
q18	8237	7773	7644	7644
q19	1701	1563	1370	1370
q20	2123	1883	1883	1883
q21	5512	5348	5421	5348
q22	1173	1082	1049	1049
Total cold run time: 70263 ms
Total hot run time: 60170 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193087 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit be158f56334ad21d6e08b581f7dc91775168f474, data reload: false

query1	921	387	388	387
query2	6242	2155	2003	2003
query3	8686	206	211	206
query4	33335	23530	23316	23316
query5	3392	475	508	475
query6	270	161	165	161
query7	4200	305	321	305
query8	276	215	224	215
query9	9335	2722	2693	2693
query10	474	300	325	300
query11	17906	15218	15239	15218
query12	157	100	98	98
query13	1539	449	417	417
query14	8598	7644	7685	7644
query15	255	179	178	178
query16	8081	478	481	478
query17	1682	626	593	593
query18	2150	324	320	320
query19	366	161	163	161
query20	123	116	115	115
query21	220	114	109	109
query22	4631	4565	4377	4377
query23	35197	34173	34269	34173
query24	10641	2844	2926	2844
query25	588	421	421	421
query26	730	168	171	168
query27	2006	306	319	306
query28	6484	2449	2446	2446
query29	764	449	438	438
query30	257	155	152	152
query31	1040	816	830	816
query32	102	55	60	55
query33	676	310	312	310
query34	920	507	517	507
query35	862	740	738	738
query36	1080	941	971	941
query37	150	89	91	89
query38	4066	3969	3892	3892
query39	1476	1412	1442	1412
query40	207	108	98	98
query41	50	48	48	48
query42	125	101	98	98
query43	545	507	496	496
query44	1168	808	800	800
query45	200	169	167	167
query46	1171	723	746	723
query47	1920	1833	1829	1829
query48	478	395	392	392
query49	899	428	420	420
query50	841	412	420	412
query51	7084	7043	6953	6953
query52	101	87	91	87
query53	260	195	195	195
query54	1222	480	491	480
query55	80	80	74	74
query56	294	272	271	271
query57	1217	1105	1101	1101
query58	244	260	263	260
query59	3254	3072	3281	3072
query60	283	270	269	269
query61	103	104	103	103
query62	872	674	668	668
query63	227	194	190	190
query64	3955	634	610	610
query65	3324	3226	3198	3198
query66	849	308	295	295
query67	15983	15498	15496	15496
query68	4577	620	576	576
query69	567	307	310	307
query70	1158	1123	1135	1123
query71	395	277	284	277
query72	7498	3919	3995	3919
query73	766	344	347	344
query74	10423	9056	9068	9056
query75	3414	2763	2694	2694
query76	3175	877	965	877
query77	410	294	294	294
query78	10783	9925	9669	9669
query79	4915	609	606	606
query80	2178	458	444	444
query81	560	250	242	242
query82	776	137	142	137
query83	307	138	149	138
query84	294	75	77	75
query85	1529	296	291	291
query86	487	303	285	285
query87	4629	4387	4363	4363
query88	4512	2408	2390	2390
query89	412	295	293	293
query90	2054	193	191	191
query91	193	148	149	148
query92	62	49	51	49
query93	3587	556	556	556
query94	1033	309	295	295
query95	363	259	257	257
query96	654	291	284	284
query97	3278	3136	3148	3136
query98	219	205	192	192
query99	1565	1303	1297	1297
Total cold run time: 303607 ms
Total hot run time: 193087 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.03 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit be158f56334ad21d6e08b581f7dc91775168f474, data reload: false

query1	0.05	0.04	0.04
query2	0.06	0.02	0.03
query3	0.23	0.06	0.06
query4	1.65	0.10	0.10
query5	0.52	0.50	0.51
query6	1.13	0.73	0.73
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.57	0.50	0.50
query10	0.56	0.57	0.55
query11	0.13	0.10	0.12
query12	0.15	0.11	0.11
query13	0.60	0.59	0.61
query14	2.72	2.74	2.82
query15	0.92	0.82	0.82
query16	0.38	0.40	0.41
query17	1.05	1.07	1.04
query18	0.20	0.20	0.19
query19	1.98	1.84	2.01
query20	0.01	0.01	0.01
query21	15.35	0.60	0.59
query22	2.57	2.67	1.39
query23	17.07	0.78	0.86
query24	2.70	0.67	1.67
query25	0.31	0.15	0.08
query26	0.40	0.14	0.13
query27	0.05	0.04	0.04
query28	10.65	1.09	1.08
query29	12.53	3.32	3.30
query30	0.25	0.06	0.06
query31	2.88	0.39	0.39
query32	3.25	0.48	0.46
query33	2.99	2.97	3.05
query34	16.70	4.47	4.45
query35	4.54	4.48	4.55
query36	0.66	0.47	0.49
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.02	0.02	0.02
query40	0.15	0.13	0.12
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.31 s
Total hot run time: 32.03 s

zfr9527
zfr9527 approved these changes Sep 27, 2024
View reviewed changes
Copy link
Contributor

@zfr9527 zfr9527 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

zfr9527
zfr9527 reviewed Sep 27, 2024
View reviewed changes
regression-test/framework/src/main/groovy/org/apache/doris/regression/suite/Suite.groovy
}

// multi mv part in rewrite process, any of them rewrte success without check if chosen by cbo or not
def mv_rewrite_any_success_without_check_chosen = { query_sql, mv_names, sync_cbo_rewrite = true ->
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It can automatically adjust the switch according to the version number?

@morrySnow morrySnow marked this pull request as draft September 27, 2024 11:30
@seawinde
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40877 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit be158f56334ad21d6e08b581f7dc91775168f474, data reload: false

------ Round 1 ----------------------------------
q1	17567	7442	7240	7240
q2	2040	274	268	268
q3	12190	1038	1136	1038
q4	10564	765	740	740
q5	7782	2866	2850	2850
q6	235	150	149	149
q7	971	616	624	616
q8	9343	1929	1949	1929
q9	6658	6404	6361	6361
q10	6978	2319	2313	2313
q11	436	249	258	249
q12	413	222	225	222
q13	17784	2994	2999	2994
q14	242	209	205	205
q15	584	533	517	517
q16	653	576	574	574
q17	974	579	553	553
q18	7192	6727	6665	6665
q19	1398	1024	974	974
q20	505	216	206	206
q21	3963	3314	3229	3229
q22	1120	1005	985	985
Total cold run time: 109592 ms
Total hot run time: 40877 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7274	7251	7220	7220
q2	333	229	228	228
q3	2991	2892	2930	2892
q4	2026	1836	1781	1781
q5	5754	5775	5738	5738
q6	237	148	146	146
q7	2225	1846	1819	1819
q8	3371	3596	3443	3443
q9	8996	8939	8836	8836
q10	3575	3574	3533	3533
q11	573	481	502	481
q12	790	585	613	585
q13	10560	3183	3226	3183
q14	316	287	264	264
q15	573	516	538	516
q16	678	637	661	637
q17	1868	1647	1604	1604
q18	8320	7665	7671	7665
q19	1703	1514	1459	1459
q20	2084	1858	1902	1858
q21	5670	5468	5485	5468
q22	1105	1058	1026	1026
Total cold run time: 71022 ms
Total hot run time: 60382 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192216 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit be158f56334ad21d6e08b581f7dc91775168f474, data reload: false

query1	934	382	386	382
query2	6267	2049	2055	2049
query3	8677	197	198	197
query4	33562	23582	23496	23496
query5	3524	464	468	464
query6	275	168	166	166
query7	4185	299	305	299
query8	272	220	213	213
query9	9234	2707	2693	2693
query10	472	288	282	282
query11	18126	15264	15432	15264
query12	152	101	99	99
query13	1535	444	407	407
query14	9701	6904	7695	6904
query15	267	169	174	169
query16	8021	461	473	461
query17	1674	640	616	616
query18	2136	331	317	317
query19	363	168	161	161
query20	128	121	115	115
query21	215	107	107	107
query22	4662	4431	4514	4431
query23	35550	35425	34294	34294
query24	11047	2866	2895	2866
query25	538	417	417	417
query26	715	170	170	170
query27	2176	306	306	306
query28	7432	2466	2427	2427
query29	667	443	435	435
query30	265	153	157	153
query31	1034	819	804	804
query32	98	57	59	57
query33	756	313	301	301
query34	931	506	524	506
query35	849	753	729	729
query36	1095	942	930	930
query37	143	88	88	88
query38	4006	3980	3901	3901
query39	1517	1448	1401	1401
query40	203	101	99	99
query41	50	48	48	48
query42	116	102	96	96
query43	544	493	480	480
query44	1263	800	807	800
query45	201	175	167	167
query46	1149	737	748	737
query47	1932	1790	1827	1790
query48	476	372	387	372
query49	882	428	420	420
query50	836	417	429	417
query51	7099	6994	6954	6954
query52	97	86	88	86
query53	269	190	183	183
query54	1106	494	465	465
query55	84	77	78	77
query56	293	279	257	257
query57	1176	1081	1113	1081
query58	241	236	238	236
query59	3042	2853	2781	2781
query60	281	265	264	264
query61	105	106	104	104
query62	820	665	663	663
query63	229	194	192	192
query64	3861	643	611	611
query65	3238	3172	3212	3172
query66	727	305	302	302
query67	16001	15692	15493	15493
query68	4505	578	624	578
query69	546	300	309	300
query70	1297	1158	1215	1158
query71	368	280	290	280
query72	7405	4121	4022	4022
query73	782	348	349	348
query74	10212	9134	8957	8957
query75	3464	2656	2659	2656
query76	3222	974	922	922
query77	631	303	300	300
query78	10565	9628	9657	9628
query79	1941	591	629	591
query80	2445	479	472	472
query81	594	234	235	234
query82	689	142	132	132
query83	294	141	140	140
query84	283	83	79	79
query85	1530	305	301	301
query86	428	310	297	297
query87	4500	4326	4329	4326
query88	3592	2442	2377	2377
query89	413	293	290	290
query90	2062	184	185	184
query91	181	142	142	142
query92	66	48	50	48
query93	1889	566	553	553
query94	1020	307	303	303
query95	359	259	264	259
query96	618	285	282	282
query97	3252	3133	3128	3128
query98	223	195	190	190
query99	1568	1326	1315	1315
Total cold run time: 300466 ms
Total hot run time: 192216 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.55 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit be158f56334ad21d6e08b581f7dc91775168f474, data reload: false

query1	0.05	0.04	0.05
query2	0.06	0.03	0.02
query3	0.23	0.07	0.07
query4	1.64	0.10	0.10
query5	0.51	0.50	0.51
query6	1.13	0.72	0.72
query7	0.02	0.01	0.02
query8	0.04	0.03	0.04
query9	0.57	0.51	0.49
query10	0.54	0.56	0.55
query11	0.14	0.10	0.11
query12	0.14	0.11	0.10
query13	0.61	0.60	0.58
query14	2.71	2.71	2.85
query15	0.91	0.82	0.82
query16	0.38	0.37	0.41
query17	0.99	1.00	1.01
query18	0.20	0.19	0.20
query19	1.86	1.87	1.96
query20	0.02	0.01	0.01
query21	15.36	0.59	0.58
query22	3.02	2.30	1.56
query23	16.98	0.94	0.84
query24	2.64	1.20	1.39
query25	0.29	0.05	0.14
query26	0.42	0.14	0.13
query27	0.03	0.04	0.03
query28	10.45	1.09	1.07
query29	12.54	3.16	3.17
query30	0.26	0.06	0.06
query31	2.87	0.38	0.38
query32	3.27	0.47	0.45
query33	2.96	3.01	3.01
query34	16.94	4.48	4.47
query35	4.56	4.49	4.50
query36	0.67	0.50	0.49
query37	0.08	0.06	0.06
query38	0.04	0.03	0.03
query39	0.03	0.02	0.02
query40	0.16	0.12	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.46 s
Total hot run time: 32.55 s

@seawinde seawinde force-pushed the fix_regression_test_unstable_and_error branch from be158f5 to 621dc13 Compare October 8, 2024 12:21
@seawinde
Copy link
Contributor Author

seawinde commented Oct 8, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40749 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 621dc13e735c36a1037b6e31e197f71c9ab6bf71, data reload: false

------ Round 1 ----------------------------------
q1	17563	7403	7291	7291
q2	2033	273	280	273
q3	11892	1056	1199	1056
q4	10571	727	751	727
q5	7742	2842	2843	2842
q6	238	152	150	150
q7	1006	625	620	620
q8	9376	1890	1927	1890
q9	6594	6408	6450	6408
q10	6927	2303	2288	2288
q11	439	251	259	251
q12	408	219	217	217
q13	17786	2961	2964	2961
q14	239	205	204	204
q15	556	507	533	507
q16	637	592	590	590
q17	969	504	526	504
q18	7132	6648	6622	6622
q19	1335	919	1021	919
q20	488	203	191	191
q21	3982	3249	3265	3249
q22	1099	989	994	989
Total cold run time: 109012 ms
Total hot run time: 40749 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7267	7246	7251	7246
q2	324	226	226	226
q3	2937	2915	2935	2915
q4	2084	1861	1849	1849
q5	5780	5729	5757	5729
q6	241	149	149	149
q7	2267	1838	1801	1801
q8	3364	3563	3470	3470
q9	8881	8854	8844	8844
q10	3603	3564	3525	3525
q11	575	490	472	472
q12	848	689	605	605
q13	9387	3179	3158	3158
q14	294	292	281	281
q15	570	527	541	527
q16	659	633	628	628
q17	1862	1644	1612	1612
q18	8331	7771	7539	7539
q19	1719	1456	1453	1453
q20	2085	1866	1899	1866
q21	5535	5321	5458	5321
q22	1136	1081	1069	1069
Total cold run time: 69749 ms
Total hot run time: 60285 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192644 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 621dc13e735c36a1037b6e31e197f71c9ab6bf71, data reload: false

query1	923	393	393	393
query2	6248	2128	2058	2058
query3	8698	196	196	196
query4	34113	23686	23467	23467
query5	3608	476	447	447
query6	286	181	159	159
query7	4201	303	311	303
query8	290	212	230	212
query9	9535	2715	2709	2709
query10	476	299	287	287
query11	17861	15107	15279	15107
query12	153	99	96	96
query13	1577	465	450	450
query14	10449	7458	7376	7376
query15	248	173	180	173
query16	8037	499	496	496
query17	1606	592	589	589
query18	2185	329	316	316
query19	360	154	158	154
query20	125	114	112	112
query21	211	108	105	105
query22	4624	4753	4669	4669
query23	34860	34079	34083	34079
query24	10958	2831	2839	2831
query25	618	417	412	412
query26	1172	168	166	166
query27	2263	316	302	302
query28	7396	2412	2400	2400
query29	878	445	430	430
query30	257	154	156	154
query31	1049	798	793	793
query32	98	56	55	55
query33	765	304	305	304
query34	918	514	505	505
query35	895	752	753	752
query36	1119	953	964	953
query37	155	92	88	88
query38	4187	3949	3987	3949
query39	1471	1424	1408	1408
query40	197	99	96	96
query41	50	44	45	44
query42	117	94	95	94
query43	532	500	485	485
query44	1283	805	828	805
query45	198	164	167	164
query46	1181	730	728	728
query47	1966	1861	1849	1849
query48	437	354	349	349
query49	947	404	396	396
query50	826	412	425	412
query51	7022	6911	6941	6911
query52	98	88	91	88
query53	255	181	184	181
query54	1107	480	470	470
query55	80	77	76	76
query56	305	248	254	248
query57	1263	1147	1145	1145
query58	227	220	228	220
query59	3217	3108	3087	3087
query60	303	262	267	262
query61	108	105	102	102
query62	873	686	658	658
query63	225	186	180	180
query64	3994	641	653	641
query65	3246	3219	3202	3202
query66	842	312	300	300
query67	15977	15554	15566	15554
query68	4272	571	567	567
query69	463	292	291	291
query70	1204	1110	1173	1110
query71	349	267	271	267
query72	7181	4159	3985	3985
query73	757	353	345	345
query74	10088	9111	9035	9035
query75	3392	2688	2624	2624
query76	2756	901	844	844
query77	608	299	285	285
query78	10666	9699	9559	9559
query79	1324	592	592	592
query80	2391	444	442	442
query81	597	236	235	235
query82	720	138	140	138
query83	290	136	132	132
query84	278	83	73	73
query85	1621	295	285	285
query86	427	313	284	284
query87	4566	4515	4292	4292
query88	3110	2487	2455	2455
query89	397	297	283	283
query90	2077	182	183	182
query91	140	105	106	105
query92	64	48	49	48
query93	1088	532	533	532
query94	1178	287	295	287
query95	349	252	256	252
query96	617	279	295	279
query97	3298	3136	3190	3136
query98	231	208	192	192
query99	1581	1306	1306	1306
Total cold run time: 299829 ms
Total hot run time: 192644 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.33 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 621dc13e735c36a1037b6e31e197f71c9ab6bf71, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.03	0.02
query3	0.23	0.07	0.06
query4	1.65	0.10	0.11
query5	0.53	0.51	0.52
query6	1.14	0.73	0.73
query7	0.02	0.02	0.02
query8	0.04	0.02	0.02
query9	0.56	0.50	0.51
query10	0.55	0.57	0.56
query11	0.14	0.11	0.10
query12	0.14	0.10	0.10
query13	0.61	0.60	0.60
query14	2.81	2.82	2.74
query15	0.91	0.81	0.82
query16	0.37	0.41	0.39
query17	1.06	1.04	1.04
query18	0.20	0.20	0.20
query19	1.96	1.87	2.02
query20	0.02	0.01	0.01
query21	15.36	0.59	0.60
query22	2.99	1.71	1.52
query23	16.99	0.96	0.82
query24	2.73	0.84	1.18
query25	0.30	0.10	0.04
query26	0.43	0.13	0.14
query27	0.04	0.04	0.05
query28	10.91	1.10	1.07
query29	12.58	3.25	3.25
query30	0.24	0.06	0.06
query31	2.89	0.38	0.37
query32	3.27	0.47	0.45
query33	3.01	3.01	3.04
query34	16.86	4.46	4.55
query35	4.54	4.49	4.47
query36	0.68	0.49	0.50
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.15	0.12	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 107.32 s
Total hot run time: 32.33 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@zfr9527 zfr9527 zfr9527 approved these changes

@morningman morningman morningman left review comments

@morrySnow morrySnow morrySnow left review comments

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
dev/3.0.x reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@seawinde @doris-robot @morningman @zfr9527 @morrySnow @shuke987