Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](Nereids) syntax of auto partition with date_trunc is wrong #32970

Closed
wants to merge 1 commit into from

Conversation

morrySnow
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38043 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1c21057b1505d340a0e67dc1178f437c142f6ff1, data reload: false

------ Round 1 ----------------------------------
q1	17627	4254	4084	4084
q2	2118	168	153	153
q3	10656	1235	1250	1235
q4	10700	737	845	737
q5	7738	3045	2996	2996
q6	208	129	128	128
q7	1073	621	592	592
q8	9574	2065	2081	2065
q9	7161	6500	6445	6445
q10	8457	3482	3602	3482
q11	436	222	226	222
q12	401	204	201	201
q13	17807	2847	2840	2840
q14	241	215	198	198
q15	506	463	452	452
q16	482	368	376	368
q17	976	521	614	521
q18	7190	6565	6461	6461
q19	1565	1460	1396	1396
q20	557	266	248	248
q21	3681	3005	2928	2928
q22	347	291	306	291
Total cold run time: 109501 ms
Total hot run time: 38043 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4136	4072	4132	4072
q2	336	232	231	231
q3	2966	2825	2844	2825
q4	1866	1597	1604	1597
q5	5252	5230	5285	5230
q6	199	116	119	116
q7	2207	1826	1835	1826
q8	3190	3340	3298	3298
q9	8470	8418	8442	8418
q10	3792	3778	3753	3753
q11	539	445	438	438
q12	740	539	591	539
q13	16894	2851	2842	2842
q14	294	242	252	242
q15	500	472	454	454
q16	466	406	420	406
q17	1741	1495	1487	1487
q18	7406	7156	7104	7104
q19	1610	1500	1537	1500
q20	1902	1706	1699	1699
q21	4837	4709	4765	4709
q22	511	451	460	451
Total cold run time: 69854 ms
Total hot run time: 53237 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 181427 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1c21057b1505d340a0e67dc1178f437c142f6ff1, data reload: false

query1	938	363	353	353
query2	6528	2055	1916	1916
query3	6708	214	207	207
query4	31963	21267	21292	21267
query5	4267	409	402	402
query6	272	188	180	180
query7	4640	287	290	287
query8	227	183	177	177
query9	9140	2357	2324	2324
query10	598	256	272	256
query11	15526	14319	14217	14217
query12	136	87	93	87
query13	1621	438	423	423
query14	12230	7770	7235	7235
query15	247	184	190	184
query16	7577	263	264	263
query17	1919	555	563	555
query18	1238	287	282	282
query19	256	161	152	152
query20	93	84	86	84
query21	203	123	124	123
query22	5014	4843	4832	4832
query23	33647	32895	32771	32771
query24	11874	2878	2836	2836
query25	622	360	366	360
query26	1580	153	157	153
query27	2961	358	363	358
query28	7511	1909	1890	1890
query29	921	624	623	623
query30	310	149	147	147
query31	983	728	738	728
query32	102	61	57	57
query33	769	258	247	247
query34	1124	493	491	491
query35	861	619	635	619
query36	1045	897	906	897
query37	213	63	68	63
query38	3592	3469	3451	3451
query39	1475	1459	1435	1435
query40	301	119	115	115
query41	56	49	48	48
query42	107	99	94	94
query43	499	453	473	453
query44	1213	744	741	741
query45	274	258	266	258
query46	1116	724	714	714
query47	1933	1858	1845	1845
query48	445	359	381	359
query49	1229	351	351	351
query50	756	381	373	373
query51	6975	6748	6733	6733
query52	104	94	95	94
query53	348	280	279	279
query54	335	247	232	232
query55	92	82	80	80
query56	250	229	227	227
query57	1247	1150	1143	1143
query58	230	209	211	209
query59	2798	2798	2574	2574
query60	272	246	255	246
query61	113	114	112	112
query62	637	405	434	405
query63	310	280	289	280
query64	6998	4097	4161	4097
query65	3094	3040	3033	3033
query66	1385	377	374	374
query67	15682	14952	14863	14863
query68	8793	528	546	528
query69	633	393	387	387
query70	1283	1196	1127	1127
query71	528	276	273	273
query72	6272	2507	2359	2359
query73	739	322	326	322
query74	8259	6465	6354	6354
query75	3748	2191	2282	2191
query76	5246	937	867	867
query77	629	262	270	262
query78	10733	10183	10074	10074
query79	9266	526	531	526
query80	1458	378	383	378
query81	516	213	217	213
query82	411	91	95	91
query83	214	143	152	143
query84	292	76	82	76
query85	1149	324	321	321
query86	373	298	324	298
query87	3777	3573	3596	3573
query88	4804	2322	2309	2309
query89	495	373	377	373
query90	2117	177	177	177
query91	170	139	155	139
query92	60	50	47	47
query93	5967	498	485	485
query94	1340	180	178	178
query95	434	331	334	331
query96	601	269	271	269
query97	2692	2536	2455	2455
query98	232	219	206	206
query99	1142	840	831	831
Total cold run time: 314103 ms
Total hot run time: 181427 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 1c21057b1505d340a0e67dc1178f437c142f6ff1 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.6 seconds inserted 10000000 Rows, about 735K ops/s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38008 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b6ec1b4a634144a4cf719b63e06ef7e59596cfe9, data reload: false

------ Round 1 ----------------------------------
q1	17616	4199	4113	4113
q2	2117	161	155	155
q3	11262	1148	1194	1148
q4	10698	843	788	788
q5	7849	2975	2941	2941
q6	209	130	128	128
q7	1066	627	593	593
q8	9915	2051	2016	2016
q9	7028	6492	6438	6438
q10	8884	3473	3567	3473
q11	432	226	216	216
q12	381	202	203	202
q13	17822	2868	2856	2856
q14	256	210	199	199
q15	533	479	465	465
q16	500	376	370	370
q17	966	634	594	594
q18	7149	6490	6464	6464
q19	1547	1458	1496	1458
q20	539	256	266	256
q21	3595	2889	2846	2846
q22	359	289	295	289
Total cold run time: 110723 ms
Total hot run time: 38008 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4133	4091	4109	4091
q2	329	238	233	233
q3	3021	2883	2858	2858
q4	1876	1611	1579	1579
q5	5226	5251	5207	5207
q6	201	117	120	117
q7	2189	1842	1785	1785
q8	3161	3280	3294	3280
q9	8511	8462	8464	8462
q10	3832	3762	3832	3762
q11	563	451	443	443
q12	721	567	558	558
q13	16896	2853	2879	2853
q14	288	252	255	252
q15	498	465	464	464
q16	474	423	435	423
q17	1747	1485	1432	1432
q18	7454	7211	7188	7188
q19	1621	1446	1517	1446
q20	1920	1745	1693	1693
q21	4742	4576	4795	4576
q22	523	457	455	455
Total cold run time: 69926 ms
Total hot run time: 53157 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 180954 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b6ec1b4a634144a4cf719b63e06ef7e59596cfe9, data reload: false

query1	945	380	361	361
query2	6526	2182	1897	1897
query3	6710	211	203	203
query4	32097	21445	21352	21352
query5	4279	392	404	392
query6	269	182	166	166
query7	4625	292	289	289
query8	234	167	171	167
query9	9231	2300	2265	2265
query10	571	253	256	253
query11	15434	14244	14334	14244
query12	139	85	86	85
query13	1616	421	417	417
query14	10994	7782	7030	7030
query15	231	193	188	188
query16	7962	262	261	261
query17	1930	581	554	554
query18	1353	303	280	280
query19	273	157	158	157
query20	99	86	89	86
query21	206	126	130	126
query22	5025	4862	4799	4799
query23	33341	32872	33005	32872
query24	11975	2927	2880	2880
query25	667	389	398	389
query26	1794	161	155	155
query27	3105	313	319	313
query28	7775	1917	1860	1860
query29	994	637	602	602
query30	307	146	146	146
query31	979	713	757	713
query32	96	56	54	54
query33	756	255	244	244
query34	1105	504	494	494
query35	896	692	684	684
query36	1007	883	878	878
query37	273	63	64	63
query38	3603	3509	3455	3455
query39	1580	1546	1593	1546
query40	293	110	103	103
query41	51	46	45	45
query42	109	93	96	93
query43	482	464	443	443
query44	1242	711	713	711
query45	273	266	261	261
query46	1105	688	683	683
query47	1900	1829	1844	1829
query48	424	362	358	358
query49	1234	328	341	328
query50	768	373	368	368
query51	6708	6557	6519	6519
query52	102	88	96	88
query53	351	274	275	274
query54	309	227	227	227
query55	84	79	80	79
query56	241	224	232	224
query57	1210	1100	1128	1100
query58	236	206	200	200
query59	2872	2626	2650	2626
query60	254	242	249	242
query61	100	94	96	94
query62	648	439	460	439
query63	309	274	276	274
query64	6243	3900	4036	3900
query65	3108	3055	3062	3055
query66	1357	382	369	369
query67	15666	14729	14890	14729
query68	5358	517	518	517
query69	593	394	388	388
query70	1169	1180	1194	1180
query71	409	276	267	267
query72	6314	2729	2499	2499
query73	712	314	318	314
query74	7799	6410	6395	6395
query75	3011	2282	2228	2228
query76	3481	908	856	856
query77	460	292	285	285
query78	10761	10193	10114	10114
query79	9897	520	518	518
query80	2114	374	367	367
query81	515	222	216	216
query82	1455	86	88	86
query83	255	138	141	138
query84	286	90	80	80
query85	1603	312	300	300
query86	470	288	280	280
query87	3748	3623	3571	3571
query88	5168	2326	2304	2304
query89	517	371	371	371
query90	1968	175	177	175
query91	174	137	140	137
query92	63	46	46	46
query93	7253	499	476	476
query94	1205	176	176	176
query95	413	307	308	307
query96	605	277	267	267
query97	2695	2471	2495	2471
query98	238	217	217	217
query99	1236	855	827	827
Total cold run time: 310626 ms
Total hot run time: 180954 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit b6ec1b4a634144a4cf719b63e06ef7e59596cfe9 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.8 seconds inserted 10000000 Rows, about 724K ops/s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38582 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e2045b83f1d3a97b8b2554a2b00e30c280a9f7d9, data reload: false

------ Round 1 ----------------------------------
q1	17818	4452	4426	4426
q2	2402	201	197	197
q3	10937	1146	1186	1146
q4	10541	773	818	773
q5	7611	2752	2815	2752
q6	212	130	132	130
q7	1034	592	629	592
q8	9286	2034	1999	1999
q9	7470	6588	6540	6540
q10	8418	3530	3487	3487
q11	433	239	231	231
q12	402	216	213	213
q13	17796	2985	2993	2985
q14	270	232	235	232
q15	531	472	462	462
q16	507	393	385	385
q17	967	613	589	589
q18	7415	6692	6680	6680
q19	1594	1452	1452	1452
q20	650	319	326	319
q21	3445	2685	2694	2685
q22	361	307	321	307
Total cold run time: 110100 ms
Total hot run time: 38582 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4300	4195	4129	4129
q2	373	275	252	252
q3	2913	2722	2659	2659
q4	1844	1518	1519	1518
q5	5271	5250	5181	5181
q6	207	125	127	125
q7	2195	1864	1876	1864
q8	3203	3267	3337	3267
q9	8599	8573	8539	8539
q10	3889	3628	3677	3628
q11	586	492	489	489
q12	760	559	599	559
q13	17582	2934	2912	2912
q14	301	266	261	261
q15	508	481	471	471
q16	479	419	422	419
q17	1754	1415	1444	1415
q18	7585	7371	7400	7371
q19	1606	1519	1503	1503
q20	1964	1769	1740	1740
q21	4981	4762	4780	4762
q22	541	453	475	453
Total cold run time: 71441 ms
Total hot run time: 53517 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 181648 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e2045b83f1d3a97b8b2554a2b00e30c280a9f7d9, data reload: false

query1	1272	1129	1117	1117
query2	7426	1927	1896	1896
query3	6666	215	222	215
query4	25998	21508	21275	21275
query5	4122	396	389	389
query6	262	174	172	172
query7	4593	299	292	292
query8	217	169	176	169
query9	8468	2275	2253	2253
query10	531	243	250	243
query11	14873	14183	14121	14121
query12	143	94	88	88
query13	1635	367	365	365
query14	11359	6801	6834	6801
query15	197	179	179	179
query16	6971	267	270	267
query17	1481	588	565	565
query18	842	287	279	279
query19	196	158	160	158
query20	91	86	86	86
query21	199	125	125	125
query22	4963	4841	4865	4841
query23	33167	32732	32729	32729
query24	12097	2808	2799	2799
query25	593	374	366	366
query26	1816	150	151	150
query27	3271	312	317	312
query28	7246	1817	1826	1817
query29	898	611	587	587
query30	299	151	146	146
query31	1009	675	712	675
query32	87	60	57	57
query33	687	247	237	237
query34	1086	487	489	487
query35	793	683	676	676
query36	1071	892	887	887
query37	103	68	66	66
query38	3575	3424	3421	3421
query39	1622	1557	1536	1536
query40	285	126	127	126
query41	52	47	47	47
query42	107	99	97	97
query43	488	449	455	449
query44	1150	723	716	716
query45	292	261	257	257
query46	1076	700	702	700
query47	1990	1879	1891	1879
query48	381	294	296	294
query49	1147	368	368	368
query50	772	391	389	389
query51	6809	6640	6630	6630
query52	106	96	91	91
query53	348	274	275	274
query54	295	260	237	237
query55	87	83	79	79
query56	246	225	229	225
query57	1253	1143	1138	1138
query58	229	206	211	206
query59	2952	2737	2659	2659
query60	262	265	255	255
query61	114	114	111	111
query62	655	435	428	428
query63	301	281	277	277
query64	6652	4206	4154	4154
query65	3098	3027	3015	3015
query66	1308	363	354	354
query67	15700	14888	15013	14888
query68	7793	546	553	546
query69	580	335	319	319
query70	1190	1210	1149	1149
query71	512	274	274	274
query72	7041	2696	2470	2470
query73	728	327	331	327
query74	6941	6438	6426	6426
query75	3388	2285	2282	2282
query76	5220	917	1046	917
query77	590	255	244	244
query78	10974	10215	10069	10069
query79	10360	519	522	519
query80	1679	418	413	413
query81	515	217	1066	217
query82	852	93	93	93
query83	223	169	168	168
query84	260	82	80	80
query85	1499	274	266	266
query86	512	301	298	298
query87	3752	3534	3599	3534
query88	5714	2394	2389	2389
query89	517	364	380	364
query90	1950	171	174	171
query91	123	98	96	96
query92	65	50	46	46
query93	7045	518	499	499
query94	1232	177	177	177
query95	394	316	302	302
query96	626	270	273	270
query97	2663	2499	2482	2482
query98	236	216	210	210
query99	1119	862	844	844
Total cold run time: 306373 ms
Total hot run time: 181648 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.1 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e2045b83f1d3a97b8b2554a2b00e30c280a9f7d9, data reload: false

query1	0.04	0.03	0.03
query2	0.09	0.04	0.03
query3	0.24	0.04	0.04
query4	1.67	0.06	0.07
query5	0.51	0.48	0.50
query6	1.14	0.65	0.66
query7	0.02	0.01	0.01
query8	0.04	0.04	0.04
query9	0.53	0.50	0.50
query10	0.56	0.55	0.55
query11	0.16	0.09	0.11
query12	0.13	0.11	0.10
query13	0.59	0.59	0.58
query14	0.76	0.78	0.77
query15	0.82	0.79	0.80
query16	0.37	0.37	0.38
query17	0.93	0.95	0.97
query18	0.21	0.22	0.24
query19	1.82	1.72	1.65
query20	0.01	0.00	0.01
query21	15.55	0.65	0.65
query22	2.43	2.60	2.47
query23	17.27	0.92	0.85
query24	1.18	0.22	0.19
query25	0.10	0.08	0.08
query26	0.24	0.18	0.17
query27	0.07	0.09	0.08
query28	14.11	0.93	0.92
query29	12.49	3.22	3.23
query30	0.28	0.09	0.08
query31	2.81	0.38	0.37
query32	3.26	0.45	0.46
query33	2.80	2.82	2.78
query34	16.62	4.48	4.40
query35	4.41	4.44	4.55
query36	0.62	0.47	0.46
query37	0.17	0.16	0.14
query38	0.15	0.13	0.13
query39	0.05	0.04	0.04
query40	0.18	0.15	0.15
query41	0.09	0.06	0.05
query42	0.05	0.05	0.04
query43	0.03	0.03	0.04
Total cold run time: 105.6 s
Total hot run time: 30.1 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit e2045b83f1d3a97b8b2554a2b00e30c280a9f7d9 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.7 seconds inserted 10000000 Rows, about 729K ops/s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38097 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f0610c5364434a2453f63c7aae14f879928e41f0, data reload: false

------ Round 1 ----------------------------------
q1	17609	4414	4196	4196
q2	2082	186	181	181
q3	10445	1149	1115	1115
q4	10195	772	749	749
q5	7467	2809	2638	2638
q6	217	129	131	129
q7	1018	619	590	590
q8	9323	2100	2058	2058
q9	7585	6642	6583	6583
q10	8598	3481	3564	3481
q11	462	242	231	231
q12	460	213	203	203
q13	18929	3001	2982	2982
q14	261	227	240	227
q15	513	466	457	457
q16	534	382	386	382
q17	960	595	601	595
q18	7432	6754	6617	6617
q19	5282	1359	1377	1359
q20	672	294	298	294
q21	3387	2835	2731	2731
q22	355	299	310	299
Total cold run time: 113786 ms
Total hot run time: 38097 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4422	4207	4204	4204
q2	381	271	272	271
q3	2989	2631	2708	2631
q4	1880	1522	1514	1514
q5	5253	5203	5259	5203
q6	207	121	122	121
q7	2247	1901	1867	1867
q8	3230	3319	3324	3319
q9	8561	8514	8568	8514
q10	4045	3881	3873	3873
q11	609	502	511	502
q12	782	647	631	631
q13	17993	3258	3160	3160
q14	316	292	290	290
q15	513	474	472	472
q16	498	462	458	458
q17	1817	1511	1444	1444
q18	8283	7903	7846	7846
q19	1617	1514	1539	1514
q20	2021	1873	1814	1814
q21	5239	4794	4947	4794
q22	563	473	456	456
Total cold run time: 73466 ms
Total hot run time: 54898 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 182381 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f0610c5364434a2453f63c7aae14f879928e41f0, data reload: false

query1	863	1129	1118	1118
query2	6929	2028	1902	1902
query3	6650	208	205	205
query4	24787	21442	21309	21309
query5	4210	393	406	393
query6	264	185	167	167
query7	4606	293	291	291
query8	222	174	176	174
query9	8445	2288	2271	2271
query10	421	238	236	236
query11	14922	14263	14171	14171
query12	134	90	86	86
query13	1622	364	361	361
query14	10563	6907	6730	6730
query15	195	174	175	174
query16	6819	280	274	274
query17	1378	586	564	564
query18	1382	299	285	285
query19	202	160	157	157
query20	94	86	91	86
query21	199	132	129	129
query22	5135	4946	5020	4946
query23	33630	33043	32866	32866
query24	11425	2980	2960	2960
query25	618	402	435	402
query26	1099	159	156	156
query27	2800	362	381	362
query28	6599	1932	1917	1917
query29	917	660	657	657
query30	304	172	161	161
query31	1012	753	732	732
query32	84	60	60	60
query33	690	264	276	264
query34	1082	488	508	488
query35	852	731	692	692
query36	1062	936	910	910
query37	108	69	71	69
query38	3658	3756	3609	3609
query39	1686	1595	1571	1571
query40	170	132	128	128
query41	47	46	46	46
query42	110	109	103	103
query43	493	469	456	456
query44	1243	744	756	744
query45	304	281	270	270
query46	1113	714	704	704
query47	2066	1953	2004	1953
query48	402	318	320	318
query49	852	371	385	371
query50	818	394	394	394
query51	6876	6783	6725	6725
query52	113	92	99	92
query53	364	282	284	282
query54	290	233	228	228
query55	90	75	79	75
query56	244	234	228	228
query57	1264	1142	1130	1130
query58	217	206	200	200
query59	2776	2503	2440	2440
query60	249	226	228	226
query61	91	93	117	93
query62	596	455	453	453
query63	302	276	278	276
query64	5042	4050	4163	4050
query65	3049	3031	3023	3023
query66	838	339	344	339
query67	15532	15008	14745	14745
query68	9771	538	540	538
query69	602	317	330	317
query70	1339	1085	1203	1085
query71	557	274	268	268
query72	7437	2601	2442	2442
query73	1653	324	321	321
query74	7157	6410	6434	6410
query75	4801	2327	2277	2277
query76	5726	966	941	941
query77	573	245	255	245
query78	11032	10191	10294	10191
query79	10089	525	529	525
query80	1461	409	405	405
query81	529	1067	223	223
query82	235	86	89	86
query83	205	165	166	165
query84	262	79	81	79
query85	842	266	259	259
query86	394	279	256	256
query87	3740	3506	3530	3506
query88	5555	2413	2486	2413
query89	503	365	377	365
query90	2017	175	171	171
query91	124	94	97	94
query92	60	45	46	45
query93	5906	508	503	503
query94	1274	188	177	177
query95	389	319	306	306
query96	595	270	272	270
query97	2697	2514	2466	2466
query98	239	228	217	217
query99	1017	820	818	818
Total cold run time: 302000 ms
Total hot run time: 182381 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.87 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f0610c5364434a2453f63c7aae14f879928e41f0, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.06
query4	1.66	0.06	0.06
query5	0.49	0.47	0.49
query6	1.13	0.65	0.65
query7	0.02	0.01	0.02
query8	0.04	0.04	0.04
query9	0.55	0.49	0.50
query10	0.55	0.55	0.55
query11	0.16	0.10	0.11
query12	0.14	0.11	0.10
query13	0.58	0.58	0.59
query14	0.74	0.78	0.79
query15	0.82	0.80	0.80
query16	0.35	0.35	0.36
query17	0.94	0.98	0.95
query18	0.21	0.23	0.25
query19	1.79	1.68	1.62
query20	0.02	0.01	0.02
query21	15.55	0.64	0.64
query22	2.56	2.28	2.25
query23	17.32	0.83	0.85
query24	1.18	0.24	0.21
query25	0.08	0.08	0.07
query26	0.24	0.16	0.16
query27	0.08	0.08	0.08
query28	14.03	0.92	0.91
query29	12.56	3.19	3.18
query30	0.27	0.08	0.07
query31	2.83	0.38	0.37
query32	3.27	0.45	0.46
query33	2.83	2.82	2.93
query34	16.68	4.38	4.44
query35	4.48	4.53	4.51
query36	0.61	0.47	0.46
query37	0.19	0.15	0.14
query38	0.15	0.14	0.14
query39	0.05	0.03	0.04
query40	0.17	0.15	0.16
query41	0.08	0.04	0.05
query42	0.06	0.05	0.04
query43	0.04	0.04	0.03
Total cold run time: 105.85 s
Total hot run time: 29.87 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit f0610c5364434a2453f63c7aae14f879928e41f0 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      33 seconds loaded 861443392 Bytes, about 24 MB/s
Insert into select:       13.4 seconds inserted 10000000 Rows, about 746K ops/s

@morrySnow
Copy link
Contributor Author

run feut

@morrySnow
Copy link
Contributor Author

duplicate with #32737

@morrySnow morrySnow closed this Mar 29, 2024
@morrySnow morrySnow deleted the fix_date_trunc_partition branch April 30, 2024 06:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants