[BugFix](StoragePolicy) fix modify partition's storage policy with different resource issue succeed with execption #35270

Johnnyssc · 2024-05-23T06:16:15Z

Proposed changes

Issue Number: close #34229

when we try to modify a partition's storage policy which have different resource with the previous one, we get error message "currently do not support change origin storage policy to another one with different resource", but the modification same also succeed!

expect:
the modification fail with "currently do not support change origin storage policy to another one with different resource".

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

doris-robot · 2024-05-23T06:16:20Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

Johnnyssc · 2024-05-23T06:18:09Z

run buildall

Johnnyssc · 2024-05-24T02:30:23Z

run buildall

doris-robot · 2024-05-24T03:11:26Z

TPC-H: Total hot run time: 49815 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5caada9aa65bab58e15e234b3cb4f77d5a7a3667, data reload: false

------ Round 1 ----------------------------------
q1	17675	4429	4389	4389
q2	2049	155	149	149
q3	10471	1866	1921	1866
q4	10369	1238	1325	1238
q5	9136	3911	3956	3911
q6	237	124	127	124
q7	2039	1586	1608	1586
q8	9359	2749	2721	2721
q9	10634	10222	10285	10222
q10	8603	3563	3459	3459
q11	419	244	251	244
q12	471	301	304	301
q13	18360	4022	4018	4018
q14	359	327	326	326
q15	518	453	459	453
q16	697	587	568	568
q17	1141	958	969	958
q18	7232	6938	6962	6938
q19	1708	1611	1547	1547
q20	522	303	307	303
q21	4418	4099	4157	4099
q22	492	398	395	395
Total cold run time: 116909 ms
Total hot run time: 49815 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4326	4382	4311	4311
q2	326	225	216	216
q3	4169	4227	4143	4143
q4	2738	2747	2743	2743
q5	7218	7138	7097	7097
q6	240	123	119	119
q7	3203	2825	2818	2818
q8	4415	4466	4508	4466
q9	16862	16894	16792	16792
q10	4249	4264	4235	4235
q11	751	707	695	695
q12	1028	874	867	867
q13	6772	3786	3754	3754
q14	462	418	423	418
q15	499	462	456	456
q16	749	688	681	681
q17	3758	3827	3886	3827
q18	8846	8847	8726	8726
q19	1711	1725	1671	1671
q20	2363	2184	2108	2108
q21	8592	8461	8511	8461
q22	1060	931	924	924
Total cold run time: 84337 ms
Total hot run time: 79528 ms

doris-robot · 2024-05-24T03:24:08Z

TPC-DS: Total hot run time: 203214 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5caada9aa65bab58e15e234b3cb4f77d5a7a3667, data reload: false

query1	922	387	373	373
query2	6544	2864	2769	2769
query3	6922	211	209	209
query4	19992	17954	18104	17954
query5	19727	6561	6512	6512
query6	281	220	233	220
query7	4167	305	301	301
query8	259	251	248	248
query9	3149	2715	2627	2627
query10	419	297	293	293
query11	11283	10552	10678	10552
query12	129	81	74	74
query13	5590	700	675	675
query14	17524	13618	13390	13390
query15	353	216	228	216
query16	6480	269	260	260
query17	1710	1462	869	869
query18	2343	401	405	401
query19	206	151	151	151
query20	77	80	81	80
query21	189	93	100	93
query22	5217	5104	5003	5003
query23	32806	32082	32169	32082
query24	7020	6480	6528	6480
query25	508	441	433	433
query26	524	163	158	158
query27	1865	294	293	293
query28	6114	2370	2301	2301
query29	2830	2671	2798	2671
query30	240	164	166	164
query31	893	750	752	750
query32	70	64	60	60
query33	393	262	255	255
query34	839	475	479	475
query35	1142	958	907	907
query36	1404	1172	1181	1172
query37	89	61	59	59
query38	3090	2923	2947	2923
query39	1377	1330	1331	1330
query40	201	99	95	95
query41	38	41	33	33
query42	86	81	83	81
query43	718	742	797	742
query44	1130	719	725	719
query45	244	247	231	231
query46	1238	966	966	966
query47	1774	1826	1766	1766
query48	996	729	692	692
query49	621	364	370	364
query50	870	615	590	590
query51	4775	4697	4681	4681
query52	92	82	75	75
query53	449	309	315	309
query54	2666	2459	2520	2459
query55	84	85	79	79
query56	237	207	205	205
query57	1263	1140	1264	1140
query58	234	195	205	195
query59	4234	4180	4072	4072
query60	214	205	206	205
query61	92	86	85	85
query62	790	486	517	486
query63	479	340	340	340
query64	2455	1526	1390	1390
query65	3710	3546	3556	3546
query66	759	366	388	366
query67	17445	14973	15126	14973
query68	8302	645	682	645
query69	563	353	369	353
query70	1680	1442	1309	1309
query71	380	311	319	311
query72	6392	3410	3442	3410
query73	729	332	331	331
query74	6340	5861	5895	5861
query75	4436	3643	3774	3643
query76	4736	1133	1224	1133
query77	621	251	269	251
query78	12602	11698	11520	11520
query79	9315	646	664	646
query80	2356	404	397	397
query81	509	233	229	229
query82	1747	106	99	99
query83	171	138	136	136
query84	254	68	71	68
query85	1087	308	296	296
query86	344	308	296	296
query87	3259	3006	3024	3006
query88	5266	2377	2388	2377
query89	401	308	311	308
query90	1776	220	217	217
query91	174	138	139	138
query92	58	57	57	57
query93	6487	558	557	557
query94	756	205	210	205
query95	1125	1060	1060	1060
query96	647	344	324	324
query97	6502	6391	6490	6391
query98	194	181	161	161
query99	3013	927	811	811
Total cold run time: 314803 ms
Total hot run time: 203214 ms

doris-robot · 2024-05-24T03:29:34Z

ClickBench: Total hot run time: 31.01 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5caada9aa65bab58e15e234b3cb4f77d5a7a3667, data reload: false

query1	0.02	0.02	0.03
query2	0.06	0.03	0.02
query3	0.24	0.04	0.04
query4	1.79	0.06	0.05
query5	0.53	0.53	0.52
query6	1.24	0.62	0.60
query7	0.01	0.01	0.01
query8	0.04	0.02	0.03
query9	0.52	0.48	0.47
query10	0.53	0.54	0.54
query11	0.12	0.08	0.09
query12	0.11	0.09	0.09
query13	0.62	0.61	0.61
query14	0.78	0.79	0.77
query15	0.79	0.75	0.76
query16	0.37	0.37	0.36
query17	0.99	1.00	1.01
query18	0.22	0.26	0.24
query19	1.84	1.86	1.85
query20	0.01	0.01	0.01
query21	15.48	0.61	0.58
query22	1.95	1.98	1.49
query23	17.51	1.05	1.01
query24	4.82	1.26	1.79
query25	0.41	0.11	0.04
query26	0.65	0.15	0.15
query27	0.05	0.04	0.03
query28	7.25	0.72	0.74
query29	12.63	2.32	2.35
query30	0.61	0.53	0.52
query31	2.82	0.38	0.37
query32	3.38	0.51	0.50
query33	3.08	3.07	3.10
query34	15.26	4.80	4.79
query35	4.87	4.86	4.86
query36	1.08	1.01	1.02
query37	0.06	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.14	0.14
query41	0.06	0.02	0.01
query42	0.02	0.01	0.02
query43	0.02	0.01	0.02
Total cold run time: 103.05 s
Total hot run time: 31.01 s

doris-robot · 2024-05-24T03:32:48Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 5caada9aa65bab58e15e234b3cb4f77d5a7a3667 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       22.0 seconds inserted 10000000 Rows, about 454K ops/s

xiaokang

pls add testcase

xiaokang · 2024-05-29T02:59:54Z

@Johnnyssc pls add testcase

Johnnyssc · 2024-05-29T05:44:23Z

@Johnnyssc pls add testcase

@xiaokang thx for reminding，the regression test case has already passed in local env and added in the latest commit

Johnnyssc · 2024-05-29T06:02:58Z

run buildall

doris-robot · 2024-05-29T06:37:37Z

TPC-H: Total hot run time: 50156 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2f52593d1c0307197ad7261126a446f2a27940c5, data reload: false

------ Round 1 ----------------------------------
q1	18506	4332	4356	4332
q2	2034	190	148	148
q3	10233	1897	1923	1897
q4	10452	1280	1334	1280
q5	8430	3937	3929	3929
q6	240	129	128	128
q7	2101	1621	1626	1621
q8	9362	2754	2725	2725
q9	10658	10453	10222	10222
q10	8662	3614	3743	3614
q11	431	245	262	245
q12	494	312	316	312
q13	18527	4060	4179	4060
q14	363	350	368	350
q15	525	473	488	473
q16	1065	631	637	631
q17	1541	991	980	980
q18	7457	6908	7005	6908
q19	1723	1580	1512	1512
q20	594	329	295	295
q21	4443	4100	4105	4100
q22	500	400	394	394
Total cold run time: 118341 ms
Total hot run time: 50156 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4387	4328	4314	4314
q2	321	226	223	223
q3	4153	4145	4164	4145
q4	2763	2739	2735	2735
q5	7121	7085	7053	7053
q6	243	119	120	119
q7	3251	2868	2834	2834
q8	4357	4474	4518	4474
q9	16812	16700	16713	16700
q10	4187	4271	4264	4264
q11	778	674	703	674
q12	1028	849	863	849
q13	7051	3761	3762	3761
q14	455	444	416	416
q15	511	456	451	451
q16	746	685	687	685
q17	3877	3882	3877	3877
q18	8727	8744	8853	8744
q19	1712	1706	1644	1644
q20	2361	2153	2140	2140
q21	8452	8498	8457	8457
q22	1030	955	956	955
Total cold run time: 84323 ms
Total hot run time: 79514 ms

doris-robot · 2024-05-29T06:50:18Z

TPC-DS: Total hot run time: 203984 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2f52593d1c0307197ad7261126a446f2a27940c5, data reload: false

query1	946	389	389	389
query2	6592	2730	2660	2660
query3	6928	211	205	205
query4	19960	17986	17945	17945
query5	19734	6484	6516	6484
query6	307	217	235	217
query7	4188	302	321	302
query8	259	284	240	240
query9	3144	2707	2629	2629
query10	412	315	318	315
query11	11329	10751	10761	10751
query12	124	73	75	73
query13	5602	695	676	676
query14	17730	13697	13841	13697
query15	389	218	217	217
query16	6448	287	261	261
query17	1710	1466	893	893
query18	2281	413	412	412
query19	216	162	151	151
query20	78	79	80	79
query21	193	102	94	94
query22	5274	5105	4996	4996
query23	32652	31858	31801	31801
query24	6960	6698	6504	6504
query25	531	429	418	418
query26	522	163	160	160
query27	1848	298	298	298
query28	6112	2359	2331	2331
query29	2823	2732	2776	2732
query30	242	166	165	165
query31	919	757	732	732
query32	74	68	61	61
query33	403	261	258	258
query34	845	484	486	484
query35	1135	934	941	934
query36	1309	1423	1088	1088
query37	93	61	61	61
query38	3123	2909	2965	2909
query39	1379	1337	1310	1310
query40	211	95	99	95
query41	40	38	38	38
query42	83	84	88	84
query43	696	696	680	680
query44	1141	706	727	706
query45	244	244	227	227
query46	1221	964	949	949
query47	1860	1705	1675	1675
query48	996	739	729	729
query49	609	366	363	363
query50	879	635	583	583
query51	4841	4712	4627	4627
query52	89	79	89	79
query53	454	321	322	321
query54	2683	2445	2433	2433
query55	87	87	79	79
query56	235	223	199	199
query57	1260	1156	1101	1101
query58	215	202	209	202
query59	4078	3800	4117	3800
query60	216	216	197	197
query61	96	95	95	95
query62	781	495	481	481
query63	479	342	353	342
query64	2407	1561	1360	1360
query65	3678	3562	3543	3543
query66	782	389	378	378
query67	15440	16368	15302	15302
query68	8539	656	660	656
query69	584	365	355	355
query70	1675	1365	1317	1317
query71	414	309	314	309
query72	6497	3493	3448	3448
query73	750	327	330	327
query74	6317	5875	5823	5823
query75	4575	3727	3661	3661
query76	4742	1130	1164	1130
query77	673	256	267	256
query78	12501	12740	12376	12376
query79	12477	650	651	650
query80	805	396	410	396
query81	498	234	233	233
query82	644	100	96	96
query83	164	133	131	131
query84	263	73	71	71
query85	779	323	332	323
query86	333	317	306	306
query87	3261	3073	3018	3018
query88	5424	2369	2349	2349
query89	420	303	284	284
query90	1921	201	218	201
query91	176	144	141	141
query92	63	54	56	54
query93	4713	567	565	565
query94	738	203	216	203
query95	1106	1056	1037	1037
query96	635	339	322	322
query97	6460	6313	6327	6313
query98	199	180	180	180
query99	2817	905	853	853
Total cold run time: 311778 ms
Total hot run time: 203984 ms

doris-robot · 2024-05-29T06:55:48Z

ClickBench: Total hot run time: 30.54 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2f52593d1c0307197ad7261126a446f2a27940c5, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.24	0.04	0.05
query4	1.80	0.07	0.07
query5	0.53	0.51	0.52
query6	1.25	0.62	0.60
query7	0.01	0.01	0.01
query8	0.03	0.03	0.02
query9	0.52	0.49	0.47
query10	0.54	0.54	0.53
query11	0.11	0.09	0.08
query12	0.11	0.08	0.09
query13	0.62	0.61	0.61
query14	0.78	0.78	0.78
query15	0.77	0.75	0.74
query16	0.36	0.37	0.37
query17	1.01	1.02	0.98
query18	0.20	0.26	0.25
query19	1.93	1.88	1.84
query20	0.02	0.01	0.01
query21	15.50	0.57	0.55
query22	2.28	3.12	1.50
query23	17.20	1.04	0.99
query24	4.87	1.10	1.07
query25	0.40	0.10	0.06
query26	0.54	0.15	0.16
query27	0.05	0.05	0.04
query28	8.09	0.76	0.71
query29	12.67	2.18	2.31
query30	0.62	0.54	0.51
query31	2.81	0.40	0.38
query32	3.38	0.49	0.50
query33	3.13	3.04	3.10
query34	15.26	4.82	4.78
query35	4.84	4.81	4.83
query36	1.04	1.02	1.01
query37	0.06	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.13	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.01
query43	0.03	0.02	0.02
Total cold run time: 103.99 s
Total hot run time: 30.54 s

doris-robot · 2024-05-29T06:59:01Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 2f52593d1c0307197ad7261126a446f2a27940c5 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.7 seconds inserted 10000000 Rows, about 460K ops/s

Johnnyssc · 2024-05-29T09:54:13Z

run P0

Johnnyssc · 2024-05-29T13:02:03Z

run p0

DarvenDuan · 2024-05-30T02:11:18Z

run p0

Johnnyssc · 2024-05-30T07:21:31Z

run buildall

doris-robot · 2024-05-30T07:55:36Z

TPC-H: Total hot run time: 49782 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 43f16867073c90a8187f6f2ec19305f498f6ee57, data reload: false

------ Round 1 ----------------------------------
q1	18036	4416	4319	4319
q2	2045	188	151	151
q3	10397	1885	1938	1885
q4	10281	1231	1295	1231
q5	8837	3901	3896	3896
q6	235	126	131	126
q7	2101	1588	1566	1566
q8	9280	2762	2722	2722
q9	10704	10363	10267	10267
q10	8627	3529	3508	3508
q11	421	256	253	253
q12	476	305	298	298
q13	18351	4002	4013	4002
q14	351	322	325	322
q15	539	461	470	461
q16	682	573	573	573
q17	1142	996	992	992
q18	7422	6935	6885	6885
q19	1730	1572	1563	1563
q20	532	313	286	286
q21	4494	4113	4099	4099
q22	491	377	387	377
Total cold run time: 117174 ms
Total hot run time: 49782 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4311	4280	4296	4280
q2	321	223	217	217
q3	4185	4142	4151	4142
q4	2756	2773	2757	2757
q5	7190	7095	7076	7076
q6	239	122	121	121
q7	3273	2814	2835	2814
q8	4355	4454	4479	4454
q9	16924	16705	16831	16705
q10	4251	4255	4255	4255
q11	756	703	669	669
q12	1049	844	850	844
q13	7037	3718	3755	3718
q14	446	416	427	416
q15	509	451	461	451
q16	740	683	692	683
q17	3804	3789	3897	3789
q18	8814	8835	8775	8775
q19	1700	1723	1646	1646
q20	2384	2107	2126	2107
q21	8434	8382	8378	8378
q22	1030	964	954	954
Total cold run time: 84508 ms
Total hot run time: 79251 ms

doris-robot · 2024-05-30T08:08:17Z

TPC-DS: Total hot run time: 203674 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 43f16867073c90a8187f6f2ec19305f498f6ee57, data reload: false

query1	931	390	382	382
query2	6593	2852	2590	2590
query3	6918	213	207	207
query4	19908	17957	17885	17885
query5	19740	6591	6506	6506
query6	294	221	226	221
query7	4268	294	310	294
query8	255	249	244	244
query9	3129	2707	2654	2654
query10	431	313	298	298
query11	11317	10799	10742	10742
query12	126	79	71	71
query13	5589	703	671	671
query14	17913	13983	13821	13821
query15	358	218	241	218
query16	6449	291	262	262
query17	1490	1492	888	888
query18	2263	417	415	415
query19	209	148	162	148
query20	70	80	78	78
query21	190	93	95	93
query22	5007	4982	4978	4978
query23	32620	31811	31944	31811
query24	6818	6557	6506	6506
query25	517	424	425	424
query26	523	164	160	160
query27	1809	307	297	297
query28	6124	2350	2341	2341
query29	2859	2706	2900	2706
query30	240	167	169	167
query31	930	779	739	739
query32	72	65	60	60
query33	401	253	255	253
query34	844	472	499	472
query35	1129	945	870	870
query36	1277	1130	1062	1062
query37	93	64	61	61
query38	3065	2917	2999	2917
query39	1385	1335	1310	1310
query40	208	102	96	96
query41	41	37	37	37
query42	87	83	81	81
query43	667	586	704	586
query44	1155	709	717	709
query45	242	232	227	227
query46	1213	964	988	964
query47	1857	1661	1862	1661
query48	1015	706	692	692
query49	640	381	373	373
query50	869	622	588	588
query51	4769	4662	4643	4643
query52	91	92	81	81
query53	457	320	330	320
query54	2643	2478	2456	2456
query55	91	88	88	88
query56	218	210	219	210
query57	1229	1175	1089	1089
query58	219	194	186	186
query59	4129	4215	4068	4068
query60	217	198	211	198
query61	101	99	96	96
query62	849	515	501	501
query63	484	341	341	341
query64	2343	1522	1513	1513
query65	3679	3553	3560	3553
query66	778	374	379	374
query67	17066	15136	15426	15136
query68	8579	655	650	650
query69	579	357	345	345
query70	1890	1423	1437	1423
query71	418	312	309	309
query72	6513	3502	3502	3502
query73	745	327	325	325
query74	6318	5877	5820	5820
query75	5278	3694	3662	3662
query76	5215	1143	1190	1143
query77	857	252	270	252
query78	12578	11661	12082	11661
query79	8236	658	658	658
query80	1101	420	406	406
query81	501	234	237	234
query82	1666	99	100	99
query83	169	132	142	132
query84	255	73	71	71
query85	870	323	317	317
query86	323	332	326	326
query87	3183	3019	2994	2994
query88	4643	2374	2372	2372
query89	374	302	328	302
query90	1942	207	219	207
query91	180	145	143	143
query92	60	55	54	54
query93	6156	615	590	590
query94	693	219	218	218
query95	1108	1074	1082	1074
query96	636	330	339	330
query97	6505	6344	6363	6344
query98	175	171	168	168
query99	2924	854	861	854
Total cold run time: 312181 ms
Total hot run time: 203674 ms

doris-robot · 2024-05-30T08:13:44Z

ClickBench: Total hot run time: 30.87 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 43f16867073c90a8187f6f2ec19305f498f6ee57, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.04	0.04
query4	1.79	0.06	0.06
query5	0.53	0.53	0.52
query6	1.23	0.62	0.62
query7	0.01	0.01	0.01
query8	0.04	0.03	0.02
query9	0.54	0.50	0.48
query10	0.55	0.53	0.53
query11	0.12	0.08	0.08
query12	0.11	0.10	0.09
query13	0.62	0.61	0.61
query14	0.78	0.80	0.81
query15	0.79	0.76	0.76
query16	0.37	0.36	0.39
query17	0.97	1.01	0.98
query18	0.21	0.27	0.23
query19	1.91	1.87	1.86
query20	0.01	0.01	0.01
query21	15.48	0.57	0.56
query22	2.06	1.83	1.77
query23	16.98	1.09	0.85
query24	6.02	1.22	1.05
query25	0.35	0.08	0.04
query26	0.71	0.14	0.15
query27	0.05	0.05	0.05
query28	7.07	0.75	0.78
query29	12.66	2.28	2.32
query30	0.61	0.54	0.52
query31	2.82	0.40	0.38
query32	3.36	0.48	0.49
query33	3.08	3.05	3.09
query34	15.23	4.82	4.78
query35	4.86	4.83	4.84
query36	1.07	1.02	1.00
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.17	0.14	0.14
query41	0.06	0.01	0.02
query42	0.02	0.02	0.01
query43	0.02	0.01	0.01
Total cold run time: 103.72 s
Total hot run time: 30.87 s

doris-robot · 2024-05-30T08:16:58Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 43f16867073c90a8187f6f2ec19305f498f6ee57 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

xiaokang · 2024-05-31T03:13:32Z

run buildall

Johnnyssc · 2024-06-07T05:31:04Z

run buildall

doris-robot · 2024-06-07T06:01:25Z

TPC-H: Total hot run time: 49550 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 893b18f8eee7796bc585935a3fa7048f1dd719a1, data reload: false

------ Round 1 ----------------------------------
q1	18221	4330	4317	4317
q2	2078	155	156	155
q3	10364	1882	1908	1882
q4	10357	1251	1350	1251
q5	8326	4218	3887	3887
q6	234	147	141	141
q7	2035	1572	1565	1565
q8	9485	2718	2694	2694
q9	13367	10194	10275	10194
q10	8622	3565	3548	3548
q11	419	252	236	236
q12	466	311	308	308
q13	18331	3961	4055	3961
q14	356	326	335	326
q15	509	468	460	460
q16	680	574	572	572
q17	1115	910	906	906
q18	7365	6933	6908	6908
q19	1701	1568	1496	1496
q20	535	298	291	291
q21	4435	4131	4049	4049
q22	499	411	403	403
Total cold run time: 119500 ms
Total hot run time: 49550 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4306	4357	4254	4254
q2	320	227	229	227
q3	4167	4132	4144	4132
q4	2746	2729	2748	2729
q5	7128	7109	7092	7092
q6	234	122	121	121
q7	3276	2876	2808	2808
q8	4367	4485	4512	4485
q9	16788	16695	16717	16695
q10	4200	4283	4267	4267
q11	764	719	688	688
q12	1039	876	850	850
q13	6951	3754	3763	3754
q14	452	427	436	427
q15	506	460	457	457
q16	737	690	668	668
q17	3803	3893	3853	3853
q18	8858	8822	8874	8822
q19	1733	1681	1659	1659
q20	2384	2148	2098	2098
q21	8544	8641	8498	8498
q22	1050	999	994	994
Total cold run time: 84353 ms
Total hot run time: 79578 ms

doris-robot · 2024-06-07T06:14:14Z

TPC-DS: Total hot run time: 203528 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 893b18f8eee7796bc585935a3fa7048f1dd719a1, data reload: false

query1	948	430	383	383
query2	6600	2604	3009	2604
query3	7273	234	218	218
query4	22690	18240	18014	18014
query5	19951	6485	6507	6485
query6	425	219	236	219
query7	5240	303	304	303
query8	241	272	249	249
query9	3110	2694	2636	2636
query10	434	312	304	304
query11	11322	11418	10807	10807
query12	121	84	77	77
query13	5613	667	680	667
query14	19299	13483	13699	13483
query15	398	226	227	226
query16	6422	284	266	266
query17	1367	1493	885	885
query18	2264	430	410	410
query19	214	157	158	157
query20	77	78	81	78
query21	194	103	96	96
query22	5318	5155	5015	5015
query23	32328	31920	32006	31920
query24	6814	6527	6518	6518
query25	542	429	435	429
query26	534	164	163	163
query27	1667	296	301	296
query28	6092	2340	2306	2306
query29	2943	2816	2628	2628
query30	245	165	168	165
query31	928	744	741	741
query32	71	66	61	61
query33	401	265	252	252
query34	866	463	483	463
query35	1102	912	996	912
query36	1558	1109	1037	1037
query37	93	61	59	59
query38	3057	2929	2941	2929
query39	1386	1340	1316	1316
query40	208	95	96	95
query41	40	38	37	37
query42	88	90	91	90
query43	768	739	728	728
query44	1134	730	738	730
query45	246	236	233	233
query46	1223	956	1050	956
query47	1915	1727	1848	1727
query48	1014	709	699	699
query49	617	387	369	369
query50	848	606	594	594
query51	4722	4678	4666	4666
query52	88	74	77	74
query53	445	324	321	321
query54	2670	2428	2453	2428
query55	102	84	84	84
query56	245	215	205	205
query57	1132	1079	1158	1079
query58	213	214	189	189
query59	4368	4001	4191	4001
query60	226	199	199	199
query61	97	93	96	93
query62	848	443	474	443
query63	476	346	341	341
query64	2530	1553	1340	1340
query65	3606	3543	3562	3543
query66	767	375	379	375
query67	15907	15158	16001	15158
query68	11419	663	661	661
query69	599	372	344	344
query70	1922	1471	1372	1372
query71	424	295	311	295
query72	6580	3460	3496	3460
query73	752	322	325	322
query74	6354	5801	5886	5801
query75	5534	3713	3672	3672
query76	6906	1137	1172	1137
query77	1181	250	273	250
query78	12686	11890	11726	11726
query79	6385	645	664	645
query80	1074	401	408	401
query81	456	240	225	225
query82	809	96	99	96
query83	181	132	138	132
query84	244	72	69	69
query85	878	327	313	313
query86	343	348	329	329
query87	3217	3046	3016	3016
query88	4027	2342	2331	2331
query89	438	302	294	294
query90	1892	212	220	212
query91	172	139	146	139
query92	61	55	52	52
query93	5911	577	580	577
query94	705	207	212	207
query95	1108	1050	1077	1050
query96	661	334	341	334
query97	6444	6456	6430	6430
query98	186	165	168	165
query99	3087	951	897	897
Total cold run time: 319327 ms
Total hot run time: 203528 ms

doris-robot · 2024-06-07T06:19:42Z

ClickBench: Total hot run time: 30.75 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 893b18f8eee7796bc585935a3fa7048f1dd719a1, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.03
query3	0.24	0.05	0.05
query4	1.76	0.06	0.07
query5	0.53	0.52	0.51
query6	1.23	0.63	0.62
query7	0.01	0.00	0.00
query8	0.03	0.03	0.02
query9	0.53	0.49	0.50
query10	0.53	0.55	0.54
query11	0.12	0.08	0.08
query12	0.11	0.09	0.09
query13	0.62	0.62	0.61
query14	0.77	0.79	0.78
query15	0.77	0.78	0.76
query16	0.37	0.37	0.38
query17	1.00	1.00	1.04
query18	0.21	0.25	0.23
query19	1.88	1.82	1.89
query20	0.02	0.01	0.01
query21	15.49	0.55	0.57
query22	2.06	2.76	1.72
query23	16.87	1.03	0.98
query24	5.22	4.82	0.71
query25	0.38	0.09	0.06
query26	0.98	0.16	0.15
query27	0.05	0.04	0.04
query28	4.42	0.83	0.78
query29	12.76	2.28	2.34
query30	0.62	0.55	0.56
query31	2.81	0.40	0.37
query32	3.38	0.50	0.51
query33	3.10	3.09	3.06
query34	15.26	4.80	4.81
query35	4.85	4.84	4.84
query36	1.06	1.02	1.02
query37	0.06	0.04	0.05
query38	0.03	0.02	0.03
query39	0.02	0.02	0.01
query40	0.16	0.14	0.14
query41	0.07	0.02	0.01
query42	0.02	0.01	0.01
query43	0.03	0.02	0.02
Total cold run time: 100.52 s
Total hot run time: 30.75 s

doris-robot · 2024-06-07T06:23:00Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 893b18f8eee7796bc585935a3fa7048f1dd719a1 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      33 seconds loaded 861443392 Bytes, about 24 MB/s
Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s

Johnnyssc · 2024-06-07T09:07:33Z

run buildall

doris-robot · 2024-06-07T09:38:03Z

TPC-H: Total hot run time: 50179 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 07160b74bcd7f18ba43e49732448ecd204cb679b, data reload: false

------ Round 1 ----------------------------------
q1	18196	4385	4414	4385
q2	2065	159	149	149
q3	10373	1929	1970	1929
q4	10748	1312	1370	1312
q5	8509	3942	3894	3894
q6	239	125	127	125
q7	2054	1617	1575	1575
q8	9443	2741	2711	2711
q9	10595	10308	10510	10308
q10	8784	3652	3729	3652
q11	433	264	260	260
q12	489	313	319	313
q13	19005	3971	4068	3971
q14	360	345	335	335
q15	508	481	459	459
q16	951	585	590	585
q17	1337	979	957	957
q18	7406	6962	6959	6959
q19	1706	1570	1547	1547
q20	536	319	295	295
q21	4419	4070	4073	4070
q22	490	388	389	388
Total cold run time: 118646 ms
Total hot run time: 50179 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4305	4307	4270	4270
q2	327	229	216	216
q3	4186	4119	4139	4119
q4	2734	2740	2722	2722
q5	7174	7108	7150	7108
q6	238	117	119	117
q7	3274	2798	2789	2789
q8	4378	4423	4476	4423
q9	16840	16622	16701	16622
q10	4240	4242	4295	4242
q11	756	697	679	679
q12	1009	858	876	858
q13	7144	3749	3734	3734
q14	442	430	422	422
q15	497	468	451	451
q16	743	690	679	679
q17	3843	3872	3819	3819
q18	8671	8794	8755	8755
q19	1705	1692	1647	1647
q20	2387	2139	2134	2134
q21	8488	8533	8491	8491
q22	1010	954	945	945
Total cold run time: 84391 ms
Total hot run time: 79242 ms

doris-robot · 2024-06-07T09:50:50Z

TPC-DS: Total hot run time: 205235 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 07160b74bcd7f18ba43e49732448ecd204cb679b, data reload: false

query1	923	423	384	384
query2	6519	2774	2696	2696
query3	6924	212	209	209
query4	21367	17980	17847	17847
query5	19736	6482	6563	6482
query6	289	217	223	217
query7	4156	303	306	303
query8	261	263	249	249
query9	3134	2689	2622	2622
query10	413	302	301	301
query11	11332	10727	10745	10727
query12	124	76	75	75
query13	5592	671	679	671
query14	17666	13432	13812	13432
query15	378	222	230	222
query16	6455	287	262	262
query17	1691	1453	892	892
query18	2296	410	411	410
query19	210	145	151	145
query20	71	79	82	79
query21	202	91	99	91
query22	5246	5109	5155	5109
query23	32488	31993	31921	31921
query24	6940	6535	6463	6463
query25	510	430	433	430
query26	536	162	168	162
query27	1788	298	297	297
query28	6202	2380	2332	2332
query29	2970	2718	2697	2697
query30	240	167	170	167
query31	927	736	744	736
query32	65	62	63	62
query33	405	259	266	259
query34	857	462	485	462
query35	1108	947	922	922
query36	1303	1270	1200	1200
query37	96	62	59	59
query38	3095	2957	2922	2922
query39	1368	1354	1319	1319
query40	205	98	96	96
query41	39	37	44	37
query42	83	85	82	82
query43	803	848	729	729
query44	1114	723	718	718
query45	242	235	228	228
query46	1223	952	987	952
query47	1944	1735	1711	1711
query48	1016	711	697	697
query49	611	371	383	371
query50	876	607	612	607
query51	4719	4677	4692	4677
query52	93	89	81	81
query53	448	326	320	320
query54	2625	2431	2405	2405
query55	95	85	84	84
query56	230	225	196	196
query57	1247	1123	1174	1123
query58	217	216	198	198
query59	4089	3992	4135	3992
query60	211	200	222	200
query61	98	98	95	95
query62	816	439	476	439
query63	482	343	346	343
query64	2363	1556	1418	1418
query65	3637	3550	3555	3550
query66	779	373	366	366
query67	17152	16725	16747	16725
query68	5916	662	679	662
query69	555	349	349	349
query70	1537	1490	1512	1490
query71	394	307	315	307
query72	6438	3507	3493	3493
query73	729	320	321	320
query74	6277	5834	5891	5834
query75	4476	3693	3645	3645
query76	3544	1128	1146	1128
query77	569	264	251	251
query78	12600	12471	11679	11679
query79	13427	645	635	635
query80	1465	404	424	404
query81	513	241	229	229
query82	1137	107	100	100
query83	186	132	130	130
query84	261	70	72	70
query85	1072	315	312	312
query86	307	290	295	290
query87	3248	3039	3060	3039
query88	6224	2356	2309	2309
query89	417	298	300	298
query90	1894	210	212	210
query91	172	156	140	140
query92	55	52	55	52
query93	6360	593	574	574
query94	774	221	211	211
query95	1113	1046	1067	1046
query96	644	336	334	334
query97	6478	6415	6329	6329
query98	193	188	181	181
query99	3053	981	909	909
Total cold run time: 315368 ms
Total hot run time: 205235 ms

doris-robot · 2024-06-07T09:56:17Z

ClickBench: Total hot run time: 31.2 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 07160b74bcd7f18ba43e49732448ecd204cb679b, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.02
query3	0.25	0.05	0.04
query4	1.81	0.07	0.07
query5	0.53	0.52	0.52
query6	1.27	0.61	0.63
query7	0.01	0.00	0.01
query8	0.03	0.02	0.02
query9	0.53	0.49	0.48
query10	0.56	0.53	0.55
query11	0.11	0.08	0.08
query12	0.12	0.09	0.09
query13	0.63	0.61	0.61
query14	0.77	0.79	0.79
query15	0.80	0.78	0.77
query16	0.36	0.36	0.35
query17	0.98	1.01	0.99
query18	0.22	0.27	0.24
query19	1.83	1.87	1.85
query20	0.02	0.01	0.01
query21	15.47	0.57	0.54
query22	1.91	1.90	1.78
query23	17.29	0.98	0.96
query24	5.86	1.28	1.29
query25	0.36	0.11	0.05
query26	0.69	0.16	0.15
query27	0.03	0.03	0.04
query28	6.88	0.74	0.76
query29	12.66	2.33	2.27
query30	0.54	0.54	0.53
query31	2.81	0.38	0.38
query32	3.37	0.49	0.49
query33	3.05	3.06	3.09
query34	15.26	4.80	4.75
query35	4.86	4.81	4.84
query36	1.05	1.02	1.02
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.15	0.14	0.15
query41	0.06	0.02	0.01
query42	0.02	0.01	0.01
query43	0.02	0.02	0.02
Total cold run time: 103.39 s
Total hot run time: 31.2 s

doris-robot · 2024-06-07T09:59:32Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 07160b74bcd7f18ba43e49732448ecd204cb679b with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.9 seconds inserted 10000000 Rows, about 456K ops/s

…ucceed with execption

Johnnyssc · 2024-06-25T09:38:00Z

run buildall

doris-robot · 2024-06-25T09:59:37Z

TPC-H: Total hot run time: 49761 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d7ea633933e72c420a0fbc47e4bdcc0803dd0058, data reload: false

------ Round 1 ----------------------------------
q1	17861	4425	4378	4378
q2	2071	165	150	150
q3	10440	1902	1944	1902
q4	10327	1226	1327	1226
q5	8409	3913	3915	3913
q6	255	124	125	124
q7	2059	1624	1585	1585
q8	9540	2737	2716	2716
q9	13912	10165	10320	10165
q10	8631	3529	3539	3529
q11	409	246	240	240
q12	467	301	308	301
q13	18397	3984	4046	3984
q14	365	334	334	334
q15	499	464	455	455
q16	651	563	575	563
q17	1121	930	908	908
q18	7403	6825	6889	6825
q19	1806	1690	1611	1611
q20	526	313	302	302
q21	4410	4134	4102	4102
q22	526	448	454	448
Total cold run time: 120085 ms
Total hot run time: 49761 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4315	4289	4289	4289
q2	318	237	222	222
q3	4178	4214	4171	4171
q4	2780	2746	2734	2734
q5	7143	7100	7058	7058
q6	238	120	121	120
q7	3246	2864	2843	2843
q8	4339	4467	4475	4467
q9	16909	16703	16622	16622
q10	4276	4228	4232	4228
q11	759	693	705	693
q12	1056	867	866	866
q13	6934	3736	3703	3703
q14	459	428	434	428
q15	501	467	457	457
q16	735	696	688	688
q17	3881	3862	3855	3855
q18	8883	8839	8753	8753
q19	1780	1607	1694	1607
q20	2371	2119	2130	2119
q21	8499	8497	8334	8334
q22	1064	962	958	958
Total cold run time: 84664 ms
Total hot run time: 79215 ms

doris-robot · 2024-06-25T10:12:19Z

TPC-DS: Total hot run time: 203919 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d7ea633933e72c420a0fbc47e4bdcc0803dd0058, data reload: false

query1	929	433	397	397
query2	6528	2750	2649	2649
query3	6918	213	196	196
query4	20320	18011	18013	18011
query5	19732	6560	6444	6444
query6	289	221	226	221
query7	4179	316	315	315
query8	439	411	398	398
query9	3089	2648	2603	2603
query10	413	294	309	294
query11	11535	10718	10704	10704
query12	133	74	76	74
query13	5590	687	692	687
query14	18051	13733	13577	13577
query15	373	259	249	249
query16	6473	280	257	257
query17	1753	1465	897	897
query18	2287	431	411	411
query19	227	150	152	150
query20	80	76	81	76
query21	193	105	96	96
query22	5108	5077	4965	4965
query23	32828	32079	32165	32079
query24	7016	6547	6529	6529
query25	554	437	411	411
query26	531	163	163	163
query27	1893	301	296	296
query28	6119	2313	2280	2280
query29	2929	2741	2806	2741
query30	243	170	169	169
query31	935	727	750	727
query32	72	64	61	61
query33	406	261	260	260
query34	868	490	474	474
query35	1137	882	933	882
query36	1298	1111	1149	1111
query37	90	61	62	61
query38	3069	2942	2956	2942
query39	1354	1341	1329	1329
query40	210	95	99	95
query41	46	46	43	43
query42	86	80	81	80
query43	762	675	717	675
query44	1172	721	725	721
query45	248	241	241	241
query46	1224	978	983	978
query47	1925	1831	1861	1831
query48	1043	737	721	721
query49	619	374	372	372
query50	862	624	625	624
query51	4828	4715	4647	4647
query52	87	85	91	85
query53	451	317	317	317
query54	2691	2477	2472	2472
query55	96	79	82	79
query56	243	221	202	202
query57	1172	1083	1009	1009
query58	225	207	207	207
query59	4131	3917	4056	3917
query60	217	215	216	215
query61	97	94	102	94
query62	895	488	494	488
query63	489	346	343	343
query64	2608	1566	1426	1426
query65	3630	3597	3566	3566
query66	822	372	395	372
query67	17479	15416	15339	15339
query68	8078	652	656	652
query69	555	353	367	353
query70	1681	1408	1299	1299
query71	395	322	319	319
query72	6490	3521	3525	3521
query73	749	329	322	322
query74	6300	5856	5799	5799
query75	4581	3670	3766	3670
query76	4589	1140	1148	1140
query77	566	260	251	251
query78	12616	11559	12459	11559
query79	8991	645	633	633
query80	2782	408	415	408
query81	538	236	238	236
query82	831	100	96	96
query83	204	133	131	131
query84	270	74	72	72
query85	1410	320	317	317
query86	353	309	308	308
query87	3270	3017	3057	3017
query88	5009	2300	2279	2279
query89	370	283	279	279
query90	1730	205	211	205
query91	177	139	142	139
query92	62	54	53	53
query93	4192	614	582	582
query94	807	207	206	206
query95	1133	1095	1067	1067
query96	646	321	330	321
query97	6533	6297	6356	6297
query98	189	175	184	175
query99	2882	915	868	868
Total cold run time: 313318 ms
Total hot run time: 203919 ms

doris-robot · 2024-06-25T10:17:47Z

ClickBench: Total hot run time: 30.13 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d7ea633933e72c420a0fbc47e4bdcc0803dd0058, data reload: false

query1	0.02	0.02	0.02
query2	0.08	0.02	0.02
query3	0.25	0.06	0.07
query4	1.76	0.11	0.08
query5	0.55	0.52	0.53
query6	1.23	0.61	0.62
query7	0.01	0.02	0.01
query8	0.03	0.02	0.02
query9	0.53	0.50	0.48
query10	0.53	0.53	0.56
query11	0.13	0.09	0.09
query12	0.12	0.09	0.09
query13	0.62	0.62	0.62
query14	0.78	0.79	0.80
query15	0.78	0.75	0.76
query16	0.37	0.36	0.38
query17	1.04	0.99	1.01
query18	0.22	0.25	0.25
query19	1.92	1.88	1.81
query20	0.01	0.01	0.00
query21	15.47	0.57	0.58
query22	2.30	2.10	1.02
query23	16.82	0.97	0.93
query24	6.11	0.83	1.69
query25	0.41	0.12	0.05
query26	0.68	0.14	0.15
query27	0.05	0.04	0.04
query28	6.47	0.78	0.76
query29	12.66	2.32	2.35
query30	0.60	0.54	0.53
query31	2.81	0.40	0.40
query32	3.32	0.49	0.50
query33	3.13	3.08	3.08
query34	15.25	4.80	4.80
query35	4.84	4.82	4.84
query36	1.04	1.03	1.02
query37	0.06	0.04	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.13
query41	0.08	0.01	0.01
query42	0.02	0.01	0.02
query43	0.03	0.01	0.01
Total cold run time: 103.35 s
Total hot run time: 30.13 s

doris-robot · 2024-06-25T10:21:03Z

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit d7ea633933e72c420a0fbc47e4bdcc0803dd0058 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.2 seconds inserted 10000000 Rows, about 471K ops/s

GoGoWen

LGTM

DarvenDuan

LGTM

…fferent resource issue succeed with execption (apache#35270) ## Proposed changes Issue Number: close apache#34229 when we try to modify a partition's storage policy which have different resource with the previous one, we get error message "currently do not support change origin storage policy to another one with different resource", but the modification same also succeed! expect: the modification fail with "currently do not support change origin storage policy to another one with different resource". ## Further comments If this is a relatively large or complex change, kick off the discussion at [[email protected]](mailto:[email protected]) by explaining why you chose the solution you did and what alternatives you considered, etc... --------- Co-authored-by: shenshoucheng <[email protected]>

Johnnyssc force-pushed the fix_modify_storage_policy branch from ddde78a to 8fce17f Compare May 24, 2024 02:27

xiaokang requested changes May 27, 2024

View reviewed changes

xiaokang marked this pull request as draft May 28, 2024 07:06

Johnnyssc force-pushed the fix_modify_storage_policy branch from 5caada9 to 2f52593 Compare May 29, 2024 05:33

github-actions bot added the kind/test label May 29, 2024

Johnnyssc force-pushed the fix_modify_storage_policy branch from 2f52593 to c6e978c Compare May 29, 2024 12:59

Johnnyssc force-pushed the fix_modify_storage_policy branch from 43f1686 to e3590df Compare May 30, 2024 10:50

Johnnyssc force-pushed the fix_modify_storage_policy branch 4 times, most recently from 46963db to 0d7bef8 Compare June 7, 2024 05:30

Johnnyssc force-pushed the fix_modify_storage_policy branch from 0d7bef8 to 893b18f Compare June 7, 2024 05:31

Johnnyssc force-pushed the fix_modify_storage_policy branch 2 times, most recently from 09314c1 to 07160b7 Compare June 7, 2024 08:35

Johnnyssc force-pushed the fix_modify_storage_policy branch from 07160b7 to 6bedb1d Compare June 25, 2024 09:36

shenshoucheng added 2 commits June 25, 2024 17:37

fix modify partition's storage policy with different resource issue s…

47aba65

…ucceed with execption

add regression tests

d7ea633

Johnnyssc force-pushed the fix_modify_storage_policy branch from 6bedb1d to d7ea633 Compare June 25, 2024 09:37

GoGoWen approved these changes Jun 26, 2024

View reviewed changes

DarvenDuan approved these changes Jul 9, 2024

View reviewed changes

GoGoWen merged commit ec9800a into apache:branch-2.0 Jul 9, 2024
26 of 28 checks passed

[BugFix](StoragePolicy) fix modify partition's storage policy with different resource issue succeed with execption #35270

[BugFix](StoragePolicy) fix modify partition's storage policy with different resource issue succeed with execption #35270

Conversation

Johnnyssc commented May 23, 2024 • edited Loading

Proposed changes

Further comments

doris-robot commented May 23, 2024

Johnnyssc commented May 23, 2024

Johnnyssc commented May 24, 2024

doris-robot commented May 24, 2024

doris-robot commented May 24, 2024

doris-robot commented May 24, 2024

doris-robot commented May 24, 2024

xiaokang left a comment

Choose a reason for hiding this comment

xiaokang commented May 29, 2024

Johnnyssc commented May 29, 2024

Johnnyssc commented May 29, 2024

doris-robot commented May 29, 2024

doris-robot commented May 29, 2024

doris-robot commented May 29, 2024

doris-robot commented May 29, 2024

Johnnyssc commented May 29, 2024

Johnnyssc commented May 29, 2024

DarvenDuan commented May 30, 2024

Johnnyssc commented May 30, 2024

doris-robot commented May 30, 2024

doris-robot commented May 30, 2024

doris-robot commented May 30, 2024

doris-robot commented May 30, 2024

xiaokang commented May 31, 2024

Johnnyssc commented Jun 7, 2024

doris-robot commented Jun 7, 2024

doris-robot commented Jun 7, 2024

doris-robot commented Jun 7, 2024

doris-robot commented Jun 7, 2024

Johnnyssc commented Jun 7, 2024

doris-robot commented Jun 7, 2024

doris-robot commented Jun 7, 2024

doris-robot commented Jun 7, 2024

doris-robot commented Jun 7, 2024

Johnnyssc commented Jun 25, 2024

doris-robot commented Jun 25, 2024

doris-robot commented Jun 25, 2024

doris-robot commented Jun 25, 2024

doris-robot commented Jun 25, 2024

GoGoWen left a comment

Choose a reason for hiding this comment

DarvenDuan left a comment

Choose a reason for hiding this comment

Johnnyssc commented May 23, 2024 •

edited

Loading