Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](fe ut) fix TabletRepairAndBalanceTest #31397 #35059

Merged

Conversation

yujun777
Copy link
Collaborator

cherry pick from #31397

@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@yujun777 yujun777 marked this pull request as draft May 20, 2024 07:18
@yujun777
Copy link
Collaborator Author

yujun777 commented Jun 5, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49628 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a17b36b82844446298fb7df95a51cc0fc5c989b9, data reload: false

------ Round 1 ----------------------------------
q1	17692	4422	4304	4304
q2	2077	155	153	153
q3	10285	1844	1885	1844
q4	10330	1248	1304	1248
q5	8391	3824	3907	3824
q6	227	124	153	124
q7	2020	1580	1588	1580
q8	9543	2726	2710	2710
q9	10749	10427	10177	10177
q10	8723	3559	3545	3545
q11	429	245	248	245
q12	473	302	303	302
q13	18392	3998	4038	3998
q14	363	335	325	325
q15	517	464	460	460
q16	663	591	577	577
q17	1124	939	977	939
q18	7293	7008	6909	6909
q19	1832	1578	1528	1528
q20	517	326	306	306
q21	4434	4183	4122	4122
q22	535	413	408	408
Total cold run time: 116609 ms
Total hot run time: 49628 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4534	4433	4421	4421
q2	347	253	249	249
q3	4306	4249	4279	4249
q4	2836	2844	2838	2838
q5	7525	7280	7235	7235
q6	245	130	130	130
q7	3331	2880	2883	2880
q8	4338	4473	4450	4450
q9	16794	16818	16702	16702
q10	4224	4259	4284	4259
q11	775	696	698	696
q12	1032	850	865	850
q13	6874	3758	3766	3758
q14	452	429	426	426
q15	503	456	456	456
q16	746	697	672	672
q17	3892	3791	3855	3791
q18	8836	8778	8719	8719
q19	1691	1676	1642	1642
q20	2366	2155	2078	2078
q21	8579	8402	8514	8402
q22	1039	981	934	934
Total cold run time: 85265 ms
Total hot run time: 79837 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203953 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a17b36b82844446298fb7df95a51cc0fc5c989b9, data reload: false

query1	920	427	384	384
query2	6554	2765	2581	2581
query3	6915	215	205	205
query4	20807	18571	18116	18116
query5	19743	6531	6533	6531
query6	279	215	234	215
query7	4174	316	309	309
query8	264	231	246	231
query9	3117	2703	2638	2638
query10	414	291	280	280
query11	11236	10720	10675	10675
query12	133	77	78	77
query13	5584	695	674	674
query14	17768	13281	13935	13281
query15	361	222	234	222
query16	6474	287	266	266
query17	1731	1425	889	889
query18	2304	409	417	409
query19	209	153	155	153
query20	76	78	77	77
query21	190	97	96	96
query22	5287	5051	5034	5034
query23	32621	32006	31994	31994
query24	6959	6549	6473	6473
query25	535	424	444	424
query26	513	165	167	165
query27	1773	300	303	300
query28	6075	2350	2313	2313
query29	2883	2744	2748	2744
query30	241	166	173	166
query31	922	742	746	742
query32	75	66	62	62
query33	407	265	256	256
query34	857	486	486	486
query35	1114	894	930	894
query36	1592	1225	1217	1217
query37	93	63	62	62
query38	3059	2933	2931	2931
query39	1389	1338	1315	1315
query40	209	93	96	93
query41	40	38	39	38
query42	83	84	83	83
query43	760	792	625	625
query44	1131	720	724	720
query45	241	234	232	232
query46	1230	953	972	953
query47	2028	1827	1717	1717
query48	1020	729	716	716
query49	619	377	374	374
query50	850	591	600	591
query51	4722	4661	4622	4622
query52	91	87	91	87
query53	450	323	317	317
query54	2683	2454	2518	2454
query55	93	85	89	85
query56	235	228	223	223
query57	1215	989	1145	989
query58	216	188	213	188
query59	4293	4077	4170	4077
query60	216	210	230	210
query61	102	96	98	96
query62	767	434	455	434
query63	494	343	340	340
query64	2406	1566	1402	1402
query65	3669	3566	3565	3565
query66	761	400	386	386
query67	16254	15864	15391	15391
query68	8708	684	691	684
query69	565	371	366	366
query70	1526	1412	1475	1412
query71	419	309	319	309
query72	6564	3530	3520	3520
query73	734	334	330	330
query74	6339	5831	5828	5828
query75	5296	3779	3709	3709
query76	5397	1134	1232	1134
query77	912	259	256	256
query78	12706	11641	11736	11641
query79	7886	649	654	649
query80	1038	406	411	406
query81	496	235	237	235
query82	1410	102	99	99
query83	175	134	143	134
query84	261	74	69	69
query85	888	327	322	322
query86	334	328	311	311
query87	3239	2991	3006	2991
query88	4975	2365	2373	2365
query89	365	282	289	282
query90	1938	219	220	219
query91	180	142	168	142
query92	61	54	49	49
query93	4736	582	564	564
query94	690	212	220	212
query95	1134	1077	1056	1056
query96	642	338	338	338
query97	6510	6485	6376	6376
query98	201	170	171	170
query99	2915	916	880	880
Total cold run time: 311766 ms
Total hot run time: 203953 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.25 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a17b36b82844446298fb7df95a51cc0fc5c989b9, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.04	0.05
query4	1.80	0.06	0.06
query5	0.54	0.52	0.52
query6	1.24	0.62	0.61
query7	0.01	0.00	0.01
query8	0.04	0.03	0.02
query9	0.55	0.48	0.48
query10	0.55	0.54	0.54
query11	0.12	0.08	0.09
query12	0.12	0.09	0.09
query13	0.62	0.62	0.61
query14	0.80	0.79	0.77
query15	0.77	0.77	0.77
query16	0.36	0.36	0.39
query17	0.98	1.01	1.01
query18	0.23	0.25	0.25
query19	1.90	1.83	1.86
query20	0.01	0.02	0.01
query21	15.48	0.55	0.56
query22	2.41	2.53	1.55
query23	17.14	0.98	0.95
query24	7.94	0.85	0.65
query25	0.34	0.12	0.05
query26	0.76	0.15	0.14
query27	0.03	0.04	0.03
query28	5.73	0.82	0.75
query29	12.61	2.16	2.37
query30	0.59	0.55	0.54
query31	2.83	0.38	0.36
query32	3.41	0.50	0.49
query33	3.07	3.05	3.07
query34	15.26	4.78	4.79
query35	4.85	4.84	4.85
query36	1.05	1.02	1.02
query37	0.06	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.14	0.14
query41	0.06	0.01	0.02
query42	0.03	0.01	0.01
query43	0.02	0.02	0.02
Total cold run time: 104.87 s
Total hot run time: 30.25 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a17b36b82844446298fb7df95a51cc0fc5c989b9 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.1 seconds inserted 10000000 Rows, about 473K ops/s

@yujun777 yujun777 marked this pull request as ready for review June 5, 2024 08:30
@dataroaring dataroaring merged commit fb5ecfb into apache:branch-2.0 Jun 7, 2024
23 of 24 checks passed
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants