Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[chore](fe) Returns dropped tables in GetMeta request #38542

Merged
merged 1 commit into from
Jul 31, 2024

Conversation

w41ter
Copy link
Contributor

@w41ter w41ter commented Jul 30, 2024

Cherry-pick #38019

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@w41ter
Copy link
Contributor Author

w41ter commented Jul 30, 2024

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 50224 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a29afde60f4dd09707f7251cdbbab06ce4641bc4, data reload: false

------ Round 1 ----------------------------------
q1	17896	4466	4368	4368
q2	2077	161	148	148
q3	10470	1903	1919	1903
q4	10310	1236	1346	1236
q5	8712	3968	3969	3968
q6	254	127	126	126
q7	2066	1630	1575	1575
q8	9313	2751	2728	2728
q9	10978	10560	10492	10492
q10	8621	3524	3505	3505
q11	423	259	256	256
q12	478	314	312	312
q13	18362	3968	4067	3968
q14	350	316	327	316
q15	506	447	456	447
q16	681	567	575	567
q17	1143	970	1001	970
q18	7267	6968	6953	6953
q19	1777	1667	1586	1586
q20	547	308	301	301
q21	4449	4099	4063	4063
q22	546	455	436	436
Total cold run time: 117226 ms
Total hot run time: 50224 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4372	4305	4341	4305
q2	323	225	227	225
q3	4187	4153	4123	4123
q4	2776	2768	2763	2763
q5	7219	7140	7139	7139
q6	238	119	123	119
q7	3271	2875	2902	2875
q8	4376	4484	4509	4484
q9	17442	17072	17317	17072
q10	4256	4321	4268	4268
q11	778	682	682	682
q12	1021	867	833	833
q13	6358	3751	3735	3735
q14	459	429	428	428
q15	498	460	449	449
q16	746	672	687	672
q17	3909	3836	3857	3836
q18	8846	8740	8796	8740
q19	1744	1715	1684	1684
q20	2401	2115	2112	2112
q21	8613	8454	8436	8436
q22	1046	1006	1004	1004
Total cold run time: 84879 ms
Total hot run time: 79984 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 204941 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a29afde60f4dd09707f7251cdbbab06ce4641bc4, data reload: false

query1	932	424	380	380
query2	6553	2883	2859	2859
query3	6920	213	199	199
query4	20134	18083	18162	18083
query5	19723	6513	6605	6513
query6	296	215	236	215
query7	4153	311	315	311
query8	450	453	404	404
query9	3194	2746	2656	2656
query10	424	303	299	299
query11	11353	10701	10735	10701
query12	125	77	73	73
query13	5601	723	697	697
query14	18286	13716	13781	13716
query15	368	248	250	248
query16	6449	285	266	266
query17	1522	1480	874	874
query18	2277	430	422	422
query19	215	153	150	150
query20	81	81	84	81
query21	191	101	100	100
query22	5166	5087	5000	5000
query23	32445	32260	31981	31981
query24	7023	6526	6483	6483
query25	519	426	434	426
query26	522	168	164	164
query27	1801	310	297	297
query28	6190	2409	2370	2370
query29	2821	2644	2713	2644
query30	248	166	165	165
query31	915	756	729	729
query32	71	62	62	62
query33	401	254	272	254
query34	838	504	490	490
query35	1168	954	976	954
query36	1273	1162	1143	1143
query37	98	61	60	60
query38	3060	2984	2929	2929
query39	1386	1321	1332	1321
query40	209	99	98	98
query41	46	44	44	44
query42	81	87	87	87
query43	683	687	625	625
query44	1145	730	735	730
query45	256	238	232	232
query46	1226	947	992	947
query47	1993	1721	1716	1716
query48	1028	721	723	721
query49	631	372	387	372
query50	864	598	576	576
query51	4837	4667	4725	4667
query52	107	85	87	85
query53	454	323	324	323
query54	2644	2480	2485	2480
query55	96	78	96	78
query56	243	219	203	203
query57	1224	1077	1162	1077
query58	218	205	193	193
query59	4026	4061	3828	3828
query60	217	209	216	209
query61	100	95	97	95
query62	835	447	525	447
query63	495	342	355	342
query64	2390	1537	1500	1500
query65	3648	3555	3594	3555
query66	756	379	384	379
query67	16485	15525	15364	15364
query68	9105	668	679	668
query69	572	346	369	346
query70	1799	1468	1378	1378
query71	428	329	301	301
query72	6529	3480	3443	3443
query73	738	327	324	324
query74	6263	5923	5840	5840
query75	5501	3757	3713	3713
query76	5800	1157	1148	1148
query77	985	256	260	256
query78	12917	12732	11933	11933
query79	13046	662	657	657
query80	811	402	409	402
query81	494	234	233	233
query82	1177	101	101	101
query83	171	137	134	134
query84	256	71	74	71
query85	857	338	340	338
query86	336	290	299	290
query87	3229	3021	3090	3021
query88	5892	2360	2344	2344
query89	424	291	292	291
query90	1994	194	217	194
query91	192	144	151	144
query92	62	59	55	55
query93	5872	589	607	589
query94	732	214	219	214
query95	1103	1069	1070	1069
query96	657	324	332	324
query97	6519	6406	6539	6406
query98	186	175	176	175
query99	2810	861	847	847
Total cold run time: 319586 ms
Total hot run time: 204941 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.62 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a29afde60f4dd09707f7251cdbbab06ce4641bc4, data reload: false

query1	0.02	0.02	0.02
query2	0.06	0.03	0.02
query3	0.24	0.05	0.06
query4	1.78	0.06	0.07
query5	0.53	0.53	0.52
query6	1.23	0.65	0.62
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.53	0.46	0.48
query10	0.54	0.53	0.55
query11	0.12	0.09	0.09
query12	0.11	0.09	0.10
query13	0.62	0.61	0.62
query14	0.78	0.78	0.78
query15	0.78	0.78	0.77
query16	0.40	0.38	0.39
query17	1.02	1.00	1.03
query18	0.22	0.26	0.22
query19	1.86	1.86	1.88
query20	0.01	0.02	0.01
query21	15.46	0.54	0.54
query22	2.08	2.07	1.86
query23	17.20	1.04	1.07
query24	5.52	1.27	1.13
query25	0.46	0.06	0.06
query26	0.63	0.16	0.15
query27	0.05	0.04	0.04
query28	7.26	0.75	0.75
query29	12.62	2.36	2.36
query30	0.59	0.54	0.57
query31	2.81	0.40	0.38
query32	3.37	0.52	0.49
query33	3.07	3.06	3.13
query34	15.63	4.85	4.85
query35	4.90	4.93	4.93
query36	1.08	1.04	1.05
query37	0.06	0.05	0.05
query38	0.03	0.02	0.02
query39	0.02	0.02	0.02
query40	0.16	0.14	0.14
query41	0.07	0.02	0.02
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 104.01 s
Total hot run time: 31.62 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a29afde60f4dd09707f7251cdbbab06ce4641bc4 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       22.0 seconds inserted 10000000 Rows, about 454K ops/s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.81% (8118/21472)
Line Coverage: 29.48% (66596/225916)
Region Coverage: 28.96% (34328/118525)
Branch Coverage: 24.84% (17638/71010)
Coverage Report: http://coverage.selectdb-in.cc/coverage/a29afde60f4dd09707f7251cdbbab06ce4641bc4_a29afde60f4dd09707f7251cdbbab06ce4641bc4/report/index.html

@w41ter w41ter merged commit ce7c979 into apache:branch-2.0 Jul 31, 2024
21 of 25 checks passed
@w41ter w41ter deleted the pick/38019_to_2.0 branch July 31, 2024 02:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants