Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[test](inverted index) add an Inverted Index Testing Switch #38942

Merged
merged 1 commit into from
Aug 13, 2024
Merged

[test](inverted index) add an Inverted Index Testing Switch #38942

merged 1 commit into from
Aug 13, 2024

Conversation

zzzxl1993
Copy link
Contributor

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zzzxl1993
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Aug 6, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.74% (8102/21467)
Line Coverage: 29.38% (66352/225861)
Region Coverage: 28.89% (34241/118532)
Branch Coverage: 24.77% (17593/71034)
Coverage Report: http://coverage.selectdb-in.cc/coverage/b0e93279c84eed4acc3ca33bc143bc1a778518cb_b0e93279c84eed4acc3ca33bc143bc1a778518cb/report/index.html

@zzzxl1993
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Aug 7, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 50140 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 319d7175bd0a0dab98f1e3c0dc805cd12162c873, data reload: false

------ Round 1 ----------------------------------
q1	17693	5991	4412	4412
q2	2090	164	157	157
q3	10612	1938	1913	1913
q4	10368	1298	1340	1298
q5	8477	3925	3950	3925
q6	237	128	151	128
q7	2048	1608	1619	1608
q8	9351	2756	2723	2723
q9	10595	10732	10250	10250
q10	8669	3507	3533	3507
q11	425	254	253	253
q12	473	310	303	303
q13	18342	3936	4025	3936
q14	359	332	332	332
q15	501	466	457	457
q16	691	573	581	573
q17	1152	987	1002	987
q18	7328	6864	6876	6864
q19	1812	1685	1666	1666
q20	547	314	299	299
q21	4497	4153	4106	4106
q22	524	448	443	443
Total cold run time: 116791 ms
Total hot run time: 50140 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4346	4332	4363	4332
q2	344	225	223	223
q3	4215	4169	4152	4152
q4	2764	2749	2774	2749
q5	7186	7169	7135	7135
q6	241	122	125	122
q7	3275	2785	2871	2785
q8	4457	4487	4565	4487
q9	16992	16917	16743	16743
q10	4242	4284	4298	4284
q11	792	688	698	688
q12	1032	848	866	848
q13	6939	3769	3742	3742
q14	455	434	416	416
q15	494	467	456	456
q16	755	674	675	674
q17	3765	3867	3897	3867
q18	8782	8702	8787	8702
q19	1744	1720	1699	1699
q20	2376	2136	2079	2079
q21	8496	8454	8382	8382
q22	1078	980	1023	980
Total cold run time: 84770 ms
Total hot run time: 79545 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203380 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 319d7175bd0a0dab98f1e3c0dc805cd12162c873, data reload: false

query1	950	389	417	389
query2	6534	2797	2923	2797
query3	6919	209	208	208
query4	20974	17955	17971	17955
query5	19742	6517	6516	6516
query6	292	214	241	214
query7	4164	291	300	291
query8	464	428	409	409
query9	3079	2634	2567	2567
query10	411	306	290	290
query11	11283	10584	10763	10584
query12	125	79	72	72
query13	5596	686	696	686
query14	17634	13446	13523	13446
query15	363	238	247	238
query16	6466	282	265	265
query17	1715	1442	859	859
query18	2319	407	412	407
query19	207	149	155	149
query20	80	78	82	78
query21	186	93	93	93
query22	5104	5035	4982	4982
query23	32677	31814	32049	31814
query24	6960	6553	6490	6490
query25	533	431	417	417
query26	534	163	162	162
query27	1869	291	293	291
query28	6208	2353	2313	2313
query29	2889	2840	2737	2737
query30	241	167	165	165
query31	914	739	742	739
query32	69	61	59	59
query33	407	249	256	249
query34	856	474	477	474
query35	1111	958	936	936
query36	1340	1255	1465	1255
query37	90	60	61	60
query38	3065	2948	2885	2885
query39	1377	1340	1313	1313
query40	200	93	94	93
query41	47	44	48	44
query42	82	85	80	80
query43	723	663	744	663
query44	1124	718	712	712
query45	248	237	240	237
query46	1224	953	986	953
query47	1817	1686	1707	1686
query48	1004	705	703	703
query49	619	373	375	373
query50	862	616	590	590
query51	4700	4650	4714	4650
query52	90	98	88	88
query53	445	319	327	319
query54	2689	2484	2479	2479
query55	95	82	91	82
query56	222	218	219	218
query57	1216	1048	1044	1044
query58	218	214	204	204
query59	3935	3764	4066	3764
query60	225	203	224	203
query61	93	91	93	91
query62	880	438	437	437
query63	488	346	344	344
query64	2574	1503	1396	1396
query65	3647	3583	3593	3583
query66	809	383	372	372
query67	15615	15149	15243	15149
query68	9923	669	636	636
query69	589	337	347	337
query70	1619	1544	1343	1343
query71	415	309	311	309
query72	6539	3499	3489	3489
query73	727	323	319	319
query74	6264	5917	5876	5876
query75	5349	3722	3642	3642
query76	6332	1158	1225	1158
query77	1073	262	256	256
query78	12704	11815	11877	11815
query79	7673	657	662	657
query80	1140	403	401	401
query81	495	237	238	237
query82	1635	102	99	99
query83	171	134	132	132
query84	258	72	73	72
query85	880	327	336	327
query86	333	332	333	332
query87	3257	3109	3026	3026
query88	4754	2307	2330	2307
query89	384	299	284	284
query90	1963	215	216	215
query91	170	138	152	138
query92	66	53	53	53
query93	5881	605	542	542
query94	700	214	212	212
query95	1124	1070	1056	1056
query96	649	330	322	322
query97	6422	6415	6448	6415
query98	183	176	178	176
query99	2876	898	786	786
Total cold run time: 314186 ms
Total hot run time: 203380 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.74% (8102/21468)
Line Coverage: 29.37% (66346/225871)
Region Coverage: 28.88% (34240/118540)
Branch Coverage: 24.77% (17594/71040)
Coverage Report: http://coverage.selectdb-in.cc/coverage/319d7175bd0a0dab98f1e3c0dc805cd12162c873_319d7175bd0a0dab98f1e3c0dc805cd12162c873/report/index.html

@doris-robot
Copy link

ClickBench: Total hot run time: 30.85 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 319d7175bd0a0dab98f1e3c0dc805cd12162c873, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.04	0.04
query4	1.79	0.07	0.07
query5	0.54	0.52	0.52
query6	1.23	0.62	0.62
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.54	0.49	0.49
query10	0.54	0.53	0.53
query11	0.13	0.09	0.09
query12	0.12	0.10	0.09
query13	0.62	0.61	0.62
query14	0.79	0.78	0.80
query15	0.77	0.76	0.75
query16	0.39	0.37	0.38
query17	0.98	1.01	1.02
query18	0.20	0.26	0.24
query19	1.94	1.85	1.85
query20	0.01	0.00	0.00
query21	15.47	0.57	0.56
query22	2.04	1.87	1.61
query23	16.81	1.00	0.97
query24	6.31	1.19	0.91
query25	0.36	0.11	0.06
query26	0.70	0.17	0.17
query27	0.04	0.04	0.04
query28	6.71	0.75	0.74
query29	12.65	2.28	2.36
query30	0.57	0.54	0.52
query31	2.81	0.40	0.37
query32	3.37	0.50	0.50
query33	3.11	3.09	3.08
query34	15.26	4.80	4.79
query35	4.89	4.86	4.84
query36	1.06	1.01	1.01
query37	0.06	0.05	0.05
query38	0.03	0.02	0.02
query39	0.03	0.01	0.02
query40	0.16	0.15	0.15
query41	0.07	0.02	0.01
query42	0.02	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 103.53 s
Total hot run time: 30.85 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 319d7175bd0a0dab98f1e3c0dc805cd12162c873 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       22.0 seconds inserted 10000000 Rows, about 454K ops/s

@xiaokang xiaokang merged commit 923cd83 into apache:branch-2.0 Aug 13, 2024
21 of 24 checks passed
GoGoWen pushed a commit to GoGoWen/incubator-doris that referenced this pull request Aug 27, 2024
@zzzxl1993
[test](inverted index) add an Inverted Index Testing Switch apache#38077
045fee8 
 (apache#38942)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@zzzxl1993 @doris-robot @xiaokang