Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix] (inverted index) fix error result in compound query (#40425) #40469

Merged
merged 1 commit into from
Sep 7, 2024

Conversation

csun5285
Copy link
Contributor

@csun5285 csun5285 commented Sep 6, 2024

Proposed changes

pick from branch-2.1 #40425

 fix
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@csun5285
Copy link
Contributor Author

csun5285 commented Sep 6, 2024

run buildall

Copy link
Contributor

github-actions bot commented Sep 6, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 48895 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 65dcd78d92aabe2a7a0ebd55af3255392d6d86ae, data reload: false

------ Round 1 ----------------------------------
q1	18138	4331	4304	4304
q2	2028	155	143	143
q3	10262	1881	1930	1881
q4	10320	1238	1320	1238
q5	8442	3872	3900	3872
q6	225	125	124	124
q7	2038	1628	1572	1572
q8	9281	2721	2690	2690
q9	10410	9885	9887	9885
q10	8648	3543	3498	3498
q11	425	248	251	248
q12	465	301	299	299
q13	18367	3988	4017	3988
q14	341	331	324	324
q15	501	453	469	453
q16	540	457	457	457
q17	1128	956	906	906
q18	7170	6719	6991	6719
q19	1670	1555	1499	1499
q20	549	315	292	292
q21	4372	4105	4107	4105
q22	482	402	398	398
Total cold run time: 115802 ms
Total hot run time: 48895 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4349	4326	4386	4326
q2	316	216	221	216
q3	4160	4125	4127	4125
q4	2739	2749	2738	2738
q5	7166	7238	7170	7170
q6	236	117	121	117
q7	3245	2876	2804	2804
q8	4367	4447	4494	4447
q9	14281	13978	13693	13693
q10	4267	4260	4268	4260
q11	747	694	694	694
q12	1009	854	845	845
q13	6458	3814	3805	3805
q14	474	419	439	419
q15	494	473	462	462
q16	628	579	594	579
q17	3844	3855	3845	3845
q18	8714	8749	8934	8749
q19	1716	1681	1691	1681
q20	2408	2131	2112	2112
q21	8515	8451	8418	8418
q22	1036	922	948	922
Total cold run time: 81169 ms
Total hot run time: 76427 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.85% (8137/21497)
Line Coverage: 29.60% (66984/226311)
Region Coverage: 29.09% (34564/118823)
Branch Coverage: 24.99% (17809/71260)
Coverage Report: http://coverage.selectdb-in.cc/coverage/65dcd78d92aabe2a7a0ebd55af3255392d6d86ae_65dcd78d92aabe2a7a0ebd55af3255392d6d86ae/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 213469 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 65dcd78d92aabe2a7a0ebd55af3255392d6d86ae, data reload: false

query1	979	412	448	412
query2	6661	2224	1982	1982
query3	6998	221	211	211
query4	24541	22121	21712	21712
query5	19734	6543	6510	6510
query6	416	217	224	217
query7	5165	302	314	302
query8	274	266	256	256
query9	3071	2656	2594	2594
query10	441	289	300	289
query11	15917	15030	15136	15030
query12	124	73	72	72
query13	994	433	438	433
query14	19227	13356	13284	13284
query15	362	215	229	215
query16	6437	280	260	260
query17	1563	949	917	917
query18	889	323	309	309
query19	212	151	145	145
query20	75	78	80	78
query21	193	95	98	95
query22	5193	5046	5216	5046
query23	34182	33522	33451	33451
query24	6743	6277	6288	6277
query25	538	437	432	432
query26	796	161	166	161
query27	2274	297	294	294
query28	6119	2270	2218	2218
query29	2851	2843	2765	2765
query30	248	170	167	167
query31	987	704	745	704
query32	70	61	57	57
query33	431	264	251	251
query34	880	451	467	451
query35	1134	952	973	952
query36	1515	1278	1246	1246
query37	93	58	59	58
query38	3100	2934	2941	2934
query39	1386	1327	1313	1313
query40	206	99	95	95
query41	39	36	36	36
query42	88	80	85	80
query43	661	725	549	549
query44	1219	728	720	720
query45	248	227	227	227
query46	1233	963	942	942
query47	1973	1775	1680	1680
query48	508	419	408	408
query49	623	372	377	372
query50	858	625	591	591
query51	4789	4688	4662	4662
query52	88	76	84	76
query53	228	189	182	182
query54	2657	2487	2485	2485
query55	95	80	84	80
query56	252	213	210	210
query57	1206	1179	1023	1023
query58	222	202	215	202
query59	3555	3501	3432	3432
query60	218	221	190	190
query61	97	92	96	92
query62	848	488	491	488
query63	205	177	172	172
query64	3364	1587	1543	1543
query65	3616	3550	3571	3550
query66	742	410	416	410
query67	16189	16762	15783	15783
query68	8062	668	675	668
query69	498	282	273	273
query70	1579	1254	1361	1254
query71	412	306	320	306
query72	6827	4719	4865	4719
query73	775	326	324	324
query74	6296	5874	5819	5819
query75	4572	3763	3734	3734
query76	4516	1149	1187	1149
query77	554	254	267	254
query78	12745	11923	12069	11923
query79	8014	661	649	649
query80	2410	389	386	386
query81	500	244	233	233
query82	1440	96	104	96
query83	170	133	133	133
query84	260	71	69	69
query85	1284	319	317	317
query86	360	331	295	295
query87	3252	3022	2970	2970
query88	4628	2324	2312	2312
query89	465	282	302	282
query90	1761	215	219	215
query91	157	134	130	130
query92	67	50	52	50
query93	5618	554	562	554
query94	765	215	208	208
query95	2055	2056	2057	2056
query96	640	325	325	325
query97	6534	6351	6415	6351
query98	233	218	210	210
query99	2990	951	825	825
Total cold run time: 319279 ms
Total hot run time: 213469 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.45 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 65dcd78d92aabe2a7a0ebd55af3255392d6d86ae, data reload: false

query1	0.02	0.02	0.02
query2	0.08	0.02	0.02
query3	0.25	0.05	0.05
query4	1.80	0.07	0.07
query5	0.53	0.52	0.52
query6	1.24	0.63	0.62
query7	0.02	0.01	0.02
query8	0.04	0.03	0.02
query9	0.52	0.49	0.49
query10	0.53	0.54	0.54
query11	0.12	0.09	0.09
query12	0.11	0.09	0.09
query13	0.61	0.61	0.61
query14	0.79	0.79	0.78
query15	0.78	0.76	0.76
query16	0.39	0.36	0.36
query17	1.02	1.01	1.02
query18	0.22	0.26	0.25
query19	1.97	1.85	1.82
query20	0.01	0.00	0.00
query21	15.50	0.57	0.55
query22	1.97	2.04	1.62
query23	16.96	0.88	0.96
query24	5.92	1.94	1.62
query25	0.33	0.10	0.07
query26	0.84	0.15	0.16
query27	0.04	0.05	0.04
query28	5.95	0.74	0.74
query29	12.67	2.34	2.33
query30	0.54	0.52	0.51
query31	2.81	0.38	0.37
query32	3.39	0.49	0.50
query33	3.08	3.07	3.06
query34	15.25	4.79	4.79
query35	4.88	4.86	4.84
query36	1.08	1.00	1.02
query37	0.06	0.05	0.05
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.15	0.14	0.14
query41	0.07	0.02	0.01
query42	0.02	0.01	0.01
query43	0.02	0.02	0.02
Total cold run time: 102.64 s
Total hot run time: 31.45 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 65dcd78d92aabe2a7a0ebd55af3255392d6d86ae with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

@xiaokang xiaokang merged commit ced13ac into apache:branch-2.0 Sep 7, 2024
19 of 24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants