Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Fix](inverted index) fix profile metrics for inverted index after refactor #40324

Merged
merged 1 commit into from
Sep 3, 2024

Conversation

airborne12
Copy link
Member

Proposed changes

Make profile metrics right after #38908

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@airborne12
Copy link
Member Author

run buildall

Copy link
Contributor

github-actions bot commented Sep 3, 2024

clang-tidy review says "All clean, LGTM! 👍"

Copy link
Contributor

@csun5285 csun5285 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

github-actions bot commented Sep 3, 2024

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 38220 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit eb741fae9a32f1641293364cb0add90c691b0ad4, data reload: false

------ Round 1 ----------------------------------
q1	18223	4434	4306	4306
q2	2026	177	178	177
q3	10479	1173	1066	1066
q4	10132	824	813	813
q5	7709	2866	2795	2795
q6	230	138	140	138
q7	964	622	598	598
q8	9328	2042	2077	2042
q9	7008	6548	6540	6540
q10	7000	2225	2174	2174
q11	467	246	251	246
q12	393	226	223	223
q13	17994	3099	3150	3099
q14	289	238	253	238
q15	514	480	494	480
q16	578	538	514	514
q17	955	691	664	664
q18	7397	6839	6770	6770
q19	1375	1073	1114	1073
q20	665	343	318	318
q21	3809	3018	2952	2952
q22	1125	994	1025	994
Total cold run time: 108660 ms
Total hot run time: 38220 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4309	4311	4342	4311
q2	379	270	285	270
q3	2901	2634	2654	2634
q4	1936	1667	1639	1639
q5	5447	5401	5395	5395
q6	224	130	132	130
q7	2094	1731	1771	1731
q8	3223	3366	3333	3333
q9	8470	8494	8444	8444
q10	3452	3196	3160	3160
q11	600	503	514	503
q12	815	620	623	620
q13	11975	3114	3089	3089
q14	306	277	278	277
q15	537	471	487	471
q16	635	569	581	569
q17	1792	1515	1453	1453
q18	7725	7406	7553	7406
q19	1660	1582	1549	1549
q20	2063	1840	1824	1824
q21	5445	5273	5224	5224
q22	1166	1020	1053	1020
Total cold run time: 67154 ms
Total hot run time: 55052 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188525 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit eb741fae9a32f1641293364cb0add90c691b0ad4, data reload: false

query1	925	375	367	367
query2	6464	1923	1988	1923
query3	6647	207	214	207
query4	31080	23276	23283	23276
query5	4155	521	500	500
query6	255	164	163	163
query7	4593	296	289	289
query8	245	210	198	198
query9	8648	2486	2462	2462
query10	442	284	270	270
query11	18039	15041	14977	14977
query12	152	95	96	95
query13	1628	383	367	367
query14	8835	6961	7509	6961
query15	270	165	175	165
query16	7456	464	470	464
query17	1620	560	561	560
query18	1998	306	293	293
query19	296	149	150	149
query20	121	111	110	110
query21	214	105	107	105
query22	4492	4200	4186	4186
query23	34259	33950	33593	33593
query24	11318	2837	2873	2837
query25	608	380	383	380
query26	1200	154	173	154
query27	2724	289	275	275
query28	7421	2058	2034	2034
query29	776	419	421	419
query30	317	161	166	161
query31	976	725	792	725
query32	93	57	53	53
query33	751	279	288	279
query34	934	469	490	469
query35	847	714	724	714
query36	1095	941	951	941
query37	164	95	95	95
query38	4024	3841	3943	3841
query39	1449	1411	1384	1384
query40	201	117	113	113
query41	49	46	71	46
query42	115	91	98	91
query43	520	474	477	474
query44	1201	739	741	739
query45	202	165	169	165
query46	1113	724	748	724
query47	1853	1783	1808	1783
query48	377	292	287	287
query49	1100	427	431	427
query50	820	426	415	415
query51	7048	6865	6885	6865
query52	97	90	86	86
query53	256	182	179	179
query54	989	461	457	457
query55	74	76	83	76
query56	278	266	255	255
query57	1189	1090	1077	1077
query58	247	236	242	236
query59	2965	2893	2774	2774
query60	296	270	275	270
query61	99	99	102	99
query62	819	663	659	659
query63	210	186	181	181
query64	4441	673	734	673
query65	3241	3168	3185	3168
query66	1455	345	345	345
query67	15636	15338	15296	15296
query68	3123	583	571	571
query69	452	291	278	278
query70	1159	1179	1045	1045
query71	343	272	278	272
query72	6346	4061	4061	4061
query73	735	324	339	324
query74	9153	8921	8858	8858
query75	3376	2693	2675	2675
query76	1878	1022	968	968
query77	513	320	324	320
query78	11268	9392	9961	9392
query79	1131	542	538	538
query80	766	506	505	505
query81	559	236	234	234
query82	806	147	142	142
query83	253	160	156	156
query84	227	83	75	75
query85	762	289	276	276
query86	309	303	300	300
query87	4443	4314	4389	4314
query88	2990	2331	2324	2324
query89	387	289	282	282
query90	2038	197	199	197
query91	131	102	103	102
query92	61	49	49	49
query93	1047	526	529	526
query94	907	296	294	294
query95	355	259	258	258
query96	587	266	264	264
query97	3243	3109	3055	3055
query98	226	210	197	197
query99	1459	1293	1272	1272
Total cold run time: 285455 ms
Total hot run time: 188525 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.19 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit eb741fae9a32f1641293364cb0add90c691b0ad4, data reload: false

query1	0.04	0.04	0.05
query2	0.09	0.03	0.04
query3	0.22	0.06	0.05
query4	1.64	0.08	0.08
query5	0.51	0.50	0.50
query6	1.14	0.73	0.73
query7	0.02	0.01	0.02
query8	0.04	0.04	0.05
query9	0.55	0.48	0.49
query10	0.55	0.54	0.53
query11	0.15	0.12	0.12
query12	0.15	0.13	0.12
query13	0.60	0.59	0.59
query14	2.05	2.07	2.13
query15	0.89	0.83	0.82
query16	0.36	0.38	0.35
query17	0.98	0.98	1.02
query18	0.22	0.20	0.20
query19	1.86	1.72	1.72
query20	0.01	0.02	0.01
query21	15.40	0.69	0.66
query22	3.79	7.94	1.88
query23	18.28	1.48	1.34
query24	2.10	0.22	0.22
query25	0.15	0.08	0.08
query26	0.27	0.18	0.18
query27	0.07	0.08	0.07
query28	13.26	1.02	1.00
query29	12.56	3.41	3.45
query30	0.24	0.06	0.07
query31	2.85	0.41	0.40
query32	3.24	0.48	0.48
query33	2.97	2.99	3.06
query34	16.97	4.47	4.43
query35	4.46	4.48	4.45
query36	0.67	0.49	0.48
query37	0.19	0.15	0.16
query38	0.16	0.15	0.15
query39	0.05	0.04	0.04
query40	0.15	0.12	0.13
query41	0.10	0.05	0.05
query42	0.06	0.04	0.04
query43	0.05	0.04	0.04
Total cold run time: 110.11 s
Total hot run time: 32.19 s

Copy link
Contributor

@zzzxl1993 zzzxl1993 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@qidaye qidaye left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

github-actions bot commented Sep 3, 2024

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 3, 2024
@airborne12 airborne12 merged commit 5e93a71 into apache:master Sep 3, 2024
28 of 31 checks passed
@airborne12 airborne12 deleted the fix-timer branch September 3, 2024 11:57
airborne12 added a commit that referenced this pull request Sep 10, 2024
airborne12 added a commit to airborne12/apache-doris that referenced this pull request Sep 10, 2024
…factor (apache#40324)

## Proposed changes
Make profile metrics right after apache#38908
airborne12 added a commit to airborne12/apache-doris that referenced this pull request Sep 29, 2024
…factor (apache#40324)

## Proposed changes
Make profile metrics right after apache#38908
airborne12 added a commit that referenced this pull request Sep 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.7-merged dev/3.0.2-merged reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants