Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Fix](Nereids) fix leading hint should have all tables in one query block (#33517) #35272

Merged
merged 1 commit into from
May 23, 2024

Conversation

LiBinfeng-01
Copy link
Contributor

cherry-pick: #33517

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@LiBinfeng-01
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 50622 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8326cefcc6588150badbaf64bdfa0319236856f5, data reload: false

------ Round 1 ----------------------------------
q1	17602	4361	4311	4311
q2	2059	148	145	145
q3	10352	1906	1921	1906
q4	10553	1230	1336	1230
q5	8484	4254	3983	3983
q6	240	128	125	125
q7	2111	1634	1600	1600
q8	9491	2734	2721	2721
q9	13934	10723	10581	10581
q10	8638	3515	3539	3515
q11	420	246	244	244
q12	472	290	305	290
q13	19325	4020	4050	4020
q14	355	330	335	330
q15	515	482	465	465
q16	676	567	582	567
q17	1161	979	941	941
q18	7632	7250	7303	7250
q19	1770	1605	1598	1598
q20	533	306	304	304
q21	4451	4162	4103	4103
q22	491	393	412	393
Total cold run time: 121265 ms
Total hot run time: 50622 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4390	4326	4339	4326
q2	334	240	220	220
q3	4186	4137	4150	4137
q4	2728	2722	2738	2722
q5	7149	7157	7131	7131
q6	235	119	119	119
q7	3163	2873	2842	2842
q8	4305	4445	4471	4445
q9	17317	16999	17098	16999
q10	4255	4240	4259	4240
q11	731	704	680	680
q12	1038	851	874	851
q13	6919	3740	3729	3729
q14	454	427	423	423
q15	501	456	451	451
q16	736	682	683	682
q17	3816	3852	3797	3797
q18	8699	8758	8776	8758
q19	1719	1676	1689	1676
q20	2402	2091	2118	2091
q21	8374	8380	8377	8377
q22	1059	964	904	904
Total cold run time: 84510 ms
Total hot run time: 79600 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203894 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8326cefcc6588150badbaf64bdfa0319236856f5, data reload: false

query1	929	384	369	369
query2	6541	2873	2868	2868
query3	6914	212	210	210
query4	20021	18068	18174	18068
query5	19730	6578	6636	6578
query6	290	213	228	213
query7	4157	301	317	301
query8	263	276	261	261
query9	3087	2695	2618	2618
query10	441	303	310	303
query11	11358	10728	10785	10728
query12	119	74	83	74
query13	5575	690	667	667
query14	17747	13463	13349	13349
query15	362	214	222	214
query16	6481	268	256	256
query17	1726	1485	872	872
query18	2293	405	402	402
query19	213	144	147	144
query20	81	79	77	77
query21	194	92	98	92
query22	5219	5162	5035	5035
query23	32652	31859	31801	31801
query24	6941	6449	6484	6449
query25	521	414	415	414
query26	499	161	157	157
query27	1770	285	290	285
query28	6216	2363	2324	2324
query29	2835	2703	2800	2703
query30	244	159	165	159
query31	923	719	724	719
query32	69	64	63	63
query33	395	247	238	238
query34	852	467	472	467
query35	1144	838	955	838
query36	1401	1116	1181	1116
query37	88	60	59	59
query38	3131	2934	2915	2915
query39	1358	1351	1341	1341
query40	206	99	93	93
query41	40	40	36	36
query42	84	84	84	84
query43	678	744	755	744
query44	1132	711	710	710
query45	240	229	232	229
query46	1224	948	948	948
query47	1762	1670	1855	1670
query48	1019	714	708	708
query49	623	368	367	367
query50	858	596	585	585
query51	4772	4687	4731	4687
query52	95	76	84	76
query53	444	324	315	315
query54	2662	2456	2452	2452
query55	98	78	84	78
query56	235	224	209	209
query57	1152	1142	1132	1132
query58	215	198	181	181
query59	4116	3925	3772	3772
query60	220	203	201	201
query61	86	86	85	85
query62	847	508	495	495
query63	491	343	335	335
query64	2484	1488	1474	1474
query65	3609	3555	3532	3532
query66	767	383	377	377
query67	15672	16143	15709	15709
query68	8302	661	693	661
query69	559	344	349	344
query70	1691	1255	1437	1255
query71	383	307	308	307
query72	6408	3425	3461	3425
query73	728	327	324	324
query74	6276	5785	5886	5785
query75	4546	3723	3712	3712
query76	4740	1126	1132	1126
query77	622	247	262	247
query78	12725	11871	12965	11871
query79	11006	671	683	671
query80	1395	393	390	390
query81	498	233	234	233
query82	638	104	95	95
query83	164	129	133	129
query84	261	69	73	69
query85	867	305	299	299
query86	329	282	290	282
query87	3248	3015	3023	3015
query88	4681	2378	2373	2373
query89	378	301	287	287
query90	1930	217	218	217
query91	167	131	135	131
query92	61	54	53	53
query93	3685	575	588	575
query94	831	207	200	200
query95	1119	1068	1065	1065
query96	638	326	338	326
query97	6624	6411	6353	6353
query98	206	178	166	166
query99	3124	899	877	877
Total cold run time: 309441 ms
Total hot run time: 203894 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.29 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8326cefcc6588150badbaf64bdfa0319236856f5, data reload: false

query1	0.02	0.02	0.02
query2	0.06	0.03	0.02
query3	0.25	0.05	0.05
query4	1.79	0.08	0.10
query5	0.53	0.53	0.52
query6	1.24	0.61	0.61
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.52	0.49	0.48
query10	0.53	0.55	0.51
query11	0.12	0.08	0.09
query12	0.11	0.08	0.08
query13	0.63	0.62	0.61
query14	0.78	0.80	0.79
query15	0.79	0.77	0.78
query16	0.36	0.35	0.36
query17	1.01	0.94	0.98
query18	0.23	0.22	0.25
query19	1.91	1.82	1.84
query20	0.02	0.01	0.01
query21	15.47	0.58	0.54
query22	2.00	2.44	2.06
query23	17.26	0.97	0.99
query24	7.56	1.09	1.06
query25	0.38	0.09	0.06
query26	0.80	0.15	0.14
query27	0.05	0.03	0.03
query28	5.47	0.73	0.72
query29	12.76	2.34	2.35
query30	0.51	0.51	0.53
query31	2.80	0.38	0.37
query32	3.40	0.50	0.49
query33	3.07	3.10	3.09
query34	15.27	4.79	4.83
query35	4.86	4.87	4.87
query36	1.06	1.02	1.02
query37	0.06	0.05	0.04
query38	0.04	0.02	0.02
query39	0.01	0.01	0.02
query40	0.16	0.15	0.14
query41	0.06	0.01	0.02
query42	0.02	0.01	0.01
query43	0.02	0.01	0.02
Total cold run time: 104.04 s
Total hot run time: 31.29 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 8326cefcc6588150badbaf64bdfa0319236856f5 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

@xiaokang xiaokang merged commit 24d8481 into apache:branch-2.0 May 23, 2024
24 of 25 checks passed
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants