Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[chore](Nereids) disable fallback_to_original_planner by default #32882

Merged
merged 1 commit into from
Apr 17, 2024
Merged

[chore](Nereids) disable fallback_to_original_planner by default #32882

merged 1 commit into from
Apr 17, 2024

Conversation

morrySnow
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37722 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bbfab684d920774cc00a855cd2ce4b3ac457e48d, data reload: false

------ Round 1 ----------------------------------
q1	17613	4236	4091	4091
q2	2101	161	149	149
q3	10584	1175	1179	1175
q4	10224	751	745	745
q5	7435	2949	2960	2949
q6	204	124	122	122
q7	1026	584	577	577
q8	9318	1958	1948	1948
q9	7183	6567	6546	6546
q10	8448	3434	3563	3434
q11	434	229	226	226
q12	364	208	201	201
q13	17799	2837	2839	2837
q14	235	201	213	201
q15	513	462	458	458
q16	482	374	375	374
q17	941	623	578	578
q18	7152	6391	6386	6386
q19	3772	1358	1400	1358
q20	539	246	247	246
q21	3542	2829	2982	2829
q22	342	310	292	292
Total cold run time: 110251 ms
Total hot run time: 37722 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4118	4049	4083	4049
q2	325	231	231	231
q3	2975	2839	2829	2829
q4	1826	1552	1565	1552
q5	5258	5349	5305	5305
q6	197	119	118	118
q7	2251	1857	1866	1857
q8	3154	3264	3290	3264
q9	8681	8680	8678	8678
q10	3823	3776	3797	3776
q11	540	445	437	437
q12	732	542	575	542
q13	16919	2846	2863	2846
q14	270	253	266	253
q15	493	468	454	454
q16	490	429	439	429
q17	1715	1498	1455	1455
q18	7306	7191	7042	7042
q19	1611	1498	1461	1461
q20	1958	1743	1718	1718
q21	4711	4716	4731	4716
q22	517	476	447	447
Total cold run time: 69870 ms
Total hot run time: 53459 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 181856 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bbfab684d920774cc00a855cd2ce4b3ac457e48d, data reload: false

query1	934	364	352	352
query2	7615	1989	1804	1804
query3	6700	217	220	217
query4	31694	21348	21361	21348
query5	4314	414	390	390
query6	276	176	169	169
query7	4630	300	289	289
query8	236	170	175	170
query9	9167	2297	2260	2260
query10	574	245	267	245
query11	14746	14350	14280	14280
query12	139	86	86	86
query13	1630	429	427	427
query14	11250	7751	7899	7751
query15	244	209	193	193
query16	8171	257	262	257
query17	1943	575	545	545
query18	2101	290	319	290
query19	317	161	156	156
query20	101	87	86	86
query21	203	127	125	125
query22	5035	4876	4826	4826
query23	33850	32862	32912	32862
query24	10953	2818	2859	2818
query25	627	389	391	389
query26	1365	160	165	160
query27	2924	362	361	361
query28	7327	1918	1900	1900
query29	903	639	625	625
query30	304	150	149	149
query31	974	720	733	720
query32	97	59	55	55
query33	771	255	249	249
query34	1042	491	488	488
query35	809	605	603	603
query36	1029	907	898	898
query37	119	67	65	65
query38	3588	3473	3428	3428
query39	1461	1447	1448	1447
query40	223	130	112	112
query41	50	47	47	47
query42	102	97	101	97
query43	457	436	438	436
query44	1182	761	735	735
query45	273	260	255	255
query46	1117	710	704	704
query47	1922	1941	1842	1842
query48	456	356	365	356
query49	1131	348	341	341
query50	772	377	379	377
query51	6660	6617	6674	6617
query52	103	94	89	89
query53	348	277	279	277
query54	304	248	244	244
query55	90	80	81	80
query56	252	231	226	226
query57	1236	1139	1133	1133
query58	231	218	214	214
query59	2677	2485	2458	2458
query60	289	254	246	246
query61	114	112	115	112
query62	646	439	438	438
query63	298	272	276	272
query64	5758	3958	3943	3943
query65	3112	3025	3051	3025
query66	1484	378	360	360
query67	15118	14895	14829	14829
query68	6393	533	531	531
query69	599	378	398	378
query70	1261	1201	1148	1148
query71	448	264	259	259
query72	6380	2733	2533	2533
query73	719	319	318	318
query74	6623	6334	6404	6334
query75	3250	2226	2231	2226
query76	4344	936	915	915
query77	623	272	256	256
query78	10999	10084	10218	10084
query79	8724	539	538	538
query80	1964	379	388	379
query81	565	215	216	215
query82	1573	83	86	83
query83	289	144	148	144
query84	285	76	82	76
query85	1636	319	312	312
query86	512	291	313	291
query87	3741	3525	3518	3518
query88	5227	2380	2377	2377
query89	540	372	369	369
query90	1903	176	177	176
query91	168	135	140	135
query92	66	48	48	48
query93	7267	510	501	501
query94	1229	182	184	182
query95	446	342	335	335
query96	627	272	270	270
query97	2695	2486	2465	2465
query98	234	220	209	209
query99	1281	903	947	903
Total cold run time: 309179 ms
Total hot run time: 181856 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit bbfab684d920774cc00a855cd2ce4b3ac457e48d with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.9 seconds inserted 10000000 Rows, about 719K ops/s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38055 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a11adb0ea1858ed96aff3f7645d45f2a3d51ef47, data reload: false

------ Round 1 ----------------------------------
q1	17621	4151	4146	4146
q2	2112	163	161	161
q3	10576	1128	1226	1128
q4	10223	731	837	731
q5	7471	3021	2972	2972
q6	205	125	120	120
q7	1044	582	562	562
q8	9333	2015	1988	1988
q9	7169	6640	6552	6552
q10	8371	3449	3599	3449
q11	430	239	221	221
q12	373	203	196	196
q13	17815	2880	2882	2880
q14	252	201	200	200
q15	514	478	481	478
q16	475	374	377	374
q17	947	536	602	536
q18	7119	6478	6529	6478
q19	1527	1468	1493	1468
q20	552	252	252	252
q21	3597	2928	2864	2864
q22	350	309	299	299
Total cold run time: 108076 ms
Total hot run time: 38055 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4075	4084	4123	4084
q2	327	232	229	229
q3	2999	2809	2873	2809
q4	1858	1502	1518	1502
q5	5296	5320	5290	5290
q6	200	118	118	118
q7	2268	1823	1868	1823
q8	3157	3278	3287	3278
q9	8681	8673	8718	8673
q10	3815	3798	3808	3798
q11	546	460	451	451
q12	732	536	542	536
q13	16916	2877	2858	2858
q14	270	264	251	251
q15	503	461	463	461
q16	479	426	420	420
q17	1734	1480	1446	1446
q18	7323	7184	6973	6973
q19	1610	1485	1507	1485
q20	1905	1732	1713	1713
q21	4707	4713	4826	4713
q22	536	453	457	453
Total cold run time: 69937 ms
Total hot run time: 53364 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 182523 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a11adb0ea1858ed96aff3f7645d45f2a3d51ef47, data reload: false

query1	932	375	366	366
query2	6556	2112	1926	1926
query3	6702	210	209	209
query4	31733	21335	21434	21335
query5	4325	406	393	393
query6	274	179	174	174
query7	4645	298	287	287
query8	249	167	168	167
query9	9407	2311	2291	2291
query10	554	249	241	241
query11	15392	14223	14293	14223
query12	144	95	88	88
query13	1637	412	411	411
query14	10058	8016	7884	7884
query15	277	211	201	201
query16	8249	267	265	265
query17	2041	593	554	554
query18	2104	292	287	287
query19	345	157	158	157
query20	97	89	90	89
query21	201	131	124	124
query22	5070	4832	4860	4832
query23	33546	33028	32882	32882
query24	11109	2907	2825	2825
query25	621	391	387	387
query26	1639	159	153	153
query27	2949	352	353	352
query28	7522	1897	1862	1862
query29	970	619	613	613
query30	305	159	150	150
query31	970	736	752	736
query32	87	58	55	55
query33	767	248	251	248
query34	1056	492	491	491
query35	829	621	613	613
query36	1027	894	899	894
query37	118	69	63	63
query38	3579	3398	3433	3398
query39	1494	1453	1425	1425
query40	290	115	111	111
query41	51	49	51	49
query42	107	98	96	96
query43	506	466	457	457
query44	1206	730	742	730
query45	277	266	268	266
query46	1127	698	720	698
query47	1920	1847	1841	1841
query48	454	355	366	355
query49	1199	332	349	332
query50	764	379	370	370
query51	6716	6740	6583	6583
query52	104	89	97	89
query53	340	276	274	274
query54	339	238	225	225
query55	79	76	78	76
query56	242	216	215	215
query57	1266	1131	1142	1131
query58	231	202	203	202
query59	2808	2762	2787	2762
query60	275	239	247	239
query61	98	93	95	93
query62	663	432	437	432
query63	306	270	280	270
query64	6248	3932	3984	3932
query65	3174	3118	3078	3078
query66	1410	369	356	356
query67	15738	15075	15006	15006
query68	8443	517	521	517
query69	614	380	374	374
query70	1289	1187	1171	1171
query71	517	260	249	249
query72	6474	2703	2564	2564
query73	729	316	318	316
query74	6923	6442	6360	6360
query75	3674	2191	2233	2191
query76	5121	916	890	890
query77	638	272	260	260
query78	10893	10380	10167	10167
query79	7930	533	537	533
query80	1394	403	395	395
query81	518	217	219	217
query82	520	90	88	88
query83	222	153	147	147
query84	287	83	82	82
query85	1270	390	369	369
query86	392	295	320	295
query87	3775	3563	3562	3562
query88	4505	2301	2289	2289
query89	488	361	379	361
query90	2059	171	173	171
query91	169	159	138	138
query92	60	46	46	46
query93	6384	496	490	490
query94	1206	190	188	188
query95	436	326	337	326
query96	601	277	269	269
query97	2637	2500	2476	2476
query98	223	217	209	209
query99	1204	894	923	894
Total cold run time: 309113 ms
Total hot run time: 182523 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a11adb0ea1858ed96aff3f7645d45f2a3d51ef47 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       14.1 seconds inserted 10000000 Rows, about 709K ops/s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38179 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 11ffe2e88ffefcce8e05cb0a24ebf3d0e7003875, data reload: false

------ Round 1 ----------------------------------
q1	17888	4407	4201	4201
q2	2432	161	172	161
q3	11509	1113	1175	1113
q4	10387	742	760	742
q5	7724	3084	3051	3051
q6	205	127	125	125
q7	1064	628	604	604
q8	9335	2047	1985	1985
q9	7275	6629	6590	6590
q10	8448	3465	3594	3465
q11	435	239	216	216
q12	370	194	194	194
q13	17796	2846	2860	2846
q14	226	205	197	197
q15	515	475	460	460
q16	511	366	371	366
q17	954	535	573	535
q18	7133	6626	6447	6447
q19	1562	1437	1495	1437
q20	552	258	274	258
q21	3591	2895	2902	2895
q22	346	294	291	291
Total cold run time: 110258 ms
Total hot run time: 38179 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4103	4077	4074	4074
q2	320	224	227	224
q3	2932	2820	2817	2817
q4	1832	1556	1579	1556
q5	5327	5361	5316	5316
q6	195	116	116	116
q7	2194	1839	1857	1839
q8	3176	3277	3269	3269
q9	8725	8724	8700	8700
q10	3840	3731	3809	3731
q11	552	446	438	438
q12	740	541	537	537
q13	16893	2860	2840	2840
q14	289	258	257	257
q15	504	455	464	455
q16	488	415	421	415
q17	1709	1494	1477	1477
q18	7347	7176	7162	7162
q19	1593	1526	1562	1526
q20	1893	1716	1742	1716
q21	4806	4675	4551	4551
q22	533	465	451	451
Total cold run time: 69991 ms
Total hot run time: 53467 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 181601 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 11ffe2e88ffefcce8e05cb0a24ebf3d0e7003875, data reload: false

query1	953	368	358	358
query2	6528	2031	1923	1923
query3	6707	208	211	208
query4	31980	21420	21547	21420
query5	4290	397	402	397
query6	272	173	191	173
query7	4631	288	293	288
query8	229	182	177	177
query9	9170	2367	2334	2334
query10	569	250	259	250
query11	17190	14129	14140	14129
query12	146	94	92	92
query13	1628	416	431	416
query14	9879	7604	7571	7571
query15	250	201	196	196
query16	8143	257	253	253
query17	1972	548	523	523
query18	2076	272	275	272
query19	245	155	153	153
query20	93	88	85	85
query21	198	130	132	130
query22	4952	4791	4804	4791
query23	33595	32821	32641	32641
query24	11905	2890	2852	2852
query25	646	363	386	363
query26	1830	157	164	157
query27	3141	347	356	347
query28	7920	1901	1875	1875
query29	1048	645	624	624
query30	307	149	151	149
query31	992	755	743	743
query32	94	60	55	55
query33	780	257	259	257
query34	1110	491	505	491
query35	852	626	615	615
query36	1007	885	854	854
query37	283	68	78	68
query38	3545	3444	3425	3425
query39	1501	1464	1436	1436
query40	294	114	113	113
query41	50	47	47	47
query42	109	100	97	97
query43	507	472	429	429
query44	1229	760	737	737
query45	275	258	266	258
query46	1113	698	692	692
query47	1905	1849	1826	1826
query48	467	354	356	354
query49	1242	352	353	352
query50	758	377	381	377
query51	6750	6540	6666	6540
query52	113	94	93	93
query53	369	276	291	276
query54	335	250	248	248
query55	81	80	79	79
query56	260	233	231	231
query57	1206	1148	1156	1148
query58	250	212	213	212
query59	2837	2646	2588	2588
query60	277	259	262	259
query61	119	114	112	112
query62	681	440	458	440
query63	311	282	281	281
query64	6605	4155	4068	4068
query65	3136	3047	3045	3045
query66	1410	395	387	387
query67	15379	15049	14893	14893
query68	7956	516	532	516
query69	627	400	395	395
query70	1287	1171	1116	1116
query71	514	275	272	272
query72	6486	2692	2554	2554
query73	742	329	314	314
query74	7792	6452	6327	6327
query75	3571	2180	2252	2180
query76	4981	869	860	860
query77	644	255	257	255
query78	11001	10134	10165	10134
query79	11720	534	519	519
query80	1944	368	370	368
query81	522	217	217	217
query82	755	84	88	84
query83	216	142	150	142
query84	284	78	73	73
query85	1494	320	314	314
query86	475	287	306	287
query87	3724	3538	3509	3509
query88	5389	2295	2295	2295
query89	500	378	375	375
query90	1975	177	174	174
query91	177	134	138	134
query92	64	48	47	47
query93	7660	500	483	483
query94	1229	180	174	174
query95	436	321	327	321
query96	625	275	267	267
query97	2669	2492	2494	2492
query98	231	215	213	213
query99	1252	917	937	917
Total cold run time: 319667 ms
Total hot run time: 181601 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 11ffe2e88ffefcce8e05cb0a24ebf3d0e7003875 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.5 seconds inserted 10000000 Rows, about 740K ops/s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38219 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a668412b14c8a498f03c49200892d73ebebb2a20, data reload: false

------ Round 1 ----------------------------------
q1	17915	4350	4207	4207
q2	2424	164	157	157
q3	11204	1152	1237	1152
q4	10552	812	722	722
q5	7848	3040	3033	3033
q6	208	130	127	127
q7	1046	634	603	603
q8	9705	2039	2025	2025
q9	7212	6644	6631	6631
q10	8450	3465	3581	3465
q11	434	236	220	220
q12	367	199	195	195
q13	17799	2869	2909	2869
q14	229	225	203	203
q15	499	483	464	464
q16	496	369	376	369
q17	962	510	610	510
q18	7224	6461	6375	6375
q19	1546	1466	1405	1405
q20	561	263	281	263
q21	3692	2975	2923	2923
q22	349	301	304	301
Total cold run time: 110722 ms
Total hot run time: 38219 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4101	4074	4097	4074
q2	328	235	237	235
q3	3021	2824	2818	2818
q4	1855	1534	1569	1534
q5	5303	5366	5324	5324
q6	196	121	119	119
q7	2280	1902	1848	1848
q8	3206	3288	3306	3288
q9	8712	8720	8706	8706
q10	3774	3810	3788	3788
q11	550	452	430	430
q12	727	544	547	544
q13	16862	2842	2851	2842
q14	288	261	251	251
q15	503	459	465	459
q16	469	408	424	408
q17	1745	1479	1460	1460
q18	7353	7047	7125	7047
q19	1615	1528	1475	1475
q20	1918	1747	1720	1720
q21	4832	4766	4576	4576
q22	531	451	451	451
Total cold run time: 70169 ms
Total hot run time: 53397 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 182281 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a668412b14c8a498f03c49200892d73ebebb2a20, data reload: false

query1	925	359	343	343
query2	6544	2116	2018	2018
query3	6703	213	217	213
query4	31738	21325	21297	21297
query5	4305	409	392	392
query6	277	186	183	183
query7	4630	295	290	290
query8	233	168	169	168
query9	9193	2350	2356	2350
query10	575	257	267	257
query11	17245	14389	14313	14313
query12	140	94	91	91
query13	1629	421	463	421
query14	9994	7592	7976	7592
query15	252	183	201	183
query16	8232	257	261	257
query17	2025	539	543	539
query18	2094	286	276	276
query19	338	161	152	152
query20	91	90	90	90
query21	208	136	151	136
query22	5019	4841	4792	4792
query23	33257	32830	32767	32767
query24	11840	2834	2890	2834
query25	665	382	389	382
query26	1811	157	153	153
query27	3097	359	360	359
query28	7675	1894	1855	1855
query29	1050	640	627	627
query30	311	146	152	146
query31	979	725	746	725
query32	103	63	57	57
query33	790	266	253	253
query34	1111	486	496	486
query35	835	624	605	605
query36	988	925	900	900
query37	270	64	70	64
query38	3561	3472	3466	3466
query39	1476	1450	1427	1427
query40	287	117	115	115
query41	50	47	44	44
query42	118	102	95	95
query43	496	446	447	446
query44	1179	743	762	743
query45	276	258	270	258
query46	1110	725	715	715
query47	1927	1855	1848	1848
query48	426	371	364	364
query49	1243	347	344	344
query50	760	371	363	363
query51	6706	6693	6625	6625
query52	115	93	94	93
query53	354	278	280	278
query54	331	237	241	237
query55	92	80	80	80
query56	250	224	227	224
query57	1229	1142	1144	1142
query58	239	215	213	213
query59	2836	2648	2696	2648
query60	276	255	259	255
query61	116	118	124	118
query62	683	468	450	450
query63	306	279	282	279
query64	6884	4060	4016	4016
query65	3097	3076	3039	3039
query66	1453	396	373	373
query67	15794	14935	14848	14848
query68	9088	523	523	523
query69	696	399	378	378
query70	1408	1091	1147	1091
query71	527	270	273	270
query72	6636	2709	2578	2578
query73	1582	326	328	326
query74	6936	6513	6436	6436
query75	4170	2274	2227	2227
query76	5838	889	903	889
query77	650	264	276	264
query78	10881	10208	10128	10128
query79	8350	526	538	526
query80	1070	381	367	367
query81	493	213	217	213
query82	254	91	87	87
query83	227	149	143	143
query84	286	81	77	77
query85	1073	332	321	321
query86	354	316	297	297
query87	3771	3536	3524	3524
query88	4337	2307	2299	2299
query89	480	373	364	364
query90	2010	176	180	176
query91	179	140	140	140
query92	65	48	47	47
query93	4914	495	489	489
query94	1328	178	180	178
query95	430	340	329	329
query96	597	278	270	270
query97	2632	2491	2482	2482
query98	225	218	225	218
query99	1091	912	921	912
Total cold run time: 313420 ms
Total hot run time: 182281 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a668412b14c8a498f03c49200892d73ebebb2a20 with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.7 seconds inserted 10000000 Rows, about 729K ops/s

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37924 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d3b81431733de44810c113235a5fa91dd5b9a2ee, data reload: false

------ Round 1 ----------------------------------
q1	17639	4335	4116	4116
q2	2112	162	152	152
q3	11065	1244	1246	1244
q4	10485	807	765	765
q5	7770	2990	2976	2976
q6	207	127	130	127
q7	1042	594	582	582
q8	9392	2040	2012	2012
q9	7092	6515	6456	6456
q10	8886	3477	3572	3477
q11	436	231	217	217
q12	433	198	194	194
q13	17792	2858	2836	2836
q14	236	199	205	199
q15	515	479	471	471
q16	502	368	373	368
q17	950	540	547	540
q18	7169	6472	6490	6472
q19	1564	1407	1486	1407
q20	538	252	272	252
q21	3563	2880	2780	2780
q22	334	290	281	281
Total cold run time: 109722 ms
Total hot run time: 37924 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4087	4112	4092	4092
q2	327	227	224	224
q3	2919	2832	2902	2832
q4	1859	1632	1542	1542
q5	5235	5223	5176	5176
q6	192	113	115	113
q7	2224	1816	1807	1807
q8	3182	3310	3321	3310
q9	8407	8357	8413	8357
q10	3779	3770	3767	3767
q11	553	478	434	434
q12	728	558	519	519
q13	8238	2902	2877	2877
q14	302	249	275	249
q15	500	461	453	453
q16	486	420	418	418
q17	1721	1516	1463	1463
q18	7339	7094	7100	7094
q19	1612	1514	1564	1514
q20	1896	1742	1717	1717
q21	4860	4712	4688	4688
q22	530	442	426	426
Total cold run time: 60976 ms
Total hot run time: 53072 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 181765 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d3b81431733de44810c113235a5fa91dd5b9a2ee, data reload: false

query1	953	365	353	353
query2	6544	2040	1884	1884
query3	6706	218	213	213
query4	31631	21333	21263	21263
query5	4280	392	393	392
query6	269	179	183	179
query7	4632	291	293	291
query8	240	179	189	179
query9	9279	2334	2316	2316
query10	563	257	252	252
query11	15534	14216	14359	14216
query12	141	100	93	93
query13	1626	414	418	414
query14	9957	8040	7903	7903
query15	308	192	181	181
query16	8157	259	261	259
query17	2139	582	553	553
query18	1925	309	300	300
query19	352	155	154	154
query20	97	87	91	87
query21	206	129	126	126
query22	5036	4828	4857	4828
query23	33353	32683	33029	32683
query24	11798	2871	2879	2871
query25	658	385	389	385
query26	1789	154	155	154
query27	3030	353	352	352
query28	7669	1910	1872	1872
query29	1006	644	612	612
query30	309	153	149	149
query31	1004	729	752	729
query32	90	60	56	56
query33	757	257	249	249
query34	1112	478	483	478
query35	867	605	612	605
query36	1026	880	899	880
query37	272	65	67	65
query38	3595	3459	3391	3391
query39	1494	1469	1443	1443
query40	297	113	112	112
query41	55	48	49	48
query42	103	97	95	95
query43	489	457	425	425
query44	1209	727	725	725
query45	282	269	260	260
query46	1102	692	687	687
query47	1917	1831	1839	1831
query48	441	368	352	352
query49	1235	343	359	343
query50	763	369	373	369
query51	6845	6763	6861	6763
query52	115	93	90	90
query53	346	279	271	271
query54	322	246	241	241
query55	93	79	78	78
query56	249	234	223	223
query57	1249	1134	1140	1134
query58	249	211	206	206
query59	2844	2691	2728	2691
query60	268	240	254	240
query61	114	114	115	114
query62	634	425	423	423
query63	309	277	275	275
query64	6242	4077	4022	4022
query65	3069	3053	3037	3037
query66	1388	378	348	348
query67	15579	14924	14791	14791
query68	8979	518	531	518
query69	663	375	369	369
query70	1361	1163	1164	1163
query71	524	273	257	257
query72	6608	2545	2357	2357
query73	1637	313	314	313
query74	8270	6420	6336	6336
query75	3801	2240	2253	2240
query76	5714	908	909	908
query77	642	292	252	252
query78	11022	10319	10082	10082
query79	10632	514	523	514
query80	1752	380	369	369
query81	511	222	224	222
query82	235	87	83	83
query83	209	146	143	143
query84	289	73	84	73
query85	1122	317	313	313
query86	358	295	292	292
query87	3765	3553	3514	3514
query88	5082	2309	2301	2301
query89	483	360	370	360
query90	2060	180	178	178
query91	166	137	136	136
query92	63	49	47	47
query93	6154	493	486	486
query94	1321	176	180	176
query95	440	324	328	324
query96	626	270	275	270
query97	2642	2542	2517	2517
query98	229	223	208	208
query99	1133	840	848	840
Total cold run time: 316705 ms
Total hot run time: 181765 ms

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit d3b81431733de44810c113235a5fa91dd5b9a2ee with default session variables
Stream load json:         18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.8 seconds inserted 10000000 Rows, about 724K ops/s

@morrySnow
Copy link
Contributor Author

run buildall

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39042 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 212446a13e2fd811ce265e4b8963b645801bee1d, data reload: false

------ Round 1 ----------------------------------
q1	17755	4104	4113	4104
q2	2017	194	184	184
q3	10471	1253	1393	1253
q4	10365	872	993	872
q5	7806	2995	2977	2977
q6	228	137	136	136
q7	1139	674	634	634
q8	9842	2101	2090	2090
q9	6784	6339	6151	6151
q10	8479	3512	3502	3502
q11	422	242	234	234
q12	386	220	219	219
q13	17787	2911	2917	2911
q14	270	245	251	245
q15	536	494	475	475
q16	511	400	387	387
q17	959	927	911	911
q18	7240	6539	6520	6520
q19	1596	1537	1545	1537
q20	597	326	310	310
q21	3499	3104	3095	3095
q22	360	298	295	295
Total cold run time: 109049 ms
Total hot run time: 39042 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4091	4059	4102	4059
q2	323	214	219	214
q3	2978	2935	2959	2935
q4	1895	1844	1853	1844
q5	5246	5215	5195	5195
q6	207	125	123	123
q7	2249	1818	1821	1818
q8	3204	3268	3283	3268
q9	8476	8422	8496	8422
q10	3763	3841	3845	3841
q11	546	450	454	450
q12	716	557	559	557
q13	8362	2908	2873	2873
q14	307	259	264	259
q15	517	483	482	482
q16	473	414	411	411
q17	1701	1681	1684	1681
q18	7566	7306	7210	7210
q19	1638	1647	1640	1640
q20	1926	1724	1740	1724
q21	5038	4739	4703	4703
q22	482	420	420	420
Total cold run time: 61704 ms
Total hot run time: 54129 ms

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39162 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 520f2da0eb1d968acd4f7fb147c72ea9d7505f99, data reload: false

------ Round 1 ----------------------------------
q1	17704	4363	4236	4236
q2	2012	188	190	188
q3	10503	1192	1157	1157
q4	10200	760	797	760
q5	7524	2670	2612	2612
q6	220	131	128	128
q7	1008	626	614	614
q8	9196	2056	2044	2044
q9	8599	7164	7120	7120
q10	8536	3497	3515	3497
q11	464	242	239	239
q12	461	220	219	219
q13	18901	2937	2912	2912
q14	272	229	237	229
q15	521	478	471	471
q16	526	387	384	384
q17	954	752	717	717
q18	7263	6798	6807	6798
q19	2048	1533	1520	1520
q20	689	320	299	299
q21	3452	2716	2748	2716
q22	365	309	302	302
Total cold run time: 111418 ms
Total hot run time: 39162 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4362	4257	4240	4240
q2	366	261	271	261
q3	2995	2763	2820	2763
q4	1904	1621	1569	1569
q5	5365	5354	5255	5255
q6	209	126	121	121
q7	2243	1870	1836	1836
q8	3191	3336	3333	3333
q9	9257	9317	9358	9317
q10	4064	3922	3901	3901
q11	592	488	491	488
q12	753	654	601	601
q13	17132	3117	3150	3117
q14	320	277	289	277
q15	509	468	472	468
q16	483	461	484	461
q17	1855	1519	1505	1505
q18	8034	8069	7725	7725
q19	2024	1644	1583	1583
q20	2057	1854	1842	1842
q21	5246	4756	5089	4756
q22	575	505	486	486
Total cold run time: 73536 ms
Total hot run time: 55905 ms

@morrySnow
Copy link
Contributor Author

run buildall

@morrySnow
Copy link
Contributor Author

run buildall

@morrySnow
Copy link
Contributor Author

run buildall

@morrySnow morrySnow force-pushed the turn_off_fallback branch 2 times, most recently from 8753269 to efe4848 Compare April 17, 2024 07:09
@morrySnow
Copy link
Contributor Author

run buildall

@morrySnow morrySnow marked this pull request as ready for review April 17, 2024 07:11
@morrySnow morrySnow changed the title [chore](Nereids) turn off fallback [chore](Nereids) disable fallback_to_original_planner by default Apr 17, 2024
@morrySnow morrySnow added not-merge/2.0 do not merge into 2.0 branch not-merge/2.1 labels Apr 17, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 38831 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7737b83741534046d4ec750e04fa25b205d3e4ff, data reload: false

------ Round 1 ----------------------------------
q1	17639	4437	4280	4280
q2	2024	192	184	184
q3	10479	1222	1235	1222
q4	10645	782	800	782
q5	7673	2763	2697	2697
q6	222	133	135	133
q7	1047	614	612	612
q8	9393	2093	2068	2068
q9	7572	6796	6714	6714
q10	8683	3480	3538	3480
q11	450	228	222	222
q12	549	221	213	213
q13	18545	2939	2982	2939
q14	266	224	227	224
q15	526	485	473	473
q16	529	403	388	388
q17	968	734	675	675
q18	7599	6736	6816	6736
q19	1812	1492	1513	1492
q20	660	322	305	305
q21	3710	2678	2899	2678
q22	352	314	315	314
Total cold run time: 111343 ms
Total hot run time: 38831 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4329	4204	4212	4204
q2	380	269	261	261
q3	2984	2714	2726	2714
q4	1859	1587	1596	1587
q5	5369	5375	5349	5349
q6	209	122	127	122
q7	2239	1878	1880	1878
q8	3218	3319	3325	3319
q9	8593	8595	8574	8574
q10	3886	3698	3724	3698
q11	595	472	492	472
q12	764	581	590	581
q13	16322	2923	2941	2923
q14	299	286	266	266
q15	515	474	463	463
q16	473	411	434	411
q17	1759	1462	1441	1441
q18	7629	7530	7420	7420
q19	1633	1562	1543	1543
q20	1932	1739	1766	1739
q21	4848	4699	4778	4699
q22	538	476	457	457
Total cold run time: 70373 ms
Total hot run time: 54121 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184770 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7737b83741534046d4ec750e04fa25b205d3e4ff, data reload: false

query1	903	365	359	359
query2	7640	2641	2406	2406
query3	6648	207	208	207
query4	24188	21309	21375	21309
query5	4167	413	414	413
query6	278	175	197	175
query7	4591	292	283	283
query8	228	179	177	177
query9	8636	2340	2342	2340
query10	602	256	248	248
query11	14880	14200	14154	14154
query12	148	90	87	87
query13	1649	364	356	356
query14	10534	8079	7959	7959
query15	279	187	180	180
query16	8240	266	270	266
query17	1972	598	567	567
query18	2107	292	295	292
query19	336	156	159	156
query20	97	85	87	85
query21	199	127	124	124
query22	4980	4772	4819	4772
query23	33803	33422	33183	33183
query24	11678	2951	2960	2951
query25	645	360	368	360
query26	1743	154	149	149
query27	2894	311	308	308
query28	7680	1995	1984	1984
query29	1009	626	596	596
query30	278	173	178	173
query31	958	734	717	717
query32	85	51	55	51
query33	739	251	247	247
query34	1026	477	479	477
query35	825	707	694	694
query36	1059	914	902	902
query37	190	69	72	69
query38	3384	3173	3225	3173
query39	1583	1518	1527	1518
query40	270	123	127	123
query41	46	43	44	43
query42	102	93	99	93
query43	562	553	553	553
query44	1223	717	741	717
query45	275	258	253	253
query46	1068	728	755	728
query47	1917	1864	1848	1848
query48	355	308	284	284
query49	1130	377	360	360
query50	760	377	385	377
query51	6727	6513	6556	6513
query52	103	87	92	87
query53	345	273	278	273
query54	305	237	232	232
query55	81	73	77	73
query56	243	227	228	227
query57	1203	1139	1182	1139
query58	222	199	198	198
query59	3423	3111	3236	3111
query60	259	230	235	230
query61	91	90	91	90
query62	646	429	448	429
query63	305	281	277	277
query64	6234	3894	3745	3745
query65	3229	3034	3042	3034
query66	1389	343	322	322
query67	15400	15137	14876	14876
query68	6372	545	534	534
query69	519	317	308	308
query70	1229	1189	1149	1149
query71	1445	1267	1264	1264
query72	6493	2630	2423	2423
query73	736	315	317	315
query74	6886	6458	6377	6377
query75	3841	2628	2653	2628
query76	4255	952	1042	952
query77	624	268	267	267
query78	11064	10181	10434	10181
query79	7137	512	524	512
query80	1799	429	422	422
query81	532	254	248	248
query82	1496	96	95	95
query83	336	172	167	167
query84	259	85	82	82
query85	1562	267	264	264
query86	499	302	313	302
query87	3465	3313	3319	3313
query88	4893	2318	2318	2318
query89	483	368	373	368
query90	1996	187	183	183
query91	129	95	102	95
query92	58	50	47	47
query93	5424	519	503	503
query94	1215	177	176	176
query95	393	352	297	297
query96	610	262	264	262
query97	3202	2930	2960	2930
query98	240	224	213	213
query99	1256	880	873	873
Total cold run time: 301242 ms
Total hot run time: 184770 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.27 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7737b83741534046d4ec750e04fa25b205d3e4ff, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.23	0.04	0.04
query4	1.68	0.07	0.07
query5	0.51	0.50	0.52
query6	1.47	0.71	0.73
query7	0.02	0.01	0.01
query8	0.04	0.04	0.04
query9	0.56	0.50	0.49
query10	0.55	0.56	0.55
query11	0.16	0.11	0.12
query12	0.15	0.13	0.13
query13	0.61	0.60	0.57
query14	0.75	0.79	0.77
query15	0.81	0.78	0.79
query16	0.37	0.34	0.37
query17	0.93	0.93	0.93
query18	0.23	0.22	0.25
query19	1.75	1.70	1.66
query20	0.02	0.01	0.01
query21	15.43	0.64	0.64
query22	4.31	7.31	2.14
query23	18.26	1.35	1.20
query24	1.68	0.33	0.21
query25	0.14	0.10	0.07
query26	0.25	0.16	0.16
query27	0.08	0.08	0.08
query28	13.33	1.00	0.96
query29	12.61	3.24	3.20
query30	0.26	0.07	0.06
query31	2.85	0.37	0.39
query32	3.30	0.46	0.46
query33	2.84	2.78	2.82
query34	17.23	4.39	4.39
query35	4.48	4.50	4.52
query36	0.65	0.46	0.46
query37	0.18	0.16	0.15
query38	0.16	0.15	0.14
query39	0.04	0.04	0.03
query40	0.16	0.14	0.14
query41	0.10	0.04	0.04
query42	0.05	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 109.39 s
Total hot run time: 30.27 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 7737b83741534046d4ec750e04fa25b205d3e4ff with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       13.5 seconds inserted 10000000 Rows, about 740K ops/s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 17, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@morrySnow morrySnow merged commit de6334e into apache:master Apr 17, 2024
27 of 30 checks passed
@morrySnow morrySnow deleted the turn_off_fallback branch April 17, 2024 10:29
@zhangbutao zhangbutao mentioned this pull request May 8, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@924060929 924060929 924060929 approved these changes

@starocean999 starocean999 starocean999 approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. not-merge/2.0 do not merge into 2.0 branch not-merge/2.1 reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@morrySnow @doris-robot @924060929 @starocean999