Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[cherry-pick](fold) fix fold constant rule can't handle variable expr #32402

Merged
merged 1 commit into from
Mar 18, 2024

Conversation

zhangstar333
Copy link
Contributor

Proposed changes

cherry-pick from master #32313

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@zhangstar333
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49846 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f4f75fb3d587f3289240111e4f2c3858d553e8a8, data reload: false

------ Round 1 ----------------------------------
q1	17598	4378	4368	4368
q2	2054	151	139	139
q3	10536	1832	1870	1832
q4	10339	1223	1325	1223
q5	8562	3918	3972	3918
q6	229	121	120	120
q7	2054	1610	1602	1602
q8	9274	2673	2691	2673
q9	11150	10584	10634	10584
q10	8615	3484	3499	3484
q11	433	235	238	235
q12	455	299	300	299
q13	18350	3942	4049	3942
q14	356	318	322	318
q15	508	456	454	454
q16	702	589	589	589
q17	1097	932	918	918
q18	7187	6882	6816	6816
q19	1687	1547	1558	1547
q20	536	299	310	299
q21	4458	4098	4101	4098
q22	496	388	398	388
Total cold run time: 116676 ms
Total hot run time: 49846 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4349	4297	4271	4271
q2	313	224	228	224
q3	4146	4136	4116	4116
q4	2725	2737	2735	2735
q5	7289	7173	7211	7173
q6	234	120	118	118
q7	3251	2864	2807	2807
q8	4346	4451	4476	4451
q9	17543	17338	17386	17338
q10	4216	4244	4229	4229
q11	751	659	671	659
q12	1014	857	829	829
q13	6876	3782	3711	3711
q14	446	421	438	421
q15	494	453	451	451
q16	759	724	697	697
q17	3810	3848	3827	3827
q18	8709	8663	8757	8663
q19	1699	1676	1643	1643
q20	2370	2147	2088	2088
q21	8574	8469	8522	8469
q22	1030	1003	960	960
Total cold run time: 84944 ms
Total hot run time: 79880 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 202051 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f4f75fb3d587f3289240111e4f2c3858d553e8a8, data reload: false

query1	907	389	373	373
query2	6543	2232	2147	2147
query3	6912	199	195	195
query4	20085	18100	17957	17957
query5	19710	6468	6443	6443
query6	276	219	237	219
query7	4159	306	302	302
query8	241	263	243	243
query9	3142	2694	2621	2621
query10	416	300	293	293
query11	11377	10750	10738	10738
query12	117	82	70	70
query13	5577	654	644	644
query14	17560	13178	13575	13178
query15	362	241	231	231
query16	6452	267	260	260
query17	1760	1465	865	865
query18	2320	416	406	406
query19	208	148	148	148
query20	76	78	73	73
query21	185	94	91	91
query22	5352	4997	5122	4997
query23	32576	32048	31899	31899
query24	6974	6460	6546	6460
query25	494	412	399	399
query26	528	159	160	159
query27	1893	295	293	293
query28	6114	2196	2166	2166
query29	2800	2765	2709	2709
query30	246	165	160	160
query31	909	750	748	748
query32	66	61	50	50
query33	383	265	251	251
query34	847	462	468	462
query35	1129	947	902	902
query36	1415	1707	1566	1566
query37	91	59	59	59
query38	3157	2962	2936	2936
query39	1369	1312	1295	1295
query40	196	96	98	96
query41	36	33	32	32
query42	86	87	76	76
query43	637	609	539	539
query44	1130	713	741	713
query45	242	229	227	227
query46	1242	980	989	980
query47	1898	1660	1748	1660
query48	968	692	692	692
query49	601	363	361	361
query50	863	593	581	581
query51	4745	4573	4663	4573
query52	86	86	86	86
query53	442	322	338	322
query54	2640	2476	2462	2462
query55	92	70	80	70
query56	220	192	204	192
query57	1150	1170	1123	1123
query58	202	194	207	194
query59	3443	3400	3247	3247
query60	206	201	206	201
query61	84	82	82	82
query62	854	455	525	455
query63	468	332	331	331
query64	2495	1464	1378	1378
query65	3647	3609	3629	3609
query66	737	401	378	378
query67	18504	15847	16321	15847
query68	7951	648	663	648
query69	564	346	349	346
query70	1870	1854	1557	1557
query71	391	316	306	306
query72	6430	3437	3417	3417
query73	721	317	309	309
query74	6375	5835	5806	5806
query75	4704	3691	3621	3621
query76	4524	1128	1156	1128
query77	533	242	246	242
query78	12871	11812	11600	11600
query79	6842	642	621	621
query80	2270	390	392	390
query81	524	238	230	230
query82	1219	96	99	96
query83	150	132	132	132
query84	219	70	67	67
query85	1377	284	280	280
query86	415	422	386	386
query87	3164	3037	2991	2991
query88	4954	2284	2260	2260
query89	354	277	306	277
query90	1689	210	217	210
query91	147	114	123	114
query92	65	53	50	50
query93	2454	550	553	550
query94	874	205	207	205
query95	1121	1083	1052	1052
query96	635	321	319	319
query97	6432	6328	6368	6328
query98	184	176	177	176
query99	2796	822	950	822
Total cold run time: 307461 ms
Total hot run time: 202051 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.55 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f4f75fb3d587f3289240111e4f2c3858d553e8a8, data reload: false

query1	0.02	0.02	0.02
query2	0.06	0.02	0.02
query3	0.24	0.04	0.05
query4	1.82	0.06	0.06
query5	0.53	0.52	0.52
query6	1.25	0.61	0.65
query7	0.02	0.00	0.00
query8	0.03	0.03	0.03
query9	0.54	0.48	0.48
query10	0.53	0.53	0.55
query11	0.11	0.09	0.08
query12	0.11	0.09	0.10
query13	0.61	0.61	0.62
query14	0.78	0.79	0.80
query15	0.76	0.76	0.76
query16	0.37	0.40	0.36
query17	1.00	0.97	1.02
query18	0.20	0.28	0.23
query19	1.91	1.88	1.80
query20	0.01	0.01	0.01
query21	15.47	0.56	0.57
query22	1.95	2.16	1.69
query23	17.39	1.00	0.91
query24	5.22	0.93	1.26
query25	0.44	0.05	0.04
query26	0.66	0.17	0.14
query27	0.04	0.04	0.04
query28	7.86	0.72	0.71
query29	12.72	2.22	2.28
query30	0.56	0.53	0.50
query31	2.81	0.39	0.37
query32	3.43	0.49	0.51
query33	3.06	3.06	3.04
query34	15.29	4.81	4.80
query35	4.90	4.85	4.84
query36	1.06	1.03	1.02
query37	0.05	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.14
query41	0.06	0.02	0.01
query42	0.02	0.01	0.01
query43	0.02	0.02	0.01
Total cold run time: 104.12 s
Total hot run time: 30.55 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit f4f75fb3d587f3289240111e4f2c3858d553e8a8 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       20.5 seconds inserted 10000000 Rows, about 487K ops/s

@xiaokang xiaokang merged commit 42210ab into apache:branch-2.0 Mar 18, 2024
25 of 26 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants