[fix](nereids)move ReplaceVariableByLiteral rule to analyze phase

[starocean999]

Proposed changes

pick from master #33997

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

[doris-robot]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

[starocean999]

run buildall

[doris-robot]

TPC-H: Total hot run time: 49744 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3b3b5dd9690036c4c4b462efe4757283a5a60eec, data reload: false

------ Round 1 ----------------------------------
q1	17956	4360	4289	4289
q2	2028	146	138	138
q3	10465	1883	1935	1883
q4	10337	1231	1307	1231
q5	8889	3990	3938	3938
q6	236	121	121	121
q7	2053	1609	1548	1548
q8	9262	2692	2688	2688
q9	11090	10624	10551	10551
q10	8610	3499	3474	3474
q11	417	232	250	232
q12	466	300	303	300
q13	18338	3925	4078	3925
q14	347	326	319	319
q15	498	460	457	457
q16	692	598	593	593
q17	1141	971	981	971
q18	7308	6846	6927	6846
q19	1696	1569	1531	1531
q20	517	326	301	301
q21	4401	4022	4016	4016
q22	511	408	392	392
Total cold run time: 117258 ms
Total hot run time: 49744 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4292	4282	4286	4282
q2	318	229	228	228
q3	4135	4122	4101	4101
q4	2739	2727	2739	2727
q5	7413	7191	7216	7191
q6	233	118	116	116
q7	3249	2830	2897	2830
q8	4316	4422	4460	4422
q9	17575	17415	17383	17383
q10	4272	4244	4246	4244
q11	754	708	673	673
q12	1021	835	842	835
q13	7213	3729	3747	3729
q14	447	432	421	421
q15	498	454	446	446
q16	751	714	691	691
q17	3813	3812	3884	3812
q18	8778	8675	8716	8675
q19	1733	1707	1652	1652
q20	2401	2124	2102	2102
q21	8631	8488	8440	8440
q22	1050	915	936	915
Total cold run time: 85632 ms
Total hot run time: 79915 ms

[doris-robot]

TPC-DS: Total hot run time: 203364 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3b3b5dd9690036c4c4b462efe4757283a5a60eec, data reload: false

query1	924	384	380	380
query2	6522	2796	2860	2796
query3	6919	199	198	198
query4	20301	18127	18162	18127
query5	19720	6505	6548	6505
query6	278	213	234	213
query7	4168	293	306	293
query8	264	226	227	226
query9	3157	2743	2630	2630
query10	407	281	305	281
query11	11392	10681	10700	10681
query12	125	74	73	73
query13	5583	687	664	664
query14	17766	13680	13737	13680
query15	394	243	238	238
query16	6827	281	252	252
query17	1744	1467	877	877
query18	2336	401	397	397
query19	213	146	142	142
query20	69	75	73	73
query21	183	96	95	95
query22	5258	5107	5061	5061
query23	32578	31815	32093	31815
query24	6977	6524	6521	6521
query25	515	421	403	403
query26	527	161	159	159
query27	1781	295	296	295
query28	6175	2389	2345	2345
query29	2822	2715	2751	2715
query30	240	163	159	159
query31	897	733	695	695
query32	68	61	55	55
query33	414	244	258	244
query34	861	460	501	460
query35	1103	933	950	933
query36	1342	1318	1152	1152
query37	92	64	62	62
query38	3091	2952	2916	2916
query39	1373	1325	1319	1319
query40	206	95	99	95
query41	37	34	38	34
query42	87	84	83	83
query43	840	666	696	666
query44	1161	731	735	731
query45	240	225	224	224
query46	1254	998	969	969
query47	1814	1764	1704	1704
query48	1003	697	705	697
query49	614	355	378	355
query50	870	629	591	591
query51	4852	4676	4699	4676
query52	89	80	88	80
query53	436	319	320	319
query54	2641	2468	2470	2468
query55	90	77	82	77
query56	204	196	198	196
query57	1200	1048	1089	1048
query58	216	212	189	189
query59	4210	4096	4253	4096
query60	206	178	190	178
query61	92	87	88	87
query62	833	451	456	451
query63	472	343	338	338
query64	2314	1496	1369	1369
query65	3671	3551	3557	3551
query66	780	370	383	370
query67	15844	15119	15692	15119
query68	9989	661	689	661
query69	562	346	317	317
query70	1670	1524	1457	1457
query71	427	288	307	288
query72	6528	3458	3431	3431
query73	750	314	322	314
query74	6353	5886	5855	5855
query75	5334	3691	3683	3683
query76	6355	1122	1184	1122
query77	1072	253	247	247
query78	12857	11659	11489	11489
query79	8084	639	652	639
query80	1437	389	391	389
query81	485	231	237	231
query82	1641	98	99	98
query83	177	131	129	129
query84	262	69	70	69
query85	845	303	302	302
query86	335	290	284	284
query87	3209	3010	3040	3010
query88	4746	2344	2374	2344
query89	397	301	281	281
query90	1947	210	213	210
query91	167	134	131	131
query92	58	52	51	51
query93	6543	579	604	579
query94	706	206	209	206
query95	1091	1069	1055	1055
query96	668	329	322	322
query97	6532	6282	6389	6282
query98	192	169	183	169
query99	3024	828	876	828
Total cold run time: 316125 ms
Total hot run time: 203364 ms

[doris-robot]

ClickBench: Total hot run time: 30.93 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3b3b5dd9690036c4c4b462efe4757283a5a60eec, data reload: false

query1	0.02	0.03	0.02
query2	0.07	0.02	0.02
query3	0.25	0.05	0.04
query4	1.80	0.07	0.07
query5	0.53	0.53	0.51
query6	1.23	0.63	0.63
query7	0.01	0.01	0.01
query8	0.04	0.02	0.02
query9	0.53	0.49	0.49
query10	0.53	0.52	0.53
query11	0.12	0.09	0.09
query12	0.12	0.10	0.10
query13	0.62	0.62	0.62
query14	0.78	0.79	0.78
query15	0.78	0.75	0.76
query16	0.36	0.39	0.36
query17	0.99	1.03	1.02
query18	0.25	0.23	0.27
query19	1.94	1.84	1.80
query20	0.01	0.01	0.01
query21	15.46	0.56	0.54
query22	2.17	2.60	1.74
query23	17.31	1.11	1.04
query24	7.52	0.83	1.16
query25	0.37	0.12	0.05
query26	0.75	0.16	0.16
query27	0.05	0.04	0.03
query28	5.68	0.79	0.74
query29	12.59	2.32	2.35
query30	0.62	0.52	0.52
query31	2.81	0.38	0.37
query32	3.40	0.50	0.49
query33	3.11	3.08	3.07
query34	15.25	4.82	4.83
query35	4.87	4.86	4.87
query36	1.05	1.02	1.01
query37	0.06	0.04	0.05
query38	0.03	0.02	0.02
query39	0.01	0.01	0.01
query40	0.16	0.14	0.14
query41	0.06	0.01	0.01
query42	0.02	0.02	0.02
query43	0.02	0.01	0.02
Total cold run time: 104.35 s
Total hot run time: 30.93 s

[doris-robot]

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 3b3b5dd9690036c4c4b462efe4757283a5a60eec with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.6 seconds inserted 10000000 Rows, about 462K ops/s

[starocean999]

run buildall

[doris-robot]

TPC-H: Total hot run time: 50082 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 70fa30da0ff8fdd995bffc18485f0e93dbd8e09a, data reload: false

------ Round 1 ----------------------------------
q1	17536	4458	4297	4297
q2	2036	155	140	140
q3	10267	1931	1925	1925
q4	10092	1238	1330	1238
q5	8480	4380	3979	3979
q6	231	124	121	121
q7	2047	1579	1576	1576
q8	9277	2717	2726	2717
q9	10674	11205	10660	10660
q10	8661	3554	3574	3554
q11	428	238	236	236
q12	469	304	304	304
q13	18339	3942	4016	3942
q14	348	324	326	324
q15	509	460	455	455
q16	696	586	588	586
q17	1143	988	966	966
q18	7320	6770	6799	6770
q19	1716	1561	1530	1530
q20	506	315	305	305
q21	4461	4054	4170	4054
q22	504	412	403	403
Total cold run time: 115740 ms
Total hot run time: 50082 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4337	4314	4322	4314
q2	320	228	225	225
q3	4159	4120	4126	4120
q4	2755	2754	2747	2747
q5	7242	7177	7207	7177
q6	236	119	118	118
q7	3207	2812	2858	2812
q8	4360	4461	4499	4461
q9	17104	17117	16937	16937
q10	4240	4254	4237	4237
q11	771	700	695	695
q12	1024	862	829	829
q13	4437	3775	3710	3710
q14	455	423	429	423
q15	492	456	460	456
q16	760	700	707	700
q17	3886	3877	3918	3877
q18	8780	8745	8701	8701
q19	1724	1702	1644	1644
q20	2402	2119	2127	2119
q21	8541	8475	8446	8446
q22	1066	967	974	967
Total cold run time: 82298 ms
Total hot run time: 79715 ms

[doris-robot]

TPC-DS: Total hot run time: 202741 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 70fa30da0ff8fdd995bffc18485f0e93dbd8e09a, data reload: false

query1	913	391	383	383
query2	6527	2870	2638	2638
query3	6921	200	195	195
query4	20293	18011	17930	17930
query5	19729	6525	6474	6474
query6	278	218	237	218
query7	4148	302	309	302
query8	290	249	247	247
query9	3141	2713	2627	2627
query10	405	281	299	281
query11	11300	10713	10635	10635
query12	115	75	71	71
query13	5582	689	657	657
query14	17543	13711	13562	13562
query15	362	231	246	231
query16	6466	275	255	255
query17	1707	1453	869	869
query18	2355	415	408	408
query19	199	143	143	143
query20	77	81	75	75
query21	190	92	89	89
query22	5266	5134	4783	4783
query23	32449	32058	31779	31779
query24	6940	6487	6475	6475
query25	535	446	408	408
query26	613	164	155	155
query27	2012	290	292	290
query28	6170	2375	2332	2332
query29	2952	2821	2923	2821
query30	238	163	161	161
query31	897	710	723	710
query32	66	66	60	60
query33	400	242	239	239
query34	850	451	476	451
query35	1108	905	885	885
query36	1322	1262	1142	1142
query37	95	60	64	60
query38	3059	2986	2954	2954
query39	1354	1327	1327	1327
query40	199	98	95	95
query41	39	35	33	33
query42	86	81	90	81
query43	665	636	708	636
query44	1169	731	750	731
query45	241	221	224	221
query46	1245	980	971	971
query47	1917	1654	1733	1654
query48	1005	717	699	699
query49	617	367	370	367
query50	856	616	614	614
query51	4731	4620	4669	4620
query52	95	69	83	69
query53	448	324	321	321
query54	2677	2504	2462	2462
query55	86	81	86	81
query56	223	196	207	196
query57	1312	1315	1082	1082
query58	190	197	199	197
query59	3918	3862	4136	3862
query60	205	192	216	192
query61	83	82	81	81
query62	839	496	490	490
query63	462	335	336	335
query64	2436	1378	1412	1378
query65	3662	3565	3551	3551
query66	820	368	358	358
query67	15599	15365	15963	15365
query68	10133	673	688	673
query69	573	341	354	341
query70	1990	1555	1323	1323
query71	408	301	295	295
query72	6388	3463	3407	3407
query73	738	326	323	323
query74	6421	5880	5786	5786
query75	5267	3707	3627	3627
query76	6673	1197	1238	1197
query77	1145	250	245	245
query78	12702	11714	11621	11621
query79	9028	667	653	653
query80	1227	394	393	393
query81	481	227	236	227
query82	1631	100	100	100
query83	173	135	133	133
query84	263	67	66	66
query85	848	294	288	288
query86	342	319	292	292
query87	3195	3023	3042	3023
query88	4721	2330	2365	2330
query89	485	303	303	303
query90	1945	205	214	205
query91	182	132	145	132
query92	56	51	49	49
query93	6939	570	571	570
query94	691	202	207	202
query95	1087	1063	1060	1060
query96	644	333	322	322
query97	6492	6419	6405	6405
query98	195	175	173	173
query99	2966	961	913	913
Total cold run time: 316721 ms
Total hot run time: 202741 ms

[doris-robot]

ClickBench: Total hot run time: 30.68 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 70fa30da0ff8fdd995bffc18485f0e93dbd8e09a, data reload: false

query1	0.02	0.02	0.03
query2	0.07	0.02	0.02
query3	0.25	0.04	0.05
query4	1.79	0.07	0.06
query5	0.54	0.52	0.52
query6	1.24	0.62	0.62
query7	0.02	0.01	0.01
query8	0.03	0.03	0.03
query9	0.52	0.48	0.47
query10	0.53	0.52	0.54
query11	0.13	0.09	0.08
query12	0.12	0.10	0.10
query13	0.61	0.61	0.61
query14	0.80	0.77	0.78
query15	0.79	0.76	0.76
query16	0.36	0.37	0.36
query17	1.00	1.01	1.03
query18	0.23	0.26	0.24
query19	1.94	1.82	1.83
query20	0.01	0.01	0.01
query21	15.46	0.56	0.56
query22	2.08	2.18	1.49
query23	16.87	1.09	0.96
query24	4.88	1.01	1.46
query25	0.40	0.14	0.05
query26	0.51	0.18	0.16
query27	0.04	0.04	0.04
query28	7.79	0.73	0.73
query29	12.63	2.32	2.25
query30	0.61	0.52	0.52
query31	2.80	0.38	0.37
query32	3.45	0.51	0.51
query33	3.03	3.07	3.07
query34	15.25	4.80	4.78
query35	4.86	4.85	4.85
query36	1.05	1.01	1.01
query37	0.06	0.04	0.05
query38	0.03	0.03	0.03
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.01
query43	0.02	0.01	0.02
Total cold run time: 103.09 s
Total hot run time: 30.68 s

[doris-robot]

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 70fa30da0ff8fdd995bffc18485f0e93dbd8e09a with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s

[starocean999]

run buildall

[doris-robot]

TPC-H: Total hot run time: 50402 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 22aca3ca48a88f3e2023531f3795040b599685f3, data reload: false

------ Round 1 ----------------------------------
q1	18749	4435	4330	4330
q2	2017	152	144	144
q3	10444	1870	1946	1870
q4	10372	1252	1340	1252
q5	10383	4063	4104	4063
q6	232	125	126	125
q7	2086	1642	1701	1642
q8	9652	2721	2721	2721
q9	14208	10897	10751	10751
q10	8827	3466	3470	3466
q11	416	245	249	245
q12	471	297	309	297
q13	18380	3982	4046	3982
q14	353	323	327	323
q15	512	454	449	449
q16	712	601	589	589
q17	1122	928	931	928
q18	7283	6933	6950	6933
q19	1702	1598	1497	1497
q20	513	305	310	305
q21	4419	4095	4083	4083
q22	498	407	411	407
Total cold run time: 123351 ms
Total hot run time: 50402 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4295	4350	4314	4314
q2	320	221	221	221
q3	4154	4116	4137	4116
q4	2739	2737	2727	2727
q5	7277	7244	7215	7215
q6	235	119	119	119
q7	3222	2872	2872	2872
q8	4350	4438	4475	4438
q9	17623	17201	17276	17201
q10	4246	4242	4290	4242
q11	744	700	700	700
q12	1020	849	853	849
q13	6991	3731	3755	3731
q14	455	421	421	421
q15	507	472	451	451
q16	762	704	720	704
q17	3778	3828	3801	3801
q18	8674	8694	8795	8694
q19	1704	1651	1644	1644
q20	2396	2147	2115	2115
q21	8544	8493	8367	8367
q22	1020	928	943	928
Total cold run time: 85056 ms
Total hot run time: 79870 ms

[doris-robot]

TPC-DS: Total hot run time: 203528 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 22aca3ca48a88f3e2023531f3795040b599685f3, data reload: false

query1	907	387	382	382
query2	6556	2870	2646	2646
query3	6914	199	198	198
query4	20114	18002	17934	17934
query5	19720	6504	6515	6504
query6	273	210	231	210
query7	4153	307	308	307
query8	256	260	244	244
query9	3112	2721	2656	2656
query10	428	291	302	291
query11	11360	10678	10737	10678
query12	115	77	73	73
query13	5588	681	699	681
query14	17609	13404	13830	13404
query15	390	229	233	229
query16	6448	271	258	258
query17	1583	1458	855	855
query18	2282	409	408	408
query19	205	142	148	142
query20	76	77	77	77
query21	182	96	94	94
query22	5358	5167	5060	5060
query23	32511	31947	32039	31947
query24	7040	6633	6523	6523
query25	526	428	408	408
query26	522	167	159	159
query27	1822	301	299	299
query28	6188	2372	2357	2357
query29	2801	2697	2800	2697
query30	239	162	162	162
query31	902	745	718	718
query32	69	62	55	55
query33	402	241	257	241
query34	854	472	480	472
query35	1101	944	909	909
query36	1275	1172	1244	1172
query37	87	62	60	60
query38	3084	2972	2982	2972
query39	1357	1313	1319	1313
query40	200	97	96	96
query41	41	36	33	33
query42	89	87	76	76
query43	862	661	719	661
query44	1161	735	727	727
query45	237	231	228	228
query46	1241	965	961	961
query47	1768	1822	1836	1822
query48	1006	725	686	686
query49	604	368	367	367
query50	862	626	623	623
query51	4725	4712	4721	4712
query52	87	74	87	74
query53	439	320	313	313
query54	2654	2434	2438	2434
query55	90	80	83	80
query56	219	208	193	193
query57	1353	1144	1089	1089
query58	211	206	188	188
query59	4336	3876	4171	3876
query60	207	206	206	206
query61	89	82	84	82
query62	849	458	476	458
query63	470	347	338	338
query64	2471	1392	1401	1392
query65	3633	3552	3534	3534
query66	753	374	378	374
query67	17848	15613	15550	15550
query68	8656	660	639	639
query69	575	330	344	330
query70	1608	1350	1477	1350
query71	404	292	323	292
query72	6665	3487	3389	3389
query73	723	323	320	320
query74	6255	5824	5831	5824
query75	5334	3742	3621	3621
query76	5177	1111	1107	1107
query77	902	250	247	247
query78	12720	12500	11891	11891
query79	10077	652	649	649
query80	815	401	389	389
query81	485	232	225	225
query82	567	100	92	92
query83	165	131	131	131
query84	253	69	67	67
query85	754	299	298	298
query86	328	294	317	294
query87	3229	3012	3009	3009
query88	5041	2322	2335	2322
query89	437	327	273	273
query90	1937	210	212	210
query91	161	130	133	130
query92	56	50	53	50
query93	4977	580	600	580
query94	695	204	204	204
query95	1115	1055	1061	1055
query96	652	333	332	332
query97	6565	6412	6205	6205
query98	188	173	169	169
query99	2803	922	866	866
Total cold run time: 313233 ms
Total hot run time: 203528 ms

[doris-robot]

ClickBench: Total hot run time: 30.8 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 22aca3ca48a88f3e2023531f3795040b599685f3, data reload: false

query1	0.02	0.03	0.03
query2	0.07	0.02	0.02
query3	0.24	0.05	0.04
query4	1.79	0.06	0.06
query5	0.53	0.52	0.52
query6	1.23	0.62	0.61
query7	0.01	0.01	0.01
query8	0.03	0.03	0.02
query9	0.52	0.48	0.48
query10	0.54	0.54	0.54
query11	0.13	0.08	0.09
query12	0.11	0.09	0.09
query13	0.62	0.61	0.61
query14	0.79	0.78	0.78
query15	0.79	0.75	0.75
query16	0.36	0.37	0.38
query17	0.99	1.01	1.01
query18	0.24	0.25	0.24
query19	1.87	1.84	1.82
query20	0.02	0.00	0.01
query21	15.48	0.54	0.55
query22	2.08	2.06	1.48
query23	17.55	1.17	1.00
query24	5.09	1.09	1.21
query25	0.38	0.12	0.03
query26	0.55	0.15	0.14
query27	0.04	0.04	0.03
query28	7.75	0.78	0.70
query29	12.59	2.39	2.38
query30	0.56	0.52	0.52
query31	2.80	0.39	0.36
query32	3.38	0.50	0.50
query33	3.09	3.09	3.08
query34	15.28	4.83	4.79
query35	4.85	4.83	4.85
query36	1.04	1.01	1.00
query37	0.06	0.05	0.04
query38	0.05	0.02	0.03
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.02	0.02
query43	0.03	0.01	0.02
Total cold run time: 103.82 s
Total hot run time: 30.8 s

[doris-robot]

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 22aca3ca48a88f3e2023531f3795040b599685f3 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.6 seconds inserted 10000000 Rows, about 462K ops/s