Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[opt](like) opt LIKE and REGEXP clause with concat(col, pattern_str) #34410

Merged
merged 1 commit into from
May 28, 2024
Merged

[opt](like) opt LIKE and REGEXP clause with concat(col, pattern_str) #34410

merged 1 commit into from
May 28, 2024

Conversation

zhiqiang-hhhh
Copy link
Contributor

pick #32333

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented May 6, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 49549 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0a765938e7983f53beabdba571b02738e1762593, data reload: false

------ Round 1 ----------------------------------
q1	17767	4386	4343	4343
q2	2096	149	149	149
q3	10284	1896	1943	1896
q4	10363	1237	1324	1237
q5	8465	3871	3982	3871
q6	226	122	123	122
q7	2015	1607	1583	1583
q8	9575	2711	2740	2711
q9	13808	10240	10274	10240
q10	8615	3516	3535	3516
q11	415	244	244	244
q12	470	307	303	303
q13	18365	3978	4048	3978
q14	348	329	319	319
q15	507	449	455	449
q16	662	570	590	570
q17	1123	932	945	932
q18	7331	6803	6912	6803
q19	1684	1548	1513	1513
q20	550	298	311	298
q21	4434	4605	4082	4082
q22	490	400	390	390
Total cold run time: 119593 ms
Total hot run time: 49549 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4294	4290	4277	4277
q2	314	216	223	216
q3	4140	4138	4136	4136
q4	2754	2744	2726	2726
q5	7212	7108	7079	7079
q6	235	118	122	118
q7	3258	2903	2905	2903
q8	4370	4500	4462	4462
q9	16878	16793	16742	16742
q10	4186	4244	4226	4226
q11	766	677	680	677
q12	1050	854	832	832
q13	5082	3696	3744	3696
q14	457	430	424	424
q15	498	465	466	465
q16	747	678	686	678
q17	3858	3825	3843	3825
q18	8864	8863	8785	8785
q19	1724	1712	1635	1635
q20	2378	2135	2128	2128
q21	8691	8547	8499	8499
q22	1049	945	949	945
Total cold run time: 82805 ms
Total hot run time: 79474 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.85% (8096/21392)
Line Coverage: 29.47% (66038/224101)
Region Coverage: 28.94% (34014/117518)
Branch Coverage: 24.79% (17445/70382)
Coverage Report: http://coverage.selectdb-in.cc/coverage/0a765938e7983f53beabdba571b02738e1762593_0a765938e7983f53beabdba571b02738e1762593/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 202082 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0a765938e7983f53beabdba571b02738e1762593, data reload: false

query1	932	389	384	384
query2	6556	2862	2500	2500
query3	6913	208	202	202
query4	20988	17907	18023	17907
query5	19728	6441	6471	6441
query6	288	214	222	214
query7	4161	298	291	291
query8	245	248	234	234
query9	3155	2719	2626	2626
query10	426	287	312	287
query11	11283	10681	10817	10681
query12	121	75	73	73
query13	5580	702	690	690
query14	17987	13395	13264	13264
query15	362	221	223	221
query16	6466	270	272	270
query17	1715	1450	869	869
query18	2307	415	417	415
query19	208	159	157	157
query20	71	74	74	74
query21	193	101	90	90
query22	5133	4870	4956	4870
query23	32381	31984	32051	31984
query24	6947	6482	6527	6482
query25	529	430	433	430
query26	563	175	175	175
query27	2170	307	302	302
query28	6220	2372	2382	2372
query29	2996	2750	2684	2684
query30	239	166	163	163
query31	896	766	739	739
query32	69	59	58	58
query33	396	254	251	251
query34	852	464	497	464
query35	1094	890	923	890
query36	1427	1114	1145	1114
query37	95	61	60	60
query38	3081	2919	2953	2919
query39	1373	1327	1309	1309
query40	202	98	100	98
query41	38	42	38	38
query42	85	82	90	82
query43	775	786	629	629
query44	1140	733	741	733
query45	239	236	222	222
query46	1219	966	970	966
query47	2027	1622	1694	1622
query48	1013	724	718	718
query49	621	363	381	363
query50	865	602	568	568
query51	4737	4696	4661	4661
query52	84	88	79	79
query53	452	318	313	313
query54	2635	2464	2603	2464
query55	91	77	82	77
query56	212	209	213	209
query57	1156	1170	1051	1051
query58	213	198	207	198
query59	4185	3990	4079	3990
query60	203	190	218	190
query61	96	89	86	86
query62	791	518	462	462
query63	471	343	339	339
query64	2310	1497	1469	1469
query65	3668	3556	3552	3552
query66	830	377	386	377
query67	16174	17202	14937	14937
query68	8403	648	682	648
query69	576	338	346	338
query70	1614	1348	1319	1319
query71	399	304	302	302
query72	6548	3447	3454	3447
query73	723	327	331	327
query74	6274	5800	5816	5800
query75	4630	3722	3748	3722
query76	4793	1135	1103	1103
query77	670	257	255	255
query78	12597	11522	11581	11522
query79	8943	656	649	649
query80	1632	397	395	395
query81	498	232	229	229
query82	1677	96	98	96
query83	179	137	131	131
query84	261	72	68	68
query85	858	308	304	304
query86	320	286	289	286
query87	3231	3004	3007	3004
query88	5124	2326	2323	2323
query89	378	289	281	281
query90	1924	207	208	207
query91	162	130	134	130
query92	59	50	49	49
query93	6421	599	575	575
query94	748	212	205	205
query95	1114	1069	1056	1056
query96	648	331	333	331
query97	6407	6298	6405	6298
query98	180	177	170	170
query99	2989	913	863	863
Total cold run time: 313658 ms
Total hot run time: 202082 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.27 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0a765938e7983f53beabdba571b02738e1762593, data reload: false

query1	0.02	0.02	0.02
query2	0.08	0.03	0.02
query3	0.24	0.04	0.05
query4	1.82	0.07	0.07
query5	0.53	0.53	0.52
query6	1.24	0.62	0.62
query7	0.02	0.01	0.01
query8	0.03	0.02	0.03
query9	0.52	0.47	0.48
query10	0.55	0.53	0.54
query11	0.12	0.09	0.09
query12	0.12	0.09	0.09
query13	0.62	0.62	0.61
query14	0.78	0.79	0.77
query15	0.78	0.76	0.75
query16	0.39	0.36	0.39
query17	1.00	1.02	0.97
query18	0.20	0.28	0.24
query19	1.90	1.84	1.84
query20	0.02	0.01	0.01
query21	15.46	0.58	0.56
query22	2.22	2.48	1.77
query23	17.21	1.10	0.86
query24	7.33	1.24	0.62
query25	0.36	0.13	0.06
query26	0.72	0.15	0.15
query27	0.04	0.04	0.03
query28	6.01	0.71	0.80
query29	12.79	2.12	2.34
query30	0.60	0.52	0.55
query31	2.82	0.39	0.37
query32	3.36	0.49	0.50
query33	3.02	3.13	3.09
query34	15.26	4.79	4.79
query35	4.84	4.86	4.83
query36	1.06	1.02	1.01
query37	0.05	0.04	0.04
query38	0.04	0.02	0.02
query39	0.03	0.01	0.02
query40	0.16	0.14	0.14
query41	0.06	0.02	0.01
query42	0.02	0.01	0.01
query43	0.02	0.01	0.02
Total cold run time: 104.46 s
Total hot run time: 30.27 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 0a765938e7983f53beabdba571b02738e1762593 with default session variables
Stream load json:         21 seconds loaded 2358488459 Bytes, about 107 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.5 seconds inserted 10000000 Rows, about 465K ops/s

@xiaokang xiaokang merged commit 757e709 into apache:branch-2.0 May 28, 2024
24 of 26 checks passed
@zhiqiang-hhhh zhiqiang-hhhh deleted the pick_32333_to_upstream_branch-2.0 branch May 28, 2024 07:27
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
@zhiqiang-hhhh @sjyango
[opt](like) opt LIKE and REGEXP clause with concat(col, pattern_str) a…
8f62d7b 
…pache#32333 (apache#34410)

Co-authored-by: yangshijie <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
kind/test
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@zhiqiang-hhhh @doris-robot @xiaokang @sjyango