Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[branch-2.0-fix](partial update) enable_unique_key_partial_update should not affect tables which are not merge-on-write unique tables #40170

Conversation

bobhan1
Copy link
Contributor

@bobhan1 bobhan1 commented Aug 30, 2024

Proposed changes

@github-actions github-actions bot added area/nereids area/planner Issues or PRs related to the query planner kind/test labels Aug 30, 2024
@bobhan1
Copy link
Contributor Author

bobhan1 commented Aug 30, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49760 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2e38b58317afaa575d774511ed7a97cd33a64228, data reload: false

------ Round 1 ----------------------------------
q1	17849	4366	4362	4362
q2	2069	155	149	149
q3	10424	1867	1859	1859
q4	10284	1228	1329	1228
q5	8520	3912	3906	3906
q6	236	126	124	124
q7	2061	1655	1639	1639
q8	9315	2707	2692	2692
q9	10968	10627	10472	10472
q10	8600	3504	3491	3491
q11	422	251	258	251
q12	469	290	295	290
q13	18338	3979	4026	3979
q14	362	328	324	324
q15	500	463	461	461
q16	680	569	565	565
q17	1135	993	957	957
q18	7236	6808	6985	6808
q19	1675	1523	1402	1402
q20	542	301	307	301
q21	4428	4122	4104	4104
q22	495	396	400	396
Total cold run time: 116608 ms
Total hot run time: 49760 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4307	4308	4276	4276
q2	324	232	229	229
q3	4135	4168	4096	4096
q4	2720	2732	2734	2732
q5	7192	7167	7114	7114
q6	236	119	118	118
q7	3201	2839	2842	2839
q8	4375	4444	4484	4444
q9	17381	17248	17164	17164
q10	4203	4271	4254	4254
q11	783	707	664	664
q12	1021	844	859	844
q13	6926	3757	3763	3757
q14	444	417	423	417
q15	495	459	454	454
q16	731	685	674	674
q17	3820	3834	3768	3768
q18	8784	8711	8788	8711
q19	1705	1690	1625	1625
q20	2386	2118	2086	2086
q21	8508	8299	8581	8299
q22	1020	911	931	911
Total cold run time: 84697 ms
Total hot run time: 79476 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 201605 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2e38b58317afaa575d774511ed7a97cd33a64228, data reload: false

query1	933	395	430	395
query2	6538	2133	2046	2046
query3	6928	204	199	199
query4	20158	18020	17858	17858
query5	19733	6530	6543	6530
query6	344	215	245	215
query7	4627	296	309	296
query8	239	261	266	261
query9	3161	2705	2638	2638
query10	448	300	290	290
query11	11245	10691	10546	10546
query12	129	77	73	73
query13	5595	667	637	637
query14	17959	13671	13631	13631
query15	362	219	221	219
query16	6450	293	270	270
query17	1353	1606	879	879
query18	2289	419	426	419
query19	209	157	150	150
query20	79	79	79	79
query21	190	93	92	92
query22	5170	5085	4997	4997
query23	32559	32006	31971	31971
query24	6792	6546	6540	6540
query25	546	419	434	419
query26	532	160	162	160
query27	1849	304	297	297
query28	6108	2295	2276	2276
query29	2849	2704	2805	2704
query30	242	168	169	168
query31	927	769	718	718
query32	69	61	58	58
query33	386	249	251	249
query34	840	476	486	476
query35	1126	957	891	891
query36	1410	1093	1078	1078
query37	94	65	62	62
query38	3024	2920	2924	2920
query39	1370	1321	1312	1312
query40	205	98	92	92
query41	38	36	36	36
query42	90	80	85	80
query43	581	632	520	520
query44	1129	725	720	720
query45	239	226	232	226
query46	1235	960	988	960
query47	1915	1761	1897	1761
query48	995	653	676	653
query49	616	374	376	374
query50	869	603	607	603
query51	4829	4639	4681	4639
query52	90	84	83	83
query53	448	319	318	318
query54	2685	2442	2456	2442
query55	96	86	78	78
query56	225	219	226	219
query57	1246	1100	1055	1055
query58	206	208	197	197
query59	3582	3324	3342	3324
query60	200	211	212	211
query61	105	98	103	98
query62	800	510	507	507
query63	481	343	343	343
query64	2404	1541	1515	1515
query65	3649	3568	3593	3568
query66	781	386	377	377
query67	15148	14837	15681	14837
query68	8578	666	649	649
query69	569	345	336	336
query70	1544	1425	1573	1425
query71	389	318	318	318
query72	6499	3560	3528	3528
query73	742	332	324	324
query74	6273	5841	5809	5809
query75	5212	3693	3709	3693
query76	5294	1179	1185	1179
query77	908	251	245	245
query78	12780	11619	12332	11619
query79	8381	642	648	642
query80	1232	395	399	395
query81	486	233	233	233
query82	1320	100	97	97
query83	173	129	126	126
query84	261	72	71	71
query85	933	321	321	321
query86	321	291	300	291
query87	3191	3027	2962	2962
query88	4855	2310	2308	2308
query89	348	267	311	267
query90	1893	215	209	209
query91	156	126	124	124
query92	55	54	53	53
query93	4482	575	591	575
query94	692	204	209	204
query95	1136	1090	1042	1042
query96	652	323	343	323
query97	6570	6277	6416	6277
query98	184	175	175	175
query99	2939	946	930	930
Total cold run time: 308797 ms
Total hot run time: 201605 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.75 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2e38b58317afaa575d774511ed7a97cd33a64228, data reload: false

query1	0.02	0.03	0.02
query2	0.07	0.03	0.02
query3	0.25	0.04	0.05
query4	1.79	0.06	0.06
query5	0.53	0.53	0.52
query6	1.26	0.61	0.63
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.52	0.50	0.47
query10	0.53	0.54	0.52
query11	0.12	0.08	0.09
query12	0.12	0.09	0.09
query13	0.62	0.61	0.61
query14	0.79	0.78	0.78
query15	0.77	0.76	0.76
query16	0.36	0.37	0.38
query17	1.04	1.02	1.03
query18	0.23	0.25	0.24
query19	1.92	1.82	1.81
query20	0.01	0.01	0.01
query21	15.45	0.55	0.55
query22	2.39	2.30	1.58
query23	17.00	0.98	0.95
query24	7.30	0.92	1.10
query25	0.35	0.09	0.06
query26	0.82	0.17	0.14
query27	0.05	0.04	0.04
query28	5.85	0.76	0.73
query29	12.66	2.39	2.36
query30	0.62	0.54	0.49
query31	3.00	0.40	0.37
query32	3.74	0.51	0.49
query33	3.07	3.09	3.08
query34	15.26	4.80	4.82
query35	4.85	4.87	4.86
query36	1.05	1.01	1.02
query37	0.06	0.05	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.02	0.01
query42	0.03	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 104.85 s
Total hot run time: 30.75 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 2e38b58317afaa575d774511ed7a97cd33a64228 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.6 seconds inserted 10000000 Rows, about 462K ops/s

Copy link
Contributor

@zhannngchen zhannngchen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 30, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

@dataroaring dataroaring merged commit 1900e91 into apache:branch-2.0 Sep 2, 2024
22 of 26 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. area/nereids area/planner Issues or PRs related to the query planner kind/test reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants