Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Fix](partial update) Fix partial update failed when merge_type=MERGE #40730 #40955

Merged
merged 1 commit into from
Sep 22, 2024

Conversation

bobhan1
Copy link
Contributor

@bobhan1 bobhan1 commented Sep 19, 2024

picks #40730

fix case
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@bobhan1
Copy link
Contributor Author

bobhan1 commented Sep 19, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49117 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cec927680518d03544d52869c3df3720ef679033, data reload: false

------ Round 1 ----------------------------------
q1	17635	4461	4377	4377
q2	2050	153	154	153
q3	10260	1907	1933	1907
q4	10401	1286	1336	1286
q5	8508	3881	3930	3881
q6	239	123	146	123
q7	2027	1603	1593	1593
q8	9288	2746	2723	2723
q9	10143	9866	9838	9838
q10	8663	3545	3546	3545
q11	422	251	244	244
q12	472	305	300	300
q13	18338	3994	4011	3994
q14	353	327	324	324
q15	505	447	459	447
q16	549	452	447	447
q17	1135	973	928	928
q18	7181	6851	6808	6808
q19	1689	1556	1442	1442
q20	497	313	288	288
q21	4468	4206	4086	4086
q22	492	388	383	383
Total cold run time: 115315 ms
Total hot run time: 49117 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4388	4314	4296	4296
q2	321	226	227	226
q3	4159	4159	4188	4159
q4	2758	2742	2759	2742
q5	7127	7126	7062	7062
q6	241	117	119	117
q7	3219	2793	2788	2788
q8	4357	4461	4504	4461
q9	13667	13636	13528	13528
q10	4235	4256	4235	4235
q11	747	679	664	664
q12	1040	862	848	848
q13	7090	3792	3729	3729
q14	442	425	421	421
q15	495	465	456	456
q16	627	594	596	594
q17	3846	3789	3858	3789
q18	8749	8829	8778	8778
q19	1728	1668	1638	1638
q20	2331	2191	2115	2115
q21	8487	8482	8438	8438
q22	1013	936	965	936
Total cold run time: 81067 ms
Total hot run time: 76020 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 212252 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cec927680518d03544d52869c3df3720ef679033, data reload: false

query1	921	393	405	393
query2	6556	2310	2005	2005
query3	6923	209	209	209
query4	23324	21928	21624	21624
query5	19728	6483	6457	6457
query6	292	222	223	222
query7	4323	310	314	310
query8	252	270	232	232
query9	3111	2679	2611	2611
query10	463	311	307	307
query11	16112	15018	15229	15018
query12	121	79	73	73
query13	1039	443	439	439
query14	17259	13556	13056	13056
query15	383	215	225	215
query16	6386	287	261	261
query17	1734	932	916	916
query18	893	324	321	321
query19	213	152	155	152
query20	82	75	76	75
query21	194	99	95	95
query22	5266	5121	5128	5121
query23	34283	33538	33649	33538
query24	7870	6310	6342	6310
query25	523	432	434	432
query26	1286	166	166	166
query27	2351	290	294	290
query28	6105	2252	2220	2220
query29	3009	2773	2747	2747
query30	246	172	169	169
query31	956	750	720	720
query32	70	63	61	61
query33	452	267	259	259
query34	857	477	469	469
query35	1121	921	934	921
query36	1275	1139	1255	1139
query37	176	61	59	59
query38	3074	2984	2897	2897
query39	1370	1328	1338	1328
query40	312	97	92	92
query41	48	38	36	36
query42	86	86	81	81
query43	627	549	612	549
query44	1176	723	734	723
query45	250	230	238	230
query46	1238	961	972	961
query47	1884	1695	1749	1695
query48	516	414	425	414
query49	653	375	388	375
query50	877	648	642	642
query51	4707	4672	4614	4614
query52	92	84	82	82
query53	240	185	180	180
query54	2659	2464	2518	2464
query55	90	88	80	80
query56	234	209	210	209
query57	1232	1127	1133	1127
query58	230	205	221	205
query59	3574	3158	3254	3158
query60	209	209	198	198
query61	100	94	98	94
query62	857	457	480	457
query63	210	174	176	174
query64	3476	1568	1510	1510
query65	3609	3547	3560	3547
query66	807	444	416	416
query67	15446	16178	15100	15100
query68	9618	641	639	639
query69	511	272	280	272
query70	1928	1436	1322	1322
query71	424	320	319	319
query72	6742	4844	4683	4683
query73	769	330	325	325
query74	6325	5843	5803	5803
query75	5162	3762	3665	3665
query76	5302	1146	1172	1146
query77	911	257	266	257
query78	12442	11723	12712	11723
query79	11742	667	672	667
query80	1410	385	379	379
query81	490	239	236	236
query82	1183	96	100	96
query83	164	136	145	136
query84	263	72	71	71
query85	887	325	322	322
query86	330	287	292	287
query87	3265	2979	3051	2979
query88	5011	2404	2404	2404
query89	433	285	293	285
query90	1986	220	217	217
query91	172	124	130	124
query92	59	53	52	52
query93	5596	590	562	562
query94	762	213	211	211
query95	2012	2014	2007	2007
query96	660	323	335	323
query97	6406	6450	6416	6416
query98	226	218	200	200
query99	2760	943	874	874
Total cold run time: 321989 ms
Total hot run time: 212252 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.75 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cec927680518d03544d52869c3df3720ef679033, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.25	0.04	0.05
query4	1.80	0.06	0.07
query5	0.55	0.52	0.51
query6	1.33	0.61	0.62
query7	0.02	0.01	0.01
query8	0.03	0.03	0.03
query9	0.54	0.49	0.47
query10	0.55	0.52	0.54
query11	0.11	0.09	0.08
query12	0.12	0.09	0.09
query13	0.63	0.62	0.62
query14	0.80	0.79	0.79
query15	0.78	0.76	0.76
query16	0.37	0.39	0.37
query17	0.99	1.00	1.01
query18	0.23	0.27	0.24
query19	1.90	1.82	1.80
query20	0.02	0.01	0.01
query21	15.45	0.57	0.54
query22	2.06	2.26	1.63
query23	16.90	1.01	0.98
query24	6.52	1.04	1.14
query25	0.38	0.08	0.06
query26	0.76	0.16	0.15
query27	0.04	0.04	0.04
query28	6.44	0.73	0.69
query29	12.63	2.34	2.25
query30	0.63	0.54	0.52
query31	2.82	0.38	0.37
query32	3.37	0.50	0.49
query33	3.07	3.03	3.08
query34	15.26	4.81	4.79
query35	4.85	4.85	4.85
query36	1.06	1.02	1.01
query37	0.06	0.05	0.04
query38	0.03	0.03	0.03
query39	0.02	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.02	0.01
query42	0.02	0.01	0.02
query43	0.03	0.02	0.02
Total cold run time: 103.74 s
Total hot run time: 30.75 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit cec927680518d03544d52869c3df3720ef679033 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.0 seconds inserted 10000000 Rows, about 476K ops/s

@xiaokang xiaokang changed the title [branch-2.0] Picks "[Fix](partial update) Fix partial update failed when merge_type=MERGE #40730" [Fix](partial update) Fix partial update failed when merge_type=MERGE #40730 Sep 22, 2024
@xiaokang xiaokang merged commit c0a8843 into apache:branch-2.0 Sep 22, 2024
23 of 25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/planner Issues or PRs related to the query planner kind/test
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants