Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[chore](dependencies)Upgrade paimon to 0.7.0 #33987

Merged
merged 1 commit into from
Apr 23, 2024
Merged

[chore](dependencies)Upgrade paimon to 0.7.0 #33987

merged 1 commit into from
Apr 23, 2024

Conversation

CalvinKirs
Copy link
Member

@CalvinKirs CalvinKirs commented Apr 22, 2024 •
edited by morningman
Loading

Followup #33928
https://paimon.apache.org/releases/release-0.7/
The 0.7 brings some enhancements and bugfixes. So I upgraded to 0.7

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@CalvinKirs
Copy link
Member Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39560 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8f4b71431a28785ca0fa2f54585e87c114de691f, data reload: false

------ Round 1 ----------------------------------
q1	17982	4838	4340	4340
q2	2500	192	189	189
q3	10933	1190	1218	1190
q4	11258	848	798	798
q5	7551	2764	2613	2613
q6	226	134	135	134
q7	956	558	540	540
q8	9362	2104	2082	2082
q9	8169	7271	7263	7263
q10	8995	3629	3648	3629
q11	463	235	239	235
q12	461	225	213	213
q13	18335	2956	2946	2946
q14	271	230	231	230
q15	532	487	483	483
q16	536	401	384	384
q17	970	710	700	700
q18	7314	6769	6719	6719
q19	1671	1515	1478	1478
q20	647	315	309	309
q21	3528	2776	2867	2776
q22	373	310	309	309
Total cold run time: 113033 ms
Total hot run time: 39560 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4299	4241	4183	4183
q2	373	269	256	256
q3	2980	2762	2772	2762
q4	1896	1569	1584	1569
q5	5365	5379	5320	5320
q6	205	125	122	122
q7	1793	1403	1418	1403
q8	3239	3346	3359	3346
q9	9303	9254	9247	9247
q10	3905	3672	3681	3672
q11	575	498	481	481
q12	763	599	563	563
q13	17454	2923	2916	2916
q14	306	287	263	263
q15	515	483	474	474
q16	473	417	426	417
q17	1745	1468	1486	1468
q18	7607	7530	7564	7530
q19	1629	1514	1501	1501
q20	1976	1781	1757	1757
q21	9507	4742	4735	4735
q22	544	472	480	472
Total cold run time: 76452 ms
Total hot run time: 54457 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184948 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8f4b71431a28785ca0fa2f54585e87c114de691f, data reload: false

query1	906	374	370	370
query2	7298	2386	2325	2325
query3	6673	223	216	216
query4	24660	21293	21359	21293
query5	4155	411	408	408
query6	265	170	171	170
query7	4578	294	282	282
query8	241	186	189	186
query9	8516	2278	2285	2278
query10	586	246	260	246
query11	14888	14195	14163	14163
query12	149	94	89	89
query13	1638	383	380	380
query14	10049	7694	7734	7694
query15	249	191	188	188
query16	8151	280	264	264
query17	1918	592	566	566
query18	2110	280	278	278
query19	230	150	161	150
query20	91	86	87	86
query21	205	130	130	130
query22	4958	4866	4850	4850
query23	33763	33245	33137	33137
query24	11759	3029	3030	3029
query25	648	364	375	364
query26	1770	155	154	154
query27	2937	317	315	315
query28	7557	1957	1953	1953
query29	995	597	591	591
query30	308	169	168	168
query31	967	712	737	712
query32	92	53	54	53
query33	750	248	237	237
query34	1047	492	493	492
query35	845	704	683	683
query36	1070	899	930	899
query37	147	70	68	68
query38	3372	3202	3191	3191
query39	1607	1553	1515	1515
query40	288	131	134	131
query41	48	44	43	43
query42	105	95	98	95
query43	563	549	549	549
query44	1191	724	739	724
query45	277	270	259	259
query46	1091	750	734	734
query47	1937	1843	1887	1843
query48	361	299	294	294
query49	1158	384	380	380
query50	762	380	396	380
query51	6774	6552	6620	6552
query52	114	86	91	86
query53	349	283	282	282
query54	296	230	245	230
query55	77	72	72	72
query56	238	217	221	217
query57	1190	1112	1127	1112
query58	224	190	194	190
query59	3237	3227	3138	3138
query60	264	224	234	224
query61	88	86	88	86
query62	642	432	451	432
query63	300	283	288	283
query64	6237	3981	4263	3981
query65	3083	3002	3057	3002
query66	1191	340	342	340
query67	15393	15104	14967	14967
query68	5417	532	535	532
query69	511	289	297	289
query70	1252	1195	1103	1103
query71	1412	1266	1266	1266
query72	6426	2633	2446	2446
query73	714	325	327	325
query74	7017	6365	6451	6365
query75	3523	2613	2628	2613
query76	3918	981	1030	981
query77	658	262	261	261
query78	11041	10250	10268	10250
query79	4001	514	521	514
query80	1715	434	416	416
query81	527	249	254	249
query82	796	99	96	96
query83	334	172	178	172
query84	275	87	84	84
query85	1634	320	257	257
query86	477	294	325	294
query87	3454	3248	3257	3248
query88	4922	2436	2435	2435
query89	486	377	375	375
query90	2035	183	184	183
query91	128	100	98	98
query92	64	47	45	45
query93	5145	505	499	499
query94	1213	177	176	176
query95	383	297	297	297
query96	604	273	272	272
query97	3158	2943	2955	2943
query98	236	221	226	221
query99	1250	844	854	844
Total cold run time: 294352 ms
Total hot run time: 184948 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.13 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8f4b71431a28785ca0fa2f54585e87c114de691f, data reload: false

query1	0.04	0.03	0.03
query2	0.09	0.04	0.04
query3	0.23	0.05	0.06
query4	1.65	0.10	0.08
query5	0.50	0.49	0.52
query6	1.44	0.72	0.71
query7	0.02	0.01	0.01
query8	0.05	0.04	0.04
query9	0.54	0.48	0.52
query10	0.54	0.54	0.54
query11	0.17	0.12	0.12
query12	0.15	0.11	0.12
query13	0.60	0.60	0.58
query14	0.76	0.76	0.77
query15	0.84	0.81	0.81
query16	0.35	0.38	0.37
query17	1.01	0.95	1.02
query18	0.23	0.22	0.24
query19	1.85	1.68	1.82
query20	0.02	0.01	0.01
query21	15.50	0.66	0.64
query22	4.02	7.09	1.84
query23	18.28	1.38	1.18
query24	1.80	0.30	0.21
query25	0.15	0.08	0.08
query26	0.26	0.16	0.17
query27	0.08	0.08	0.08
query28	13.28	1.02	0.99
query29	12.61	3.28	3.31
query30	0.25	0.07	0.06
query31	2.84	0.38	0.36
query32	3.29	0.46	0.45
query33	2.80	2.83	2.78
query34	16.95	4.40	4.45
query35	4.49	4.47	4.50
query36	0.64	0.46	0.47
query37	0.18	0.16	0.16
query38	0.16	0.15	0.15
query39	0.05	0.04	0.04
query40	0.17	0.14	0.14
query41	0.09	0.05	0.05
query42	0.06	0.05	0.04
query43	0.04	0.03	0.03
Total cold run time: 109.07 s
Total hot run time: 30.13 s

morningman
morningman approved these changes Apr 22, 2024
View reviewed changes
Copy link
Contributor

@morningman morningman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 22, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@JNSimba JNSimba merged commit c5c4968 into apache:master Apr 23, 2024
28 of 31 checks passed
@CalvinKirs CalvinKirs deleted the master-paimon-0.7.0 branch April 23, 2024 02:32
@xiaokang xiaokang added dev/2.0.x and removed dev/2.0.0 2.0.0 release labels Apr 23, 2024
CalvinKirs added a commit to CalvinKirs/incubator-doris that referenced this pull request Apr 23, 2024
@CalvinKirs
[chore](dependencies)Upgrade paimon to 0.7.0 (apache#33987)
b02f746 
(cherry picked from commit c5c4968)
@CalvinKirs CalvinKirs mentioned this pull request Apr 23, 2024
Merged
CalvinKirs added a commit that referenced this pull request Apr 24, 2024
@CalvinKirs
[chore](dependencies)Upgrade paimon to 0.7.0 (#33987) (#34037)
7dcc83e 
(cherry picked from commit c5c4968)
morningman added a commit to morningman/doris that referenced this pull request Apr 24, 2024
@morningman
[chore](dependencies)Upgrade paimon to 0.7.0 apache#33987
57b7057
morningman pushed a commit to morningman/doris that referenced this pull request Apr 24, 2024
@CalvinKirs @morningman
[chore](dependencies)Upgrade paimon to 0.7.0 (apache#33987)
ce12929
@morningman morningman mentioned this pull request Apr 24, 2024
Merged
yiguolei pushed a commit that referenced this pull request Apr 24, 2024
@morningman @CalvinKirs
[upgrade](hive-shade)(paimon) upgrade hive shade to 2.0.0 and paimon …
a18576b 
…to 0.7 (#34085)

* Adapt paimon 0.6.0 (#33943)

Version 2.0.0 of the shade package eliminates potential jar conflicts, resolves dependency component issues, and significantly reduces package size.
Utilize the directly-dependent guava library instead of relying on transitively included libraries.

* [chore](dependencies)Upgrade paimon to 0.7.0 (#33987)

---------

Co-authored-by: Calvin Kirs <[email protected]>
yiguolei pushed a commit that referenced this pull request Apr 25, 2024
@morningman @CalvinKirs @Doris-Extras
[upgrade](hive-shade)(paimon) upgrade hive shade to 2.0.0 and paimon …
fbd2c9d 
…to 0.7 (#34085)

* Adapt paimon 0.6.0 (#33943)

Version 2.0.0 of the shade package eliminates potential jar conflicts, resolves dependency component issues, and significantly reduces package size.
Utilize the directly-dependent guava library instead of relying on transitively included libraries.

* [chore](dependencies)Upgrade paimon to 0.7.0 (#33987)

---------

Co-authored-by: Calvin Kirs <[email protected]>
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
@CalvinKirs
[chore](dependencies)Upgrade paimon to 0.7.0 (apache#33987) (apache#3…
d946870 
…4037)

(cherry picked from commit c5c4968)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@morningman morningman morningman approved these changes

@JNSimba JNSimba JNSimba approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.0.10-merged dev/2.1.3-merged reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
7 participants
@CalvinKirs @doris-robot @morningman @JNSimba @xiaokang @yiguolei @wm1581066