New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[case](Cloud) Add chaos storage vault cases #33730

Merged

dataroaring merged 4 commits into apache:master from ByteYue:add_chaos_vault_stub_case

Apr 22, 2024

Contributor

ByteYue commented Apr 16, 2024

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

doris-robot commented Apr 16, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

Contributor

github-actions bot commented Apr 16, 2024

clang-tidy review says "All clean, LGTM! 👍"

ByteYue force-pushed the add_chaos_vault_stub_case branch from d9a49e1 to a0dec54 Compare

April 16, 2024 13:16

Contributor

github-actions bot commented Apr 16, 2024

clang-tidy review says "All clean, LGTM! 👍"

1 similar comment

Contributor

github-actions bot commented Apr 16, 2024

clang-tidy review says "All clean, LGTM! 👍"

gavinchou reviewed

View reviewed changes

be/src/cloud/injection_point_action.cpp Outdated Show resolved Hide resolved

ByteYue force-pushed the add_chaos_vault_stub_case branch from 179a079 to 020af21 Compare

April 17, 2024 13:42

Contributor

github-actions bot commented Apr 17, 2024

clang-tidy review says "All clean, LGTM! 👍"

1 similar comment

Contributor

github-actions bot commented Apr 17, 2024

clang-tidy review says "All clean, LGTM! 👍"

ByteYue added 3 commits

April 19, 2024 10:59


          add inject

478146f

add cases

format

resolve gavin comment


          rebase

b5e3c33


          case ok

0012eb9

ByteYue force-pushed the add_chaos_vault_stub_case branch from eeedc93 to 0012eb9 Compare

April 19, 2024 05:32

ByteYue requested a review from gavinchou

April 19, 2024 05:32

Contributor Author

ByteYue commented Apr 19, 2024

run buildall

Contributor

github-actions bot commented Apr 19, 2024

clang-tidy review says "All clean, LGTM! 👍"

doris-robot commented Apr 19, 2024

TeamCity be ut coverage result:
Function Coverage: 35.42% (8920/25186)
Line Coverage: 27.14% (73298/270024)
Region Coverage: 26.26% (37844/144131)
Branch Coverage: 23.08% (19288/83582)
Coverage Report: http://coverage.selectdb-in.cc/coverage/0012eb9b784a99baf25ad38ed696761966c6676e_0012eb9b784a99baf25ad38ed696761966c6676e/report/index.html


          return value

81f3365

Contributor

github-actions bot commented Apr 19, 2024

clang-tidy review says "All clean, LGTM! 👍"

Contributor Author

ByteYue commented Apr 19, 2024

run buildall

doris-robot commented Apr 19, 2024

TeamCity be ut coverage result:
Function Coverage: 35.42% (8922/25189)
Line Coverage: 27.12% (73288/270226)
Region Coverage: 26.27% (37873/144194)
Branch Coverage: 23.07% (19289/83606)
Coverage Report: http://coverage.selectdb-in.cc/coverage/81f33658cc651cbdc8471ba07ecefda13587c0fc_81f33658cc651cbdc8471ba07ecefda13587c0fc/report/index.html

doris-robot commented Apr 19, 2024

TPC-H: Total hot run time: 38294 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 81f33658cc651cbdc8471ba07ecefda13587c0fc, data reload: false

------ Round 1 ----------------------------------
q1	17605	4227	4286	4227
q2	2008	188	188	188
q3	10445	1127	1191	1127
q4	10192	753	875	753
q5	7492	2687	2636	2636
q6	220	130	137	130
q7	1004	618	581	581
q8	9235	2060	2024	2024
q9	7345	6512	6527	6512
q10	8485	3551	3526	3526
q11	453	229	228	228
q12	414	224	214	214
q13	17765	2942	2977	2942
q14	271	230	225	225
q15	514	472	471	471
q16	538	388	378	378
q17	953	731	680	680
q18	7276	6703	6656	6656
q19	4441	1522	1497	1497
q20	650	313	297	297
q21	3476	2687	2753	2687
q22	370	315	322	315
Total cold run time: 111152 ms
Total hot run time: 38294 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4322	4188	4191	4188
q2	366	260	275	260
q3	2958	2711	2805	2711
q4	1834	1572	1584	1572
q5	5300	5329	5234	5234
q6	208	123	122	122
q7	2252	1863	1895	1863
q8	3186	3307	3318	3307
q9	8559	8515	8571	8515
q10	4021	3863	3913	3863
q11	595	478	536	478
q12	838	642	607	607
q13	17660	3233	3167	3167
q14	349	281	284	281
q15	529	487	479	479
q16	513	459	466	459
q17	1817	1538	1486	1486
q18	8134	7835	7879	7835
q19	1667	1609	1587	1587
q20	2052	1924	1816	1816
q21	5142	5119	4895	4895
q22	552	454	465	454
Total cold run time: 72854 ms
Total hot run time: 55179 ms

doris-robot commented Apr 19, 2024

TPC-DS: Total hot run time: 185972 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 81f33658cc651cbdc8471ba07ecefda13587c0fc, data reload: false

query1	883	374	364	364
query2	6622	2503	2302	2302
query3	6661	205	202	202
query4	22783	21370	21405	21370
query5	4117	408	405	405
query6	276	183	179	179
query7	4599	301	289	289
query8	243	192	182	182
query9	8544	2390	2366	2366
query10	399	257	250	250
query11	14738	14159	14181	14159
query12	136	95	83	83
query13	1634	365	364	364
query14	9741	7922	7961	7922
query15	270	174	185	174
query16	8255	266	257	257
query17	2051	583	550	550
query18	2105	284	262	262
query19	332	147	144	144
query20	92	86	86	86
query21	195	128	134	128
query22	5155	4962	4975	4962
query23	34060	33066	33334	33066
query24	10644	2985	3040	2985
query25	582	383	392	383
query26	692	154	155	154
query27	2258	365	369	365
query28	5798	2103	2129	2103
query29	863	643	619	619
query30	290	187	180	180
query31	943	766	775	766
query32	90	56	52	52
query33	652	250	248	248
query34	921	495	497	495
query35	824	711	732	711
query36	1092	948	929	929
query37	109	70	70	70
query38	3455	3484	3264	3264
query39	1619	1589	1568	1568
query40	170	125	126	125
query41	46	44	43	43
query42	108	98	95	95
query43	569	560	566	560
query44	1064	733	734	733
query45	283	283	265	265
query46	1127	766	767	766
query47	2073	1972	1979	1972
query48	398	314	325	314
query49	838	404	403	403
query50	799	398	401	398
query51	6822	6868	6862	6862
query52	103	85	95	85
query53	344	280	278	278
query54	311	236	231	231
query55	78	79	73	73
query56	272	233	232	232
query57	1214	1179	1121	1121
query58	227	207	200	200
query59	3234	3014	3029	3014
query60	258	238	238	238
query61	107	106	104	104
query62	592	460	434	434
query63	305	285	281	281
query64	4824	3762	3890	3762
query65	3074	3028	3030	3028
query66	756	331	334	331
query67	15606	15240	14973	14973
query68	9957	552	556	552
query69	585	311	309	309
query70	1433	1107	1171	1107
query71	1451	1269	1266	1266
query72	7152	2609	2437	2437
query73	1628	325	325	325
query74	6934	6469	6578	6469
query75	4477	2671	2591	2591
query76	5285	1014	958	958
query77	600	264	261	261
query78	11049	10225	10132	10132
query79	11034	519	520	519
query80	2135	439	428	428
query81	510	251	239	239
query82	175	97	95	95
query83	237	163	166	163
query84	258	83	84	83
query85	961	261	281	261
query86	335	294	283	283
query87	3517	3304	3281	3281
query88	5402	2417	2404	2404
query89	503	372	369	369
query90	2082	179	181	179
query91	124	96	95	95
query92	61	45	44	44
query93	6505	507	498	498
query94	1372	178	177	177
query95	403	293	303	293
query96	616	264	261	261
query97	3126	2968	3004	2968
query98	224	219	210	210
query99	1068	836	843	836
Total cold run time: 301524 ms
Total hot run time: 185972 ms

doris-robot commented Apr 19, 2024

ClickBench: Total hot run time: 30.75 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 81f33658cc651cbdc8471ba07ecefda13587c0fc, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.06
query4	1.65	0.09	0.10
query5	0.51	0.49	0.50
query6	1.47	0.72	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.54	0.50	0.49
query10	0.55	0.56	0.55
query11	0.15	0.12	0.11
query12	0.15	0.12	0.12
query13	0.62	0.57	0.58
query14	0.74	0.78	0.76
query15	0.83	0.81	0.82
query16	0.38	0.38	0.37
query17	0.99	1.02	1.01
query18	0.22	0.24	0.21
query19	1.84	1.78	1.82
query20	0.01	0.00	0.01
query21	15.41	0.64	0.63
query22	4.82	6.97	1.93
query23	18.29	1.30	1.28
query24	1.76	0.22	0.25
query25	0.16	0.08	0.08
query26	0.24	0.17	0.16
query27	0.09	0.08	0.07
query28	13.35	1.00	0.98
query29	12.52	3.52	3.54
query30	0.26	0.08	0.06
query31	2.84	0.38	0.37
query32	3.30	0.46	0.47
query33	2.79	2.84	2.81
query34	17.19	4.48	4.44
query35	4.49	4.43	4.50
query36	0.65	0.47	0.46
query37	0.19	0.15	0.15
query38	0.16	0.15	0.13
query39	0.04	0.03	0.03
query40	0.17	0.15	0.16
query41	0.10	0.05	0.05
query42	0.06	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 109.99 s
Total hot run time: 30.75 s

doris-robot commented Apr 19, 2024

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 81f33658cc651cbdc8471ba07ecefda13587c0fc with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       14.5 seconds inserted 10000000 Rows, about 689K ops/s

dataroaring approved these changes

View reviewed changes

Contributor

dataroaring left a comment

LGTM

github-actions bot added the approved label

Contributor

github-actions bot commented Apr 21, 2024

PR approved by at least one committer and no changes requested.

Contributor

github-actions bot commented Apr 21, 2024

PR approved by anyone and no changes requested.

github-actions bot added the reviewed label

gavinchou approved these changes

View reviewed changes

dataroaring merged commit 0f65fd0 into apache:master

25 of 28 checks passed

dataroaring added dev/4.0.0 dev/3.0.0-merged and removed dev/4.0.0 labels

dataroaring pushed a commit that referenced this pull request


          [case](Cloud) Add chaos storage vault cases (#33730)

f1111fd

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved dev/3.0.0-merged reviewed