[Fix](tablet-meta) limit the data size of tablet meta (#39455)

[luwei16]

pick master #39455

[doris-robot]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

[github-actions]

clang-tidy review says "All clean, LGTM! 👍"

[cambyzju]

pick #39455

[luwei16]

run buildall

[doris-robot]

TPC-H: Total hot run time: 49910 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 89abbf7b936cfaaff50663518e4c25ab2f05c9a6, data reload: false

------ Round 1 ----------------------------------
q1	17659	4504	4352	4352
q2	2062	152	140	140
q3	10430	2130	1949	1949
q4	10268	1276	1351	1276
q5	8481	4012	3945	3945
q6	229	124	123	123
q7	2046	1602	1572	1572
q8	9299	2748	2727	2727
q9	11092	10787	10568	10568
q10	8627	3510	3516	3510
q11	419	254	241	241
q12	471	298	304	298
q13	18364	3946	3983	3946
q14	350	336	322	322
q15	496	454	452	452
q16	680	565	570	565
q17	1137	958	965	958
q18	7372	6803	6798	6798
q19	1712	1522	1462	1462
q20	510	291	305	291
q21	4400	4143	4029	4029
q22	500	386	391	386
Total cold run time: 116604 ms
Total hot run time: 49910 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4332	4312	4337	4312
q2	326	222	221	221
q3	4131	4117	4136	4117
q4	2745	2750	2732	2732
q5	7223	7170	7213	7170
q6	237	120	118	118
q7	3222	2819	2880	2819
q8	4356	4486	4520	4486
q9	17357	17066	17200	17066
q10	4213	4277	4288	4277
q11	774	677	694	677
q12	1025	849	858	849
q13	7110	3697	3698	3697
q14	453	413	423	413
q15	493	451	460	451
q16	736	708	686	686
q17	3812	3813	3792	3792
q18	8852	8806	8793	8793
q19	1698	1712	1666	1666
q20	2376	2140	2116	2116
q21	8512	8433	8338	8338
q22	1006	941	917	917
Total cold run time: 84989 ms
Total hot run time: 79713 ms

[doris-robot]

TPC-DS: Total hot run time: 202185 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 89abbf7b936cfaaff50663518e4c25ab2f05c9a6, data reload: false

query1	932	388	408	388
query2	6525	2247	2216	2216
query3	6925	200	201	200
query4	20028	18066	17963	17963
query5	19726	6457	6502	6457
query6	285	218	231	218
query7	4154	304	303	303
query8	264	257	282	257
query9	3137	2697	2639	2639
query10	412	301	325	301
query11	11321	10656	10707	10656
query12	132	74	70	70
query13	5608	653	652	652
query14	17358	13771	13456	13456
query15	366	221	225	221
query16	6501	280	259	259
query17	1706	1459	881	881
query18	2319	426	419	419
query19	214	152	150	150
query20	78	80	80	80
query21	189	98	99	98
query22	5246	4895	4896	4895
query23	32563	31950	31732	31732
query24	7087	6546	6483	6483
query25	534	426	413	413
query26	612	162	160	160
query27	2013	294	298	294
query28	6150	2306	2234	2234
query29	2842	2806	2637	2637
query30	248	168	169	168
query31	921	703	733	703
query32	64	64	60	60
query33	397	246	259	246
query34	863	470	466	466
query35	1110	963	926	926
query36	1504	1110	1180	1110
query37	88	58	58	58
query38	3066	2914	2928	2914
query39	1365	1306	1333	1306
query40	226	93	94	93
query41	40	36	36	36
query42	84	82	85	82
query43	606	612	566	566
query44	1106	710	709	709
query45	246	235	234	234
query46	1236	937	980	937
query47	1893	1772	1932	1772
query48	1000	679	674	674
query49	625	370	365	365
query50	860	655	593	593
query51	4695	4668	4680	4668
query52	92	75	86	75
query53	444	325	320	320
query54	2649	2474	2435	2435
query55	79	83	89	83
query56	230	227	207	207
query57	1198	1136	1061	1061
query58	220	205	200	200
query59	3479	3503	3336	3336
query60	210	220	204	204
query61	100	94	96	94
query62	763	464	477	464
query63	478	343	345	343
query64	2675	1554	1526	1526
query65	3603	3599	3559	3559
query66	814	376	379	376
query67	16846	15667	16593	15667
query68	8614	637	666	637
query69	565	359	342	342
query70	1577	1426	1629	1426
query71	402	314	310	310
query72	6537	3511	3499	3499
query73	738	328	321	321
query74	6327	5847	5761	5761
query75	5024	3664	3655	3655
query76	5021	1137	1193	1137
query77	814	258	253	253
query78	12757	11735	12132	11735
query79	7925	647	628	628
query80	1090	401	401	401
query81	489	236	234	234
query82	1431	96	102	96
query83	179	135	139	135
query84	265	71	70	70
query85	1045	327	326	326
query86	335	294	295	294
query87	3221	3031	2985	2985
query88	5019	2316	2296	2296
query89	350	285	290	285
query90	1826	212	215	212
query91	164	123	122	122
query92	63	54	49	49
query93	4149	614	587	587
query94	720	215	214	214
query95	1111	1069	1063	1063
query96	642	338	334	334
query97	6500	6435	6392	6392
query98	194	179	176	176
query99	2889	906	842	842
Total cold run time: 309333 ms
Total hot run time: 202185 ms

[doris-robot]

ClickBench: Total hot run time: 30.73 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 89abbf7b936cfaaff50663518e4c25ab2f05c9a6, data reload: false

query1	0.03	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.05	0.05
query4	1.78	0.06	0.06
query5	0.53	0.52	0.52
query6	1.27	0.65	0.61
query7	0.02	0.01	0.01
query8	0.03	0.02	0.03
query9	0.53	0.50	0.47
query10	0.53	0.55	0.53
query11	0.12	0.08	0.09
query12	0.12	0.09	0.09
query13	0.62	0.61	0.61
query14	0.78	0.79	0.77
query15	0.79	0.75	0.77
query16	0.36	0.38	0.36
query17	0.99	1.00	0.98
query18	0.23	0.25	0.24
query19	1.93	1.84	1.87
query20	0.01	0.01	0.01
query21	15.45	0.58	0.55
query22	2.08	2.14	1.65
query23	17.20	0.95	0.96
query24	4.57	1.07	1.32
query25	0.36	0.11	0.04
query26	0.52	0.14	0.15
query27	0.04	0.03	0.04
query28	8.55	0.76	0.71
query29	12.74	2.26	2.36
query30	0.60	0.49	0.52
query31	2.82	0.39	0.37
query32	3.38	0.50	0.50
query33	3.08	3.08	3.05
query34	15.24	4.81	4.79
query35	4.89	4.84	4.81
query36	1.05	1.02	1.02
query37	0.06	0.05	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.07	0.01	0.02
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.94 s
Total hot run time: 30.73 s

[doris-robot]

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 89abbf7b936cfaaff50663518e4c25ab2f05c9a6 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       22.2 seconds inserted 10000000 Rows, about 450K ops/s

[doris-robot]

TeamCity be ut coverage result:
Function Coverage: 37.88% (8145/21503)
Line Coverage: 29.61% (67031/226375)
Region Coverage: 29.10% (34581/118828)
Branch Coverage: 25.01% (17819/71256)
Coverage Report: http://coverage.selectdb-in.cc/coverage/89abbf7b936cfaaff50663518e4c25ab2f05c9a6_89abbf7b936cfaaff50663518e4c25ab2f05c9a6/report/index.html

[luwei16]

run buildall

[github-actions]

clang-tidy review says "All clean, LGTM! 👍"

[doris-robot]

TPC-H: Total hot run time: 49672 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c339b834ce9b3f5778ad46a6cfb4e5b57b8dfc2b, data reload: false

------ Round 1 ----------------------------------
q1	17644	4401	4376	4376
q2	2060	189	155	155
q3	10218	1892	1966	1892
q4	10107	1241	1341	1241
q5	8473	3889	3950	3889
q6	235	124	124	124
q7	2070	1637	1620	1620
q8	9495	2724	2718	2718
q9	13909	10348	10263	10263
q10	8688	3513	3519	3513
q11	413	241	256	241
q12	465	300	301	300
q13	18354	3957	4014	3957
q14	352	324	323	323
q15	509	466	453	453
q16	657	571	568	568
q17	1124	930	945	930
q18	7217	6823	6805	6805
q19	1695	1570	1494	1494
q20	513	305	302	302
q21	4489	4120	4127	4120
q22	499	388	397	388
Total cold run time: 119186 ms
Total hot run time: 49672 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4319	4313	4282	4282
q2	321	222	220	220
q3	4179	4143	4123	4123
q4	2736	2715	2724	2715
q5	7190	7067	7117	7067
q6	239	123	121	121
q7	3219	2851	2818	2818
q8	4324	4428	4483	4428
q9	16978	16798	16775	16775
q10	4193	4253	4267	4253
q11	756	693	688	688
q12	1048	862	880	862
q13	6722	3765	3731	3731
q14	449	413	422	413
q15	493	448	466	448
q16	720	668	680	668
q17	3780	3812	3814	3812
q18	8708	8689	8669	8669
q19	1748	1636	1667	1636
q20	2349	2131	2071	2071
q21	8473	8408	8390	8390
q22	1035	917	905	905
Total cold run time: 83979 ms
Total hot run time: 79095 ms

[doris-robot]

TeamCity be ut coverage result:
Function Coverage: 37.88% (8145/21503)
Line Coverage: 29.60% (67014/226374)
Region Coverage: 29.09% (34572/118828)
Branch Coverage: 24.99% (17810/71256)
Coverage Report: http://coverage.selectdb-in.cc/coverage/c339b834ce9b3f5778ad46a6cfb4e5b57b8dfc2b_c339b834ce9b3f5778ad46a6cfb4e5b57b8dfc2b/report/index.html

[doris-robot]

TPC-DS: Total hot run time: 200963 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c339b834ce9b3f5778ad46a6cfb4e5b57b8dfc2b, data reload: false

query1	923	392	405	392
query2	6553	2222	2231	2222
query3	6921	205	204	204
query4	20646	18068	17937	17937
query5	19729	6501	6564	6501
query6	283	215	230	215
query7	4153	292	302	292
query8	258	239	227	227
query9	3127	2696	2611	2611
query10	409	332	301	301
query11	11376	10778	10778	10778
query12	125	72	75	72
query13	5605	643	647	643
query14	16994	13173	13504	13173
query15	359	221	236	221
query16	6453	283	263	263
query17	1714	1452	859	859
query18	2334	419	409	409
query19	210	154	148	148
query20	82	78	79	78
query21	189	95	98	95
query22	5332	5134	5165	5134
query23	32464	31736	31921	31736
query24	7083	6482	6444	6444
query25	520	422	416	416
query26	631	160	161	160
query27	2062	297	292	292
query28	6143	2284	2249	2249
query29	3040	2761	2738	2738
query30	237	167	163	163
query31	901	735	744	735
query32	78	61	59	59
query33	411	252	261	252
query34	835	456	483	456
query35	1093	921	953	921
query36	1207	1118	1135	1118
query37	93	58	62	58
query38	3135	2896	2942	2896
query39	1351	1311	1314	1311
query40	256	99	97	97
query41	41	38	36	36
query42	84	87	81	81
query43	621	597	632	597
query44	1110	702	723	702
query45	243	237	226	226
query46	1241	936	982	936
query47	1725	1746	1635	1635
query48	987	680	651	651
query49	633	365	367	365
query50	861	596	624	596
query51	4754	4587	4634	4587
query52	89	80	82	80
query53	442	323	317	317
query54	2644	2504	2455	2455
query55	79	87	79	79
query56	228	214	206	206
query57	1126	1029	1123	1029
query58	218	196	189	189
query59	3598	3331	3225	3225
query60	216	210	203	203
query61	97	97	97	97
query62	803	447	518	447
query63	484	340	334	334
query64	2619	1559	1454	1454
query65	3618	3559	3527	3527
query66	813	389	376	376
query67	15207	15568	17123	15568
query68	10361	664	628	628
query69	569	361	348	348
query70	1944	1434	1206	1206
query71	415	305	311	305
query72	6538	3497	3524	3497
query73	736	315	319	315
query74	6405	5863	5814	5814
query75	5452	3676	3628	3628
query76	6602	1128	1164	1128
query77	1151	248	249	248
query78	12541	11427	11714	11427
query79	7034	630	633	630
query80	1054	402	402	402
query81	495	231	231	231
query82	1167	101	94	94
query83	168	130	133	130
query84	266	71	73	71
query85	889	326	317	317
query86	327	331	299	299
query87	3242	3009	2997	2997
query88	4471	2275	2286	2275
query89	373	283	290	283
query90	1946	215	199	199
query91	165	124	123	123
query92	56	50	52	50
query93	5959	602	562	562
query94	704	203	211	203
query95	1117	1094	1046	1046
query96	637	326	318	318
query97	6450	6323	6404	6323
query98	194	171	172	171
query99	2902	838	821	821
Total cold run time: 312226 ms
Total hot run time: 200963 ms

[doris-robot]

ClickBench: Total hot run time: 30.45 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c339b834ce9b3f5778ad46a6cfb4e5b57b8dfc2b, data reload: false

query1	0.02	0.02	0.02
query2	0.06	0.03	0.03
query3	0.25	0.05	0.05
query4	1.80	0.06	0.06
query5	0.55	0.53	0.52
query6	1.22	0.62	0.61
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.54	0.48	0.48
query10	0.55	0.52	0.54
query11	0.12	0.09	0.08
query12	0.13	0.09	0.09
query13	0.60	0.62	0.61
query14	0.77	0.78	0.78
query15	0.78	0.76	0.75
query16	0.37	0.37	0.37
query17	0.96	1.01	1.00
query18	0.23	0.24	0.25
query19	1.81	1.86	1.85
query20	0.02	0.01	0.01
query21	15.48	0.55	0.53
query22	2.18	2.13	1.51
query23	17.25	1.05	0.98
query24	6.76	0.72	1.37
query25	0.35	0.13	0.04
query26	0.72	0.14	0.15
query27	0.04	0.03	0.04
query28	6.46	0.73	0.71
query29	12.63	2.41	2.36
query30	0.60	0.56	0.53
query31	2.80	0.38	0.38
query32	3.37	0.50	0.50
query33	3.08	3.04	3.06
query34	15.27	4.79	4.77
query35	4.85	4.87	4.85
query36	1.04	1.01	1.01
query37	0.06	0.04	0.04
query38	0.04	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.14	0.15
query41	0.07	0.01	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 104.1 s
Total hot run time: 30.45 s

[doris-robot]

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit c339b834ce9b3f5778ad46a6cfb4e5b57b8dfc2b with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.7 seconds inserted 10000000 Rows, about 460K ops/s