Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fix](mtmv)use name instead of id in meta of MTMV #39355

Merged
merged 13 commits into from
Aug 21, 2024
Merged

[fix](mtmv)use name instead of id in meta of MTMV #39355

merged 13 commits into from
Aug 21, 2024

Conversation

zddr
Copy link
Contributor

@zddr zddr commented Aug 14, 2024 •
edited
Loading

What is currently stored is the ID.

When the catalog is rebuilt, the ID of the catalog will change, and an error will be reported when refreshing the materialized view.

After the modification, the name is saved.

compatibility:

At startup, the appropriate name will be found based on the ID and saved.

When retrieving a table, if the name is not saved, an attempt will be made to use the ID to retrieve the table

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zddr zddr marked this pull request as draft August 14, 2024 10:04
@github-actions github-actions bot added the doing label Aug 14, 2024
@zddr
Copy link
Contributor Author

zddr commented Aug 14, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37874 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 82cab60f2c7a1b57572479af19260f3f5ce09331, data reload: false

------ Round 1 ----------------------------------
q1	17614	4321	4276	4276
q2	2010	179	172	172
q3	11781	1037	1174	1037
q4	10500	815	816	815
q5	7728	2816	2767	2767
q6	224	134	137	134
q7	944	580	605	580
q8	9535	2030	2055	2030
q9	8714	6528	6520	6520
q10	7032	2232	2280	2232
q11	463	244	238	238
q12	390	223	230	223
q13	18874	2996	2979	2979
q14	284	236	229	229
q15	522	477	498	477
q16	513	397	386	386
q17	982	688	672	672
q18	7307	6774	6708	6708
q19	6417	1152	1136	1136
q20	657	325	334	325
q21	3909	2993	2937	2937
q22	1089	1011	1001	1001
Total cold run time: 117489 ms
Total hot run time: 37874 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4406	4273	4259	4259
q2	393	277	265	265
q3	2856	2616	2623	2616
q4	2016	1738	1759	1738
q5	5633	5734	5580	5580
q6	227	136	133	133
q7	2133	1728	1748	1728
q8	3354	3429	3455	3429
q9	8826	8771	8820	8771
q10	3522	3264	3257	3257
q11	622	520	515	515
q12	784	589	631	589
q13	17090	3169	3159	3159
q14	307	299	289	289
q15	548	478	489	478
q16	538	446	475	446
q17	1838	1538	1499	1499
q18	8038	7912	7689	7689
q19	1765	1573	1636	1573
q20	2116	1902	1905	1902
q21	8045	5307	5415	5307
q22	1084	1019	1018	1018
Total cold run time: 76141 ms
Total hot run time: 56240 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190838 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 82cab60f2c7a1b57572479af19260f3f5ce09331, data reload: false

query1	1269	902	861	861
query2	6440	2060	1963	1963
query3	10627	3815	3778	3778
query4	58602	25023	23395	23395
query5	5626	502	490	490
query6	465	173	155	155
query7	6105	301	284	284
query8	280	201	202	201
query9	8844	2456	2408	2408
query10	494	258	273	258
query11	18433	15166	15222	15166
query12	156	97	98	97
query13	1576	391	375	375
query14	11701	7433	7079	7079
query15	290	172	176	172
query16	7601	520	500	500
query17	1233	585	598	585
query18	1987	302	297	297
query19	297	156	166	156
query20	133	115	113	113
query21	211	107	102	102
query22	4399	4343	4303	4303
query23	34277	33501	33287	33287
query24	5815	2900	2963	2900
query25	549	405	409	405
query26	692	162	161	161
query27	1795	276	278	276
query28	3620	2063	2042	2042
query29	711	422	430	422
query30	351	158	153	153
query31	915	758	760	758
query32	85	55	57	55
query33	420	293	296	293
query34	845	471	483	471
query35	802	749	718	718
query36	1112	957	945	945
query37	136	83	81	81
query38	3919	3841	3899	3841
query39	1440	1397	1395	1395
query40	203	123	122	122
query41	49	46	45	45
query42	127	96	99	96
query43	519	500	486	486
query44	1085	739	734	734
query45	193	164	167	164
query46	1096	729	754	729
query47	1850	1770	1780	1770
query48	367	299	295	295
query49	808	432	442	432
query50	807	412	417	412
query51	6810	6718	6750	6718
query52	104	97	91	91
query53	253	182	181	181
query54	569	458	457	457
query55	78	74	75	74
query56	266	248	257	248
query57	1135	1058	1042	1042
query58	226	220	236	220
query59	2963	2950	2995	2950
query60	315	267	269	267
query61	102	93	94	93
query62	732	670	625	625
query63	212	187	184	184
query64	3273	1797	1740	1740
query65	3217	3180	3144	3144
query66	674	337	333	333
query67	15327	14950	14916	14916
query68	6063	547	549	547
query69	626	283	304	283
query70	1216	1147	1073	1073
query71	520	282	274	274
query72	7547	2309	2064	2064
query73	807	321	317	317
query74	9195	8796	8682	8682
query75	5161	2691	2672	2672
query76	4126	1100	981	981
query77	741	322	313	313
query78	10042	9043	9219	9043
query79	8384	524	529	524
query80	1242	491	486	486
query81	590	235	227	227
query82	981	142	132	132
query83	339	148	145	145
query84	272	72	75	72
query85	1572	292	274	274
query86	366	302	294	294
query87	4493	4242	4224	4224
query88	4402	2327	2293	2293
query89	534	285	284	284
query90	1873	191	195	191
query91	125	97	94	94
query92	58	49	48	48
query93	6169	539	531	531
query94	708	286	285	285
query95	336	252	253	252
query96	611	268	266	266
query97	3224	3013	3034	3013
query98	220	196	201	196
query99	1551	1249	1251	1249
Total cold run time: 331707 ms
Total hot run time: 190838 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.92 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 82cab60f2c7a1b57572479af19260f3f5ce09331, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.07	0.07
query5	0.50	0.48	0.47
query6	1.12	0.72	0.72
query7	0.02	0.02	0.01
query8	0.04	0.04	0.04
query9	0.54	0.48	0.48
query10	0.56	0.54	0.55
query11	0.16	0.11	0.11
query12	0.15	0.12	0.12
query13	0.61	0.59	0.58
query14	0.75	0.80	0.77
query15	0.85	0.83	0.81
query16	0.35	0.36	0.37
query17	0.96	0.97	1.06
query18	0.23	0.22	0.21
query19	1.84	1.84	1.86
query20	0.02	0.01	0.01
query21	15.38	0.76	0.67
query22	3.74	6.05	2.87
query23	18.29	1.39	1.45
query24	2.11	0.22	0.21
query25	0.16	0.08	0.07
query26	0.30	0.21	0.21
query27	0.46	0.22	0.22
query28	13.30	1.03	0.99
query29	12.63	3.39	3.34
query30	0.23	0.05	0.05
query31	2.90	0.39	0.39
query32	3.28	0.48	0.48
query33	2.99	2.93	2.94
query34	16.99	4.40	4.38
query35	4.46	4.44	4.46
query36	0.65	0.46	0.47
query37	0.19	0.17	0.15
query38	0.16	0.15	0.15
query39	0.05	0.03	0.04
query40	0.15	0.13	0.14
query41	0.10	0.05	0.04
query42	0.06	0.05	0.04
query43	0.04	0.04	0.04
Total cold run time: 109.34 s
Total hot run time: 31.92 s

@zddr zddr marked this pull request as ready for review August 15, 2024 07:09
@zddr
Copy link
Contributor Author

zddr commented Aug 15, 2024

run buildall

@zddr zddr changed the title 1 [fix](mtmv)use name instead of id in meta of MTMV Aug 15, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 38249 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6f6917f6507a60cae761d43753dfa231e4112968, data reload: false

------ Round 1 ----------------------------------
q1	17907	4817	4296	4296
q2	2053	207	210	207
q3	11738	1113	1226	1113
q4	10541	808	757	757
q5	7802	2821	2744	2744
q6	257	156	153	153
q7	989	631	615	615
q8	9576	2067	2103	2067
q9	8859	6581	6570	6570
q10	7062	2203	2221	2203
q11	499	267	264	264
q12	419	252	252	252
q13	17782	3023	3001	3001
q14	298	261	254	254
q15	580	539	544	539
q16	526	414	415	414
q17	981	700	727	700
q18	7431	6789	6928	6789
q19	6755	1053	1025	1025
q20	719	341	371	341
q21	3862	2912	3058	2912
q22	1118	1033	1045	1033
Total cold run time: 117754 ms
Total hot run time: 38249 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4508	4275	4277	4275
q2	391	284	290	284
q3	2897	2606	2781	2606
q4	2022	1688	1726	1688
q5	5609	5708	5631	5631
q6	251	156	156	156
q7	2200	1771	1790	1771
q8	3335	3528	3450	3450
q9	8827	8748	8723	8723
q10	3661	3366	3241	3241
q11	628	547	540	540
q12	866	686	663	663
q13	15925	3242	3081	3081
q14	314	294	288	288
q15	563	515	526	515
q16	490	449	471	449
q17	1842	1599	1547	1547
q18	8196	7832	7746	7746
q19	2971	1608	1644	1608
q20	2167	1933	1898	1898
q21	14836	5374	5317	5317
q22	1181	1078	1087	1078
Total cold run time: 83680 ms
Total hot run time: 56555 ms

@zddr
Copy link
Contributor Author

zddr commented Aug 16, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38574 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 18a34f477b2358a9c02e843fe1a92a81de6ec742, data reload: false

------ Round 1 ----------------------------------
q1	18551	4586	4437	4437
q2	2646	213	226	213
q3	11770	1279	1251	1251
q4	11223	892	801	801
q5	8150	2942	2851	2851
q6	273	167	157	157
q7	986	649	657	649
q8	9385	2108	2089	2089
q9	7309	6591	6606	6591
q10	7083	2254	2270	2254
q11	483	256	260	256
q12	419	246	242	242
q13	17783	2980	3035	2980
q14	306	253	250	250
q15	552	504	527	504
q16	525	404	402	402
q17	993	702	705	702
q18	7450	6829	6866	6829
q19	4467	1028	1021	1021
q20	683	350	353	350
q21	3795	2799	2729	2729
q22	1125	1016	1022	1016
Total cold run time: 115957 ms
Total hot run time: 38574 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4560	4331	4342	4331
q2	412	299	307	299
q3	2859	2618	2653	2618
q4	1916	1565	1639	1565
q5	5429	5430	5396	5396
q6	238	144	142	142
q7	2091	1658	1673	1658
q8	3239	3363	3366	3363
q9	8458	8424	8414	8414
q10	3427	3191	3187	3187
q11	617	514	508	508
q12	806	627	653	627
q13	17294	3013	2998	2998
q14	333	293	279	279
q15	558	511	519	511
q16	484	442	448	442
q17	1812	1503	1492	1492
q18	7589	7446	7462	7446
q19	1728	1581	1552	1552
q20	2002	1794	1820	1794
q21	5327	5177	5105	5105
q22	1148	1027	1032	1027
Total cold run time: 72327 ms
Total hot run time: 54754 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190582 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 18a34f477b2358a9c02e843fe1a92a81de6ec742, data reload: false

query1	953	400	389	389
query2	6727	1929	1949	1929
query3	6672	229	242	229
query4	33988	23778	23366	23366
query5	4411	635	634	634
query6	302	193	202	193
query7	4616	312	309	309
query8	410	359	365	359
query9	8583	2478	2464	2464
query10	476	326	330	326
query11	17668	15077	15130	15077
query12	168	127	123	123
query13	1678	434	410	410
query14	9869	7311	6828	6828
query15	320	188	189	188
query16	8150	496	470	470
query17	1719	592	579	579
query18	2087	338	335	335
query19	345	175	167	167
query20	144	136	132	132
query21	254	149	139	139
query22	4362	4119	4076	4076
query23	34174	33760	33415	33415
query24	11126	2875	2882	2875
query25	626	424	407	407
query26	884	182	175	175
query27	2082	302	304	302
query28	6215	2125	2136	2125
query29	805	452	443	443
query30	338	192	178	178
query31	1066	858	838	838
query32	128	112	81	81
query33	820	341	341	341
query34	925	513	491	491
query35	909	748	759	748
query36	1156	959	937	937
query37	154	104	100	100
query38	3972	3909	3811	3811
query39	1512	1515	1476	1476
query40	235	158	153	153
query41	141	140	138	138
query42	132	116	119	116
query43	536	500	520	500
query44	1294	792	786	786
query45	222	196	206	196
query46	1170	770	801	770
query47	1914	1868	1843	1843
query48	420	342	346	342
query49	1183	607	580	580
query50	867	459	463	459
query51	6929	6749	6705	6705
query52	122	110	108	108
query53	304	229	229	229
query54	1075	506	497	497
query55	90	89	87	87
query56	335	311	315	311
query57	1232	1132	1131	1131
query58	308	310	305	305
query59	2979	2703	2864	2703
query60	353	326	327	326
query61	154	147	151	147
query62	892	736	695	695
query63	270	228	228	228
query64	5054	2429	1878	1878
query65	3239	3297	3207	3207
query66	1100	675	677	675
query67	15671	15014	14913	14913
query68	8203	611	609	609
query69	743	421	357	357
query70	1263	1161	1179	1161
query71	574	314	323	314
query72	7540	2360	2078	2078
query73	1231	365	359	359
query74	9378	8807	8970	8807
query75	4735	2747	2766	2747
query76	4958	1115	1010	1010
query77	881	448	442	442
query78	9867	9120	9028	9028
query79	8663	553	552	552
query80	2575	628	666	628
query81	634	259	260	259
query82	816	157	158	157
query83	338	216	215	215
query84	300	100	100	100
query85	1395	367	356	356
query86	419	337	324	324
query87	4499	4352	4213	4213
query88	5308	2535	2519	2519
query89	563	329	338	329
query90	2064	238	229	229
query91	154	128	128	128
query92	92	77	77	77
query93	6505	555	548	548
query94	963	320	320	320
query95	393	294	297	294
query96	643	290	284	284
query97	3266	3106	3103	3103
query98	251	232	245	232
query99	1639	1327	1310	1310
Total cold run time: 319868 ms
Total hot run time: 190582 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.59 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 18a34f477b2358a9c02e843fe1a92a81de6ec742, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.06	0.05
query4	1.66	0.07	0.07
query5	0.53	0.49	0.50
query6	1.14	0.73	0.72
query7	0.02	0.01	0.01
query8	0.06	0.04	0.05
query9	0.55	0.49	0.49
query10	0.55	0.56	0.55
query11	0.16	0.12	0.12
query12	0.16	0.13	0.14
query13	0.61	0.60	0.59
query14	0.77	0.80	0.78
query15	0.87	0.83	0.83
query16	0.38	0.38	0.38
query17	1.04	1.02	1.07
query18	0.22	0.21	0.22
query19	1.83	1.69	1.68
query20	0.01	0.01	0.02
query21	15.40	0.82	0.65
query22	4.59	6.30	2.46
query23	18.28	1.37	1.28
query24	2.08	0.23	0.23
query25	0.15	0.09	0.08
query26	0.30	0.21	0.20
query27	0.46	0.22	0.22
query28	13.33	1.04	1.01
query29	12.64	3.33	3.27
query30	0.40	0.19	0.19
query31	2.81	0.41	0.40
query32	3.24	0.50	0.48
query33	2.98	2.95	2.97
query34	17.13	4.38	4.34
query35	4.45	4.40	4.48
query36	0.68	0.47	0.50
query37	0.21	0.17	0.18
query38	0.16	0.16	0.16
query39	0.06	0.05	0.05
query40	0.18	0.16	0.15
query41	0.10	0.07	0.06
query42	0.08	0.07	0.07
query43	0.06	0.05	0.05
Total cold run time: 110.69 s
Total hot run time: 31.59 s

morrySnow
morrySnow previously approved these changes Aug 16, 2024
View reviewed changes
@zddr zddr requested a review from morrySnow August 19, 2024 07:32
@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 19, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 37955 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c5b317afdae2af2d37d5012d287cf853582799af, data reload: false

------ Round 1 ----------------------------------
q1	17848	4387	4316	4316
q2	2057	209	203	203
q3	11813	1116	1168	1116
q4	10525	751	772	751
q5	7800	2848	2814	2814
q6	263	157	156	156
q7	1019	660	636	636
q8	9590	2061	2113	2061
q9	8716	6512	6534	6512
q10	7060	2239	2203	2203
q11	471	264	268	264
q12	426	253	256	253
q13	17791	3009	2999	2999
q14	312	255	256	255
q15	562	537	534	534
q16	539	405	409	405
q17	970	601	729	601
q18	7411	6778	6744	6744
q19	6452	1080	1028	1028
q20	701	333	339	333
q21	3875	2852	2776	2776
q22	1131	995	1020	995
Total cold run time: 117332 ms
Total hot run time: 37955 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4560	4278	4329	4278
q2	418	306	299	299
q3	2787	2660	2616	2616
q4	1994	1736	1757	1736
q5	5645	5719	5656	5656
q6	233	149	160	149
q7	2168	1781	1734	1734
q8	3274	3471	3467	3467
q9	8772	8692	8750	8692
q10	3590	3337	3317	3317
q11	612	539	543	539
q12	837	672	665	665
q13	17207	3152	3161	3152
q14	320	300	290	290
q15	551	506	510	506
q16	494	443	456	443
q17	1815	1527	1539	1527
q18	8502	7836	7635	7635
q19	6855	1656	1572	1572
q20	2193	1881	1895	1881
q21	13719	5186	5364	5186
q22	1146	1091	1055	1055
Total cold run time: 87692 ms
Total hot run time: 56395 ms

@zddr
Copy link
Contributor Author

zddr commented Aug 19, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38319 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c5b317afdae2af2d37d5012d287cf853582799af, data reload: false

------ Round 1 ----------------------------------
q1	17944	4638	4292	4292
q2	2039	202	227	202
q3	10442	1152	1121	1121
q4	10169	793	796	793
q5	7764	2759	2801	2759
q6	261	157	161	157
q7	1018	673	659	659
q8	9407	2108	2071	2071
q9	7168	6569	6566	6566
q10	7096	2205	2231	2205
q11	496	275	279	275
q12	452	253	257	253
q13	18034	2993	3025	2993
q14	310	266	267	266
q15	564	530	538	530
q16	535	408	412	408
q17	987	667	657	657
q18	7409	6822	6869	6822
q19	6826	1024	1052	1024
q20	716	368	347	347
q21	3809	2875	3078	2875
q22	1181	1044	1047	1044
Total cold run time: 114627 ms
Total hot run time: 38319 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5022	4326	4305	4305
q2	419	328	307	307
q3	2876	2669	2591	2591
q4	1963	1742	1713	1713
q5	5634	5642	5645	5642
q6	245	152	151	151
q7	2233	1784	1777	1777
q8	3293	3400	3364	3364
q9	8692	8714	8714	8714
q10	3533	3284	3352	3284
q11	632	531	510	510
q12	824	687	671	671
q13	16488	3160	3171	3160
q14	339	311	312	311
q15	571	529	524	524
q16	517	456	462	456
q17	1817	1544	1533	1533
q18	8168	7955	7517	7517
q19	1796	1513	1617	1513
q20	2408	1915	1893	1893
q21	10900	5357	5402	5357
q22	1312	1113	1045	1045
Total cold run time: 79682 ms
Total hot run time: 56338 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190115 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c5b317afdae2af2d37d5012d287cf853582799af, data reload: false

query1	885	406	388	388
query2	6731	1997	1862	1862
query3	6425	230	245	230
query4	29130	23418	23241	23241
query5	4373	727	718	718
query6	301	218	221	218
query7	4428	333	324	324
query8	473	434	430	430
query9	8486	2529	2511	2511
query10	512	354	346	346
query11	17829	15057	15212	15057
query12	186	138	137	137
query13	1627	467	433	433
query14	9616	6721	6677	6677
query15	238	193	196	193
query16	7385	548	482	482
query17	1159	586	580	580
query18	2012	337	333	333
query19	223	164	166	164
query20	143	137	133	133
query21	249	142	141	141
query22	4244	4051	4065	4051
query23	34163	33145	33187	33145
query24	12224	2897	2887	2887
query25	736	417	420	417
query26	1851	177	180	177
query27	2888	303	306	303
query28	7668	2126	2092	2092
query29	1267	453	452	452
query30	326	193	187	187
query31	1077	880	835	835
query32	123	82	80	80
query33	814	351	343	343
query34	902	505	492	492
query35	890	761	777	761
query36	1139	981	982	981
query37	220	106	105	105
query38	3950	3894	3952	3894
query39	1541	1470	1449	1449
query40	311	157	153	153
query41	142	141	153	141
query42	133	117	118	117
query43	529	509	511	509
query44	1274	779	802	779
query45	224	198	195	195
query46	1118	772	754	754
query47	1937	1837	1854	1837
query48	409	331	335	331
query49	1266	588	584	584
query50	860	474	460	460
query51	6967	6750	6793	6750
query52	125	107	118	107
query53	303	225	230	225
query54	1044	499	495	495
query55	91	87	89	87
query56	339	314	305	305
query57	1233	1139	1177	1139
query58	353	340	348	340
query59	2992	2765	2843	2765
query60	347	335	330	330
query61	151	152	148	148
query62	867	702	702	702
query63	267	233	227	227
query64	6491	2395	1854	1854
query65	3251	3198	3169	3169
query66	1749	677	660	660
query67	15420	14820	14691	14691
query68	6572	585	573	573
query69	680	403	325	325
query70	1246	1203	1114	1114
query71	575	314	314	314
query72	7253	2296	2094	2094
query73	856	355	356	355
query74	9756	8869	8896	8869
query75	4355	2746	2726	2726
query76	4603	1025	972	972
query77	827	436	438	436
query78	10181	9185	9251	9185
query79	8755	554	552	552
query80	1472	609	603	603
query81	601	255	258	255
query82	804	159	157	157
query83	267	217	216	216
query84	291	97	99	97
query85	1383	363	353	353
query86	396	311	317	311
query87	4485	4212	4240	4212
query88	5355	2493	2481	2481
query89	557	330	322	322
query90	1937	232	230	230
query91	160	127	127	127
query92	92	74	74	74
query93	6888	552	545	545
query94	773	327	308	308
query95	392	289	288	288
query96	632	289	289	289
query97	3236	3172	3086	3086
query98	258	226	225	225
query99	1648	1318	1323	1318
Total cold run time: 315913 ms
Total hot run time: 190115 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.05 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c5b317afdae2af2d37d5012d287cf853582799af, data reload: false

query1	0.04	0.05	0.04
query2	0.08	0.04	0.05
query3	0.23	0.05	0.05
query4	1.68	0.08	0.08
query5	0.50	0.50	0.49
query6	1.13	0.72	0.73
query7	0.02	0.01	0.02
query8	0.06	0.05	0.04
query9	0.55	0.50	0.49
query10	0.54	0.54	0.54
query11	0.16	0.12	0.12
query12	0.15	0.13	0.13
query13	0.62	0.59	0.59
query14	0.78	0.78	0.78
query15	0.85	0.82	0.83
query16	0.38	0.36	0.38
query17	1.01	0.95	0.96
query18	0.22	0.21	0.21
query19	1.77	1.71	1.75
query20	0.01	0.01	0.02
query21	15.39	0.68	0.67
query22	3.70	7.84	2.01
query23	18.26	1.46	1.32
query24	2.18	0.22	0.23
query25	0.16	0.09	0.08
query26	0.27	0.18	0.18
query27	0.08	0.08	0.08
query28	13.26	1.04	1.01
query29	12.65	3.30	3.30
query30	0.43	0.19	0.20
query31	2.81	0.40	0.39
query32	3.25	0.48	0.49
query33	2.97	2.95	2.97
query34	17.14	4.36	4.40
query35	4.40	4.41	4.49
query36	0.68	0.49	0.48
query37	0.21	0.18	0.17
query38	0.18	0.17	0.17
query39	0.07	0.06	0.05
query40	0.18	0.16	0.15
query41	0.12	0.07	0.07
query42	0.08	0.07	0.07
query43	0.07	0.06	0.06
Total cold run time: 109.32 s
Total hot run time: 31.05 s

@zddr
Copy link
Contributor Author

zddr commented Aug 20, 2024

run p0

@zddr
Copy link
Contributor Author

zddr commented Aug 20, 2024

run cloud_p1

@zddr
Copy link
Contributor Author

zddr commented Aug 20, 2024

run buildall

@zddr
Copy link
Contributor Author

zddr commented Aug 21, 2024

run performance

@doris-robot
Copy link

TPC-H: Total hot run time: 38107 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dc9c143303e9670192eb5340a026873076b5573c, data reload: false

------ Round 1 ----------------------------------
q1	17993	4445	4384	4384
q2	2062	208	216	208
q3	10427	1111	1052	1052
q4	10172	806	780	780
q5	7756	2837	2815	2815
q6	264	162	163	162
q7	1007	667	657	657
q8	9367	2085	2075	2075
q9	7319	6533	6523	6523
q10	7048	2286	2193	2193
q11	522	260	270	260
q12	431	256	260	256
q13	18729	3015	3007	3007
q14	300	262	249	249
q15	564	521	555	521
q16	517	412	406	406
q17	975	754	670	670
q18	7396	6771	6742	6742
q19	6227	1015	968	968
q20	730	342	348	342
q21	3840	2806	2954	2806
q22	1133	1075	1031	1031
Total cold run time: 114779 ms
Total hot run time: 38107 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4525	4296	4323	4296
q2	410	309	295	295
q3	2865	2664	2606	2606
q4	1885	1672	1635	1635
q5	5367	5400	5356	5356
q6	233	154	157	154
q7	2116	1719	1720	1719
q8	3256	3370	3364	3364
q9	8421	8385	8418	8385
q10	3424	3192	3147	3147
q11	629	532	537	532
q12	806	643	616	616
q13	16511	3047	3047	3047
q14	319	295	302	295
q15	585	534	525	525
q16	514	456	459	456
q17	1813	1511	1481	1481
q18	7767	7618	7523	7523
q19	1722	1528	1533	1528
q20	2025	1839	1858	1839
q21	9012	5199	5179	5179
q22	1128	1099	1034	1034
Total cold run time: 75333 ms
Total hot run time: 55012 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191857 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dc9c143303e9670192eb5340a026873076b5573c, data reload: false

query1	990	411	389	389
query2	6736	2036	1976	1976
query3	6666	240	236	236
query4	24650	23178	23369	23178
query5	4473	733	712	712
query6	324	214	209	209
query7	4615	340	335	335
query8	488	439	429	429
query9	8603	2532	2539	2532
query10	519	355	359	355
query11	16907	15228	15182	15182
query12	186	143	144	143
query13	1715	453	461	453
query14	9584	7272	7001	7001
query15	304	204	190	190
query16	7887	555	537	537
query17	1638	602	601	601
query18	2136	341	344	341
query19	311	197	175	175
query20	141	137	135	135
query21	250	143	144	143
query22	4229	4116	3961	3961
query23	34002	33387	33291	33291
query24	11608	2953	2941	2941
query25	629	423	425	423
query26	732	181	180	180
query27	2061	304	307	304
query28	6221	2156	2116	2116
query29	761	463	455	455
query30	347	192	185	185
query31	1055	843	832	832
query32	123	83	84	83
query33	836	341	342	341
query34	895	526	526	526
query35	896	771	763	763
query36	1138	972	959	959
query37	160	102	103	102
query38	4012	3932	3878	3878
query39	1515	1465	1454	1454
query40	236	156	166	156
query41	144	139	138	138
query42	132	120	120	120
query43	544	492	512	492
query44	1279	800	797	797
query45	230	197	200	197
query46	1139	829	789	789
query47	1880	1799	1835	1799
query48	405	347	340	340
query49	1222	582	585	582
query50	887	477	461	461
query51	7218	7142	7061	7061
query52	124	110	113	110
query53	304	234	227	227
query54	935	512	508	508
query55	92	91	91	91
query56	332	314	319	314
query57	1211	1121	1108	1108
query58	313	298	319	298
query59	3222	2929	3043	2929
query60	354	334	341	334
query61	151	148	146	146
query62	861	724	700	700
query63	258	228	235	228
query64	5056	2406	1857	1857
query65	3262	3212	3175	3175
query66	1180	685	720	685
query67	15583	15003	14966	14966
query68	5508	598	597	597
query69	709	403	345	345
query70	1152	1144	1165	1144
query71	524	320	317	317
query72	7557	2343	2097	2097
query73	836	364	363	363
query74	9191	8815	8863	8815
query75	4533	2773	2744	2744
query76	3672	1107	1098	1098
query77	861	504	433	433
query78	9803	9036	9103	9036
query79	8655	565	566	565
query80	1140	629	603	603
query81	620	263	266	263
query82	805	162	163	162
query83	363	214	231	214
query84	302	104	99	99
query85	1390	357	354	354
query86	409	342	335	335
query87	4462	4292	4246	4246
query88	4467	2519	2547	2519
query89	559	336	331	331
query90	1986	239	237	237
query91	192	128	132	128
query92	87	79	75	75
query93	6714	576	565	565
query94	847	316	324	316
query95	388	301	298	298
query96	622	284	285	284
query97	3218	3065	3076	3065
query98	262	233	228	228
query99	1612	1337	1327	1327
Total cold run time: 302343 ms
Total hot run time: 191857 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.72 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dc9c143303e9670192eb5340a026873076b5573c, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.06	0.04
query4	1.68	0.08	0.08
query5	0.49	0.50	0.51
query6	1.15	0.72	0.73
query7	0.01	0.02	0.01
query8	0.06	0.05	0.06
query9	0.54	0.51	0.49
query10	0.56	0.55	0.55
query11	0.17	0.13	0.12
query12	0.15	0.13	0.14
query13	0.63	0.60	0.60
query14	0.78	0.80	0.77
query15	0.84	0.82	0.83
query16	0.37	0.38	0.37
query17	1.01	1.05	1.05
query18	0.22	0.21	0.20
query19	1.78	1.82	1.67
query20	0.02	0.02	0.01
query21	15.43	0.66	0.66
query22	4.43	8.26	1.31
query23	18.26	1.37	1.37
query24	2.20	0.21	0.23
query25	0.15	0.09	0.08
query26	0.28	0.19	0.18
query27	0.07	0.08	0.08
query28	13.19	1.04	1.01
query29	12.66	3.39	3.38
query30	0.43	0.24	0.24
query31	2.80	0.42	0.41
query32	3.24	0.50	0.49
query33	3.01	3.00	3.00
query34	17.18	4.37	4.43
query35	4.40	4.42	4.43
query36	0.68	0.50	0.49
query37	0.22	0.18	0.18
query38	0.18	0.17	0.17
query39	0.06	0.06	0.06
query40	0.18	0.15	0.15
query41	0.12	0.08	0.07
query42	0.07	0.07	0.07
query43	0.07	0.06	0.07
Total cold run time: 110.13 s
Total hot run time: 30.72 s

@morrySnow morrySnow merged commit ac3e2e1 into apache:master Aug 21, 2024
27 of 28 checks passed
@wm1581066 wm1581066 added the usercase Important user case type label label Aug 21, 2024
zddr added a commit to zddr/incubator-doris that referenced this pull request Aug 22, 2024
@zddr
[fix](mtmv) use name instead of id in meta of MTMV (apache#39355)
0f0e0d5 
What is currently stored is the ID.

When the catalog is rebuilt, the ID of the catalog will change, and an
error will be reported when refreshing the materialized view.

After the modification, the name is saved.

compatibility:

At startup, the appropriate name will be found based on the ID and
saved.

When retrieving a table, if the name is not saved, an attempt will be
made to use the ID to retrieve the table
@zddr zddr mentioned this pull request Aug 22, 2024
Merged
morrySnow pushed a commit that referenced this pull request Aug 23, 2024
@zddr
[fix](mtmv) use name instead of id in meta of MTMV (#39355) (#39748)
19c51cc 
pick from master #39355
dataroaring pushed a commit that referenced this pull request Aug 26, 2024
@zddr @dataroaring
[fix](mtmv) use name instead of id in meta of MTMV (#39355)
285068f 
What is currently stored is the ID. 

When the catalog is rebuilt, the ID of the catalog will change, and an
error will be reported when refreshing the materialized view.

After the modification, the name is saved.

compatibility:

At startup, the appropriate name will be found based on the ID and
saved.

When retrieving a table, if the name is not saved, an attempt will be
made to use the ID to retrieve the table
@yiguolei yiguolei mentioned this pull request Sep 5, 2024
Open
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@morningman morningman morningman approved these changes

@morrySnow morrySnow morrySnow approved these changes

@dataroaring dataroaring Awaiting requested review from dataroaring dataroaring is a code owner

@CalvinKirs CalvinKirs Awaiting requested review from CalvinKirs CalvinKirs is a code owner

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.6-merged dev/3.0.2-merged doing reviewed usercase Important user case type label
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@zddr @doris-robot @morningman @morrySnow @wm1581066 @dataroaring