[Feat](Nereids) support analyze database/table command #48031

xiedeyantu · 2025-02-18T11:41:25Z

What problem does this PR solve?

Issue Number: close #42706 #42705

Problem Summary:

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

hello-stephen · 2025-02-18T11:41:32Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

xiedeyantu · 2025-02-18T11:45:25Z

run buildall

xiedeyantu · 2025-02-18T14:46:03Z

run buildall

doris-robot · 2025-02-18T15:06:18Z

TPC-H: Total hot run time: 31522 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5ab54f63ec2fa00ca4cba335ac5cba174ab9f9af, data reload: false

------ Round 1 ----------------------------------
q1	14457	5119	5045	5045
q2	1873	295	167	167
q3	10081	1386	701	701
q4	9986	1007	534	534
q5	4861	2314	2435	2314
q6	188	166	137	137
q7	915	768	609	609
q8	5862	1295	1130	1130
q9	4674	4769	4722	4722
q10	5132	2320	1869	1869
q11	401	281	255	255
q12	316	354	221	221
q13	3618	3722	3085	3085
q14	226	224	215	215
q15	515	483	464	464
q16	613	621	575	575
q17	556	886	361	361
q18	6489	6320	6095	6095
q19	662	946	526	526
q20	298	319	194	194
q21	2799	2170	1989	1989
q22	359	329	314	314
Total cold run time: 74881 ms
Total hot run time: 31522 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5137	5102	5172	5102
q2	239	329	230	230
q3	2171	2703	2295	2295
q4	1454	1857	1376	1376
q5	4253	4170	4180	4170
q6	206	161	122	122
q7	1890	1803	1658	1658
q8	2531	2602	2545	2545
q9	6871	6786	6810	6786
q10	2876	3092	2642	2642
q11	580	497	478	478
q12	684	743	576	576
q13	3316	3684	3116	3116
q14	277	277	260	260
q15	508	454	463	454
q16	614	661	628	628
q17	1100	1586	1284	1284
q18	7160	7063	6899	6899
q19	762	758	863	758
q20	1924	2018	1800	1800
q21	5240	4767	4717	4717
q22	625	563	546	546
Total cold run time: 50418 ms
Total hot run time: 48442 ms

doris-robot · 2025-02-18T15:17:43Z

TPC-DS: Total hot run time: 183253 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5ab54f63ec2fa00ca4cba335ac5cba174ab9f9af, data reload: false

query1	980	381	374	374
query2	6511	1901	1887	1887
query3	6802	215	221	215
query4	26650	23401	23321	23321
query5	5408	651	468	468
query6	279	200	170	170
query7	4606	500	299	299
query8	301	245	234	234
query9	8651	2525	2533	2525
query10	503	318	264	264
query11	15716	15163	14914	14914
query12	163	108	101	101
query13	1662	520	412	412
query14	11483	6632	6354	6354
query15	242	186	180	180
query16	7715	600	472	472
query17	1550	747	563	563
query18	1990	396	298	298
query19	221	180	157	157
query20	127	115	108	108
query21	211	122	101	101
query22	4351	4303	4244	4244
query23	33829	32807	33020	32807
query24	6945	2397	2394	2394
query25	491	451	382	382
query26	1206	271	151	151
query27	2010	487	329	329
query28	3937	2409	2420	2409
query29	736	569	416	416
query30	227	182	163	163
query31	931	827	778	778
query32	75	60	59	59
query33	588	342	314	314
query34	778	846	492	492
query35	800	809	718	718
query36	971	971	885	885
query37	115	93	78	78
query38	4173	4304	4134	4134
query39	1497	1386	1378	1378
query40	207	111	106	106
query41	57	54	49	49
query42	117	109	102	102
query43	516	511	489	489
query44	1323	797	802	797
query45	170	164	160	160
query46	861	1029	639	639
query47	1730	1789	1714	1714
query48	388	394	293	293
query49	790	505	424	424
query50	694	724	415	415
query51	4134	4213	4072	4072
query52	106	106	96	96
query53	233	248	188	188
query54	481	481	396	396
query55	81	79	82	79
query56	256	264	254	254
query57	1162	1130	1031	1031
query58	243	252	257	252
query59	2587	2632	2660	2632
query60	277	261	252	252
query61	120	116	113	113
query62	786	739	652	652
query63	250	184	192	184
query64	4304	981	647	647
query65	3225	3148	3124	3124
query66	1012	455	302	302
query67	15985	15688	15356	15356
query68	7244	749	495	495
query69	458	294	255	255
query70	1198	1102	1091	1091
query71	395	287	254	254
query72	5651	3610	3696	3610
query73	731	726	364	364
query74	9001	8904	8997	8904
query75	3170	3209	2681	2681
query76	3193	1166	739	739
query77	466	358	283	283
query78	10162	10232	9172	9172
query79	2109	811	602	602
query80	1214	528	466	466
query81	563	275	261	261
query82	436	121	98	98
query83	177	176	160	160
query84	245	84	77	77
query85	751	350	297	297
query86	379	315	285	285
query87	4479	4458	4366	4366
query88	2856	2230	2213	2213
query89	392	319	296	296
query90	1896	198	194	194
query91	135	190	111	111
query92	70	64	54	54
query93	1523	1033	574	574
query94	723	403	284	284
query95	354	271	262	262
query96	479	554	267	267
query97	2779	2927	2716	2716
query98	231	209	198	198
query99	1310	1412	1258	1258
Total cold run time: 272296 ms
Total hot run time: 183253 ms

doris-robot · 2025-02-18T15:23:01Z

ClickBench: Total hot run time: 29.95 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5ab54f63ec2fa00ca4cba335ac5cba174ab9f9af, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.03	0.03
query3	0.23	0.07	0.06
query4	1.63	0.09	0.10
query5	0.42	0.42	0.41
query6	1.15	0.68	0.66
query7	0.02	0.02	0.02
query8	0.04	0.04	0.03
query9	0.59	0.53	0.52
query10	0.57	0.59	0.58
query11	0.15	0.10	0.10
query12	0.14	0.11	0.10
query13	0.62	0.60	0.60
query14	2.68	2.71	2.71
query15	0.94	0.87	0.85
query16	0.38	0.38	0.37
query17	1.02	1.01	1.07
query18	0.22	0.20	0.20
query19	1.94	1.82	1.98
query20	0.02	0.01	0.01
query21	15.36	0.89	0.54
query22	0.74	1.15	0.62
query23	15.05	1.41	0.60
query24	12.30	0.93	0.30
query25	0.34	0.14	0.06
query26	0.49	0.19	0.14
query27	0.05	0.04	0.04
query28	6.05	0.82	0.44
query29	12.54	4.00	3.32
query30	0.25	0.09	0.06
query31	2.82	0.57	0.38
query32	3.22	0.54	0.46
query33	2.97	3.06	3.03
query34	15.76	5.11	4.47
query35	4.52	4.50	4.52
query36	0.65	0.49	0.49
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.17	0.14	0.12
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 106.47 s
Total hot run time: 29.95 s

starocean999 · 2025-02-19T02:52:25Z

fe/fe-core/src/main/java/org/apache/doris/nereids/parser/LogicalPlanBuilder.java

+        }
+        Map<String, String> propertiesMap = new HashMap<>();
+        // default values
+        propertiesMap.put(AnalyzeProperties.PROPERTY_SYNC, "false");


why need set PROPERTY_SYNC to false as default value?

why need set PROPERTY_SYNC to false as default value?

old planner need this as default value.

starocean999 · 2025-02-19T02:53:02Z

fe/fe-core/src/main/java/org/apache/doris/nereids/parser/LogicalPlanBuilder.java

+
+        Map<String, String> propertiesMap = new HashMap<>();
+        // default values
+        propertiesMap.put(AnalyzeProperties.PROPERTY_SYNC, "false");


why need set PROPERTY_SYNC to false as default value?

why need set PROPERTY_SYNC to false as default value?

old planner need this as default value.

fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisManager.java

xiedeyantu · 2025-02-19T12:18:31Z

run buildall

doris-robot · 2025-02-19T12:42:47Z

TPC-H: Total hot run time: 31541 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b2b0e989f088303a1863c56df83b511a28942047, data reload: false

------ Round 1 ----------------------------------
q1	17636	5340	5111	5111
q2	2052	296	173	173
q3	10421	1289	715	715
q4	10214	995	533	533
q5	8020	2557	2248	2248
q6	187	166	136	136
q7	907	735	611	611
q8	9318	1349	1189	1189
q9	4890	4814	4580	4580
q10	6839	2320	1885	1885
q11	485	277	269	269
q12	357	359	228	228
q13	17748	3699	3044	3044
q14	230	221	216	216
q15	512	464	452	452
q16	622	602	572	572
q17	580	875	356	356
q18	6760	6273	6270	6270
q19	1073	971	529	529
q20	307	320	195	195
q21	3292	2130	1925	1925
q22	364	325	304	304
Total cold run time: 102814 ms
Total hot run time: 31541 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5137	5130	5127	5127
q2	234	334	227	227
q3	2160	2698	2301	2301
q4	1452	1831	1362	1362
q5	4234	4163	4127	4127
q6	207	166	125	125
q7	1870	1809	1921	1809
q8	2611	2534	2515	2515
q9	7234	7136	7093	7093
q10	2981	3229	2822	2822
q11	578	500	490	490
q12	686	765	614	614
q13	3439	3935	3171	3171
q14	276	288	259	259
q15	500	458	467	458
q16	639	668	619	619
q17	1127	1601	1308	1308
q18	7471	7437	7370	7370
q19	783	891	1041	891
q20	1931	2012	1851	1851
q21	5421	4917	4843	4843
q22	589	588	529	529
Total cold run time: 51560 ms
Total hot run time: 49911 ms

doris-robot · 2025-02-19T12:54:10Z

TPC-DS: Total hot run time: 183515 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b2b0e989f088303a1863c56df83b511a28942047, data reload: false

query1	961	388	384	384
query2	6522	1811	1825	1811
query3	6792	215	212	212
query4	26397	23737	23825	23737
query5	5097	667	504	504
query6	303	213	171	171
query7	4603	507	298	298
query8	282	225	241	225
query9	8633	2534	2508	2508
query10	492	318	258	258
query11	15419	14979	15050	14979
query12	175	105	105	105
query13	1642	501	388	388
query14	10736	6324	6012	6012
query15	205	191	174	174
query16	7641	632	494	494
query17	1230	717	552	552
query18	1990	402	301	301
query19	194	192	160	160
query20	124	115	128	115
query21	214	125	105	105
query22	4347	4293	4073	4073
query23	34025	33002	33248	33002
query24	7251	2358	2403	2358
query25	527	468	409	409
query26	1230	290	159	159
query27	1979	489	349	349
query28	3893	2428	2412	2412
query29	706	569	447	447
query30	298	181	161	161
query31	937	853	768	768
query32	71	62	62	62
query33	548	353	300	300
query34	775	844	495	495
query35	803	833	721	721
query36	970	953	910	910
query37	119	94	71	71
query38	4126	4240	4062	4062
query39	1501	1441	1384	1384
query40	210	115	105	105
query41	56	51	51	51
query42	122	105	104	104
query43	499	489	468	468
query44	1246	783	780	780
query45	177	167	159	159
query46	880	1029	647	647
query47	1750	1818	1707	1707
query48	383	415	302	302
query49	791	502	425	425
query50	674	713	419	419
query51	4163	4123	4147	4123
query52	109	98	92	92
query53	225	262	179	179
query54	506	483	406	406
query55	93	80	75	75
query56	261	268	247	247
query57	1128	1165	1072	1072
query58	251	237	237	237
query59	2708	2906	2696	2696
query60	283	278	260	260
query61	120	118	115	115
query62	779	711	657	657
query63	240	193	198	193
query64	4136	1014	681	681
query65	3251	3122	3130	3122
query66	1027	402	312	312
query67	15673	15388	15245	15245
query68	7560	757	530	530
query69	471	296	259	259
query70	1209	1138	1142	1138
query71	384	304	260	260
query72	5650	3581	3671	3581
query73	712	739	352	352
query74	9198	8913	8912	8912
query75	3136	3192	2672	2672
query76	3223	1155	722	722
query77	478	380	275	275
query78	10333	10137	9315	9315
query79	1816	861	599	599
query80	656	520	447	447
query81	514	269	240	240
query82	191	126	96	96
query83	165	176	158	158
query84	240	97	77	77
query85	742	387	303	303
query86	363	298	287	287
query87	4342	4601	4308	4308
query88	2829	2221	2206	2206
query89	399	321	287	287
query90	1928	197	195	195
query91	137	145	108	108
query92	68	60	56	56
query93	1304	996	586	586
query94	632	392	287	287
query95	342	267	253	253
query96	487	522	269	269
query97	2759	2866	2737	2737
query98	222	221	197	197
query99	1294	1401	1288	1288
Total cold run time: 269283 ms
Total hot run time: 183515 ms

doris-robot · 2025-02-19T12:59:29Z

ClickBench: Total hot run time: 30.27 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b2b0e989f088303a1863c56df83b511a28942047, data reload: false

query1	0.03	0.03	0.02
query2	0.08	0.03	0.03
query3	0.24	0.07	0.06
query4	1.61	0.11	0.10
query5	0.42	0.42	0.40
query6	1.18	0.66	0.67
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.59	0.53	0.51
query10	0.58	0.58	0.56
query11	0.15	0.11	0.10
query12	0.14	0.11	0.12
query13	0.63	0.59	0.59
query14	2.69	2.69	2.71
query15	0.92	0.85	0.84
query16	0.38	0.38	0.37
query17	1.03	1.05	1.05
query18	0.21	0.19	0.20
query19	1.93	1.85	1.99
query20	0.01	0.01	0.01
query21	15.38	0.87	0.55
query22	0.74	1.17	0.60
query23	15.03	1.39	0.62
query24	11.18	1.14	0.49
query25	0.51	0.15	0.13
query26	0.95	0.20	0.15
query27	0.05	0.06	0.05
query28	6.20	0.81	0.44
query29	12.60	3.88	3.21
query30	0.25	0.08	0.06
query31	2.83	0.59	0.38
query32	3.27	0.54	0.48
query33	3.04	3.06	3.01
query34	15.82	5.22	4.55
query35	4.58	4.56	4.62
query36	0.66	0.50	0.48
query37	0.08	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.02	0.03
query40	0.17	0.14	0.12
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.46 s
Total hot run time: 30.27 s

xiedeyantu · 2025-02-20T06:21:08Z

run buildall

doris-robot · 2025-02-20T06:59:41Z

TPC-H: Total hot run time: 31718 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0a67991bf6dfc243a2464067c2c0b83b807c2c97, data reload: false

------ Round 1 ----------------------------------
q1	17585	5389	5129	5129
q2	2050	305	179	179
q3	10400	1248	755	755
q4	10203	1007	541	541
q5	7526	2395	2301	2301
q6	192	169	135	135
q7	917	742	591	591
q8	9293	1323	1169	1169
q9	4826	4535	4547	4535
q10	6815	2314	1881	1881
q11	512	284	264	264
q12	361	358	222	222
q13	17770	3726	3054	3054
q14	237	232	225	225
q15	513	462	486	462
q16	611	622	580	580
q17	586	864	336	336
q18	6688	6402	6423	6402
q19	1210	962	531	531
q20	306	325	194	194
q21	2816	2330	1929	1929
q22	361	332	303	303
Total cold run time: 101778 ms
Total hot run time: 31718 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5205	5154	5405	5154
q2	237	327	230	230
q3	2130	2690	2289	2289
q4	1460	1846	1349	1349
q5	4224	4105	4122	4105
q6	217	169	125	125
q7	1853	1871	1674	1674
q8	2623	2617	2919	2617
q9	7295	7219	7162	7162
q10	3026	3203	2792	2792
q11	596	511	500	500
q12	686	767	661	661
q13	3437	3863	3345	3345
q14	298	296	267	267
q15	503	478	465	465
q16	638	671	658	658
q17	1167	1655	1293	1293
q18	7630	7291	7247	7247
q19	795	829	936	829
q20	1956	2016	1897	1897
q21	5527	5011	4783	4783
q22	617	567	550	550
Total cold run time: 52120 ms
Total hot run time: 49992 ms

doris-robot · 2025-02-20T07:11:47Z

TPC-DS: Total hot run time: 190375 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0a67991bf6dfc243a2464067c2c0b83b807c2c97, data reload: false

query1	1314	968	954	954
query2	6222	1837	1827	1827
query3	11119	4564	4500	4500
query4	55650	24649	22976	22976
query5	5290	568	485	485
query6	369	237	209	209
query7	5154	525	310	310
query8	335	252	237	237
query9	6407	2568	2574	2568
query10	443	303	261	261
query11	15125	14957	15174	14957
query12	168	115	106	106
query13	1158	535	408	408
query14	10808	6961	6787	6787
query15	198	194	180	180
query16	7099	654	483	483
query17	1132	722	588	588
query18	1558	420	312	312
query19	199	210	168	168
query20	132	160	126	126
query21	210	119	100	100
query22	4557	4522	4435	4435
query23	34030	33497	33150	33150
query24	5777	2436	2416	2416
query25	468	486	400	400
query26	722	291	163	163
query27	1774	525	345	345
query28	2882	2475	2439	2439
query29	606	556	435	435
query30	212	189	156	156
query31	887	887	820	820
query32	77	62	61	61
query33	454	374	296	296
query34	920	850	521	521
query35	790	830	736	736
query36	955	968	905	905
query37	129	99	73	73
query38	4215	4361	4278	4278
query39	1465	1462	1437	1437
query40	210	116	101	101
query41	51	56	60	56
query42	143	114	109	109
query43	484	517	482	482
query44	1327	824	834	824
query45	184	176	173	173
query46	888	1080	662	662
query47	1861	1857	1754	1754
query48	388	436	304	304
query49	719	520	402	402
query50	736	762	444	444
query51	4296	4307	4270	4270
query52	116	105	94	94
query53	230	264	193	193
query54	503	513	429	429
query55	89	81	80	80
query56	286	283	261	261
query57	1180	1200	1107	1107
query58	244	243	244	243
query59	2640	2851	2633	2633
query60	282	278	304	278
query61	124	120	124	120
query62	734	746	685	685
query63	246	201	202	201
query64	1934	1026	668	668
query65	3205	3121	3109	3109
query66	714	398	291	291
query67	15923	15954	15676	15676
query68	5484	798	551	551
query69	526	305	266	266
query70	1179	1138	1107	1107
query71	434	305	279	279
query72	5977	3588	3705	3588
query73	1000	807	356	356
query74	8791	9166	8931	8931
query75	3180	3159	2655	2655
query76	3844	1168	733	733
query77	524	371	286	286
query78	9911	10049	9299	9299
query79	2371	847	619	619
query80	652	524	444	444
query81	500	283	316	283
query82	235	126	95	95
query83	177	172	153	153
query84	282	99	75	75
query85	769	358	303	303
query86	372	304	308	304
query87	4537	4627	4333	4333
query88	3747	2203	2203	2203
query89	400	328	284	284
query90	1716	198	187	187
query91	132	134	111	111
query92	74	60	58	58
query93	2198	1026	593	593
query94	672	399	288	288
query95	346	272	260	260
query96	501	572	269	269
query97	2809	2823	2744	2744
query98	235	203	212	203
query99	1340	1376	1258	1258
Total cold run time: 295662 ms
Total hot run time: 190375 ms

doris-robot · 2025-02-20T07:17:06Z

ClickBench: Total hot run time: 31.13 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0a67991bf6dfc243a2464067c2c0b83b807c2c97, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.06
query4	1.63	0.10	0.10
query5	0.41	0.41	0.39
query6	1.17	0.67	0.66
query7	0.02	0.01	0.02
query8	0.04	0.04	0.03
query9	0.60	0.52	0.51
query10	0.58	0.58	0.57
query11	0.16	0.11	0.11
query12	0.15	0.11	0.11
query13	0.62	0.59	0.59
query14	2.70	2.76	2.71
query15	0.92	0.86	0.85
query16	0.38	0.36	0.37
query17	1.00	1.04	1.04
query18	0.22	0.20	0.19
query19	1.88	1.79	2.01
query20	0.02	0.01	0.02
query21	15.36	0.90	0.53
query22	0.74	1.05	0.64
query23	15.10	1.35	0.62
query24	9.32	1.66	1.43
query25	0.46	0.32	0.12
query26	0.72	0.17	0.14
query27	0.06	0.05	0.04
query28	7.20	0.78	0.43
query29	12.55	3.87	3.22
query30	0.25	0.09	0.06
query31	2.83	0.61	0.38
query32	3.24	0.54	0.45
query33	3.03	3.03	3.04
query34	15.79	5.15	4.57
query35	4.55	4.53	4.58
query36	0.65	0.49	0.48
query37	0.09	0.07	0.06
query38	0.05	0.05	0.03
query39	0.03	0.02	0.03
query40	0.17	0.14	0.13
query41	0.07	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.18 s
Total hot run time: 31.13 s

xiedeyantu · 2025-02-20T08:10:26Z

run buildall

doris-robot · 2025-02-20T08:47:07Z

TPC-H: Total hot run time: 31474 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c2d4afaf7925d7cde4fa7f78f6ee3f710c6cf4ce, data reload: false

------ Round 1 ----------------------------------
q1	17603	5427	5155	5155
q2	2052	292	169	169
q3	10428	1227	755	755
q4	10190	1001	573	573
q5	7544	2454	2277	2277
q6	202	174	136	136
q7	903	755	589	589
q8	9297	1326	1145	1145
q9	4841	4578	4569	4569
q10	6824	2432	1896	1896
q11	485	272	251	251
q12	361	363	230	230
q13	17776	3674	3063	3063
q14	224	230	218	218
q15	521	457	448	448
q16	633	617	580	580
q17	582	857	333	333
q18	6563	6134	6161	6134
q19	1213	965	533	533
q20	306	332	197	197
q21	2836	2117	1928	1928
q22	358	334	295	295
Total cold run time: 101742 ms
Total hot run time: 31474 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5129	5144	5189	5144
q2	234	324	234	234
q3	2160	2646	2277	2277
q4	1409	1796	1363	1363
q5	4213	4087	4193	4087
q6	212	167	125	125
q7	1865	1810	1709	1709
q8	2650	2678	2604	2604
q9	7386	7324	7251	7251
q10	3031	3249	2844	2844
q11	586	529	490	490
q12	681	766	622	622
q13	3549	4031	3374	3374
q14	299	293	287	287
q15	515	477	479	477
q16	648	685	648	648
q17	1134	1606	1325	1325
q18	7496	7225	7305	7225
q19	801	804	964	804
q20	2005	2017	1873	1873
q21	5322	4953	4788	4788
q22	590	555	539	539
Total cold run time: 51915 ms
Total hot run time: 50090 ms

doris-robot · 2025-02-20T08:59:05Z

TPC-DS: Total hot run time: 189722 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c2d4afaf7925d7cde4fa7f78f6ee3f710c6cf4ce, data reload: false

query1	1313	912	934	912
query2	6248	1838	1792	1792
query3	10963	4616	4320	4320
query4	56587	24425	23124	23124
query5	5115	504	488	488
query6	364	190	180	180
query7	5163	508	297	297
query8	319	255	236	236
query9	6330	2540	2561	2540
query10	426	322	267	267
query11	15233	15137	15105	15105
query12	157	112	106	106
query13	1154	530	405	405
query14	10647	6452	6916	6452
query15	208	202	179	179
query16	7099	613	456	456
query17	1050	717	570	570
query18	1503	402	316	316
query19	192	219	161	161
query20	125	122	121	121
query21	205	123	109	109
query22	4472	4461	4227	4227
query23	33843	33192	33019	33019
query24	5617	2437	2444	2437
query25	453	459	411	411
query26	685	281	160	160
query27	1706	516	354	354
query28	2853	2523	2471	2471
query29	563	561	424	424
query30	217	189	155	155
query31	928	870	808	808
query32	79	63	61	61
query33	440	360	299	299
query34	746	880	535	535
query35	807	815	748	748
query36	925	1018	901	901
query37	131	98	75	75
query38	4126	4353	4275	4275
query39	1493	1401	1442	1401
query40	201	112	105	105
query41	53	49	57	49
query42	133	111	106	106
query43	501	494	492	492
query44	1327	810	821	810
query45	174	182	171	171
query46	913	1074	672	672
query47	1829	1844	1787	1787
query48	388	439	318	318
query49	707	523	450	450
query50	727	776	426	426
query51	4318	4316	4232	4232
query52	112	114	102	102
query53	245	268	185	185
query54	507	493	425	425
query55	78	78	80	78
query56	274	263	250	250
query57	1166	1175	1116	1116
query58	242	244	243	243
query59	2730	2698	2590	2590
query60	286	278	255	255
query61	125	120	137	120
query62	748	751	680	680
query63	237	202	198	198
query64	1463	1022	678	678
query65	3295	3196	3130	3130
query66	703	389	286	286
query67	15723	15751	15312	15312
query68	3247	822	609	609
query69	469	333	281	281
query70	1175	1111	1120	1111
query71	385	304	273	273
query72	6256	3618	3640	3618
query73	649	771	356	356
query74	9091	9040	9178	9040
query75	3172	3345	2738	2738
query76	2102	1172	723	723
query77	535	386	278	278
query78	10149	10205	9414	9414
query79	1587	830	621	621
query80	892	572	450	450
query81	525	274	238	238
query82	388	137	98	98
query83	189	170	158	158
query84	285	96	71	71
query85	739	361	306	306
query86	331	309	276	276
query87	4445	4658	4464	4464
query88	3071	2249	2211	2211
query89	413	319	292	292
query90	1708	196	194	194
query91	137	135	109	109
query92	66	61	63	61
query93	1474	1026	597	597
query94	592	406	291	291
query95	351	278	265	265
query96	501	544	276	276
query97	2772	2804	2704	2704
query98	222	200	202	200
query99	1334	1419	1236	1236
Total cold run time: 288942 ms
Total hot run time: 189722 ms

doris-robot · 2025-02-20T09:04:24Z

ClickBench: Total hot run time: 30.08 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c2d4afaf7925d7cde4fa7f78f6ee3f710c6cf4ce, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.03	0.03
query3	0.23	0.07	0.06
query4	1.62	0.10	0.10
query5	0.40	0.42	0.41
query6	1.15	0.65	0.67
query7	0.03	0.02	0.02
query8	0.04	0.03	0.03
query9	0.60	0.51	0.51
query10	0.57	0.59	0.58
query11	0.15	0.10	0.10
query12	0.15	0.12	0.11
query13	0.61	0.61	0.61
query14	2.66	2.73	2.68
query15	0.92	0.86	0.85
query16	0.39	0.38	0.37
query17	1.03	1.04	0.98
query18	0.21	0.20	0.20
query19	1.86	1.77	1.96
query20	0.02	0.01	0.01
query21	15.38	0.90	0.52
query22	0.78	1.27	0.63
query23	14.89	1.44	0.61
query24	9.07	3.36	0.50
query25	0.31	0.21	0.07
query26	0.82	0.19	0.14
query27	0.06	0.05	0.05
query28	6.53	0.78	0.45
query29	12.62	3.94	3.32
query30	0.25	0.08	0.06
query31	2.82	0.60	0.38
query32	3.23	0.54	0.46
query33	3.01	3.00	3.03
query34	15.76	5.14	4.47
query35	4.52	4.57	4.52
query36	0.67	0.49	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.16	0.12	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.02	0.02
Total cold run time: 103.96 s
Total hot run time: 30.08 s

xiedeyantu · 2025-02-20T10:41:08Z

run cloud_p0

xiedeyantu requested review from dataroaring, CalvinKirs and morningman as code owners February 18, 2025 11:41

xiedeyantu changed the title ~~support analyze database/table command~~ [Feat](Nereids) support analyze database/table command Feb 18, 2025

starocean999 mentioned this pull request Feb 19, 2025

[Enhancement] (nereids)implement analyzeDatabaseCommand in nereids #42706

Open

1 task

starocean999 reviewed Feb 19, 2025

View reviewed changes

fe/fe-core/src/main/java/org/apache/doris/statistics/AnalysisManager.java Outdated Show resolved Hide resolved

xiedeyantu added 4 commits February 20, 2025 16:09

support analyze database/table command

701edea

fix1

66a4ec1

refactor

0f306f9

fix

c2d4afa

xiedeyantu force-pushed the analyze branch from 0a67991 to c2d4afa Compare February 20, 2025 08:10

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Feat](Nereids) support analyze database/table command #48031

[Feat](Nereids) support analyze database/table command #48031

xiedeyantu commented Feb 18, 2025 •

edited

Loading

hello-stephen commented Feb 18, 2025

xiedeyantu commented Feb 18, 2025

xiedeyantu commented Feb 18, 2025

doris-robot commented Feb 18, 2025

doris-robot commented Feb 18, 2025

doris-robot commented Feb 18, 2025

starocean999 Feb 19, 2025

xiedeyantu Feb 19, 2025

starocean999 Feb 19, 2025

xiedeyantu Feb 19, 2025

xiedeyantu commented Feb 19, 2025

doris-robot commented Feb 19, 2025

doris-robot commented Feb 19, 2025

doris-robot commented Feb 19, 2025

xiedeyantu commented Feb 20, 2025

doris-robot commented Feb 20, 2025

doris-robot commented Feb 20, 2025

doris-robot commented Feb 20, 2025

xiedeyantu commented Feb 20, 2025

doris-robot commented Feb 20, 2025

doris-robot commented Feb 20, 2025

doris-robot commented Feb 20, 2025

xiedeyantu commented Feb 20, 2025

[Feat](Nereids) support analyze database/table command #48031

Are you sure you want to change the base?

[Feat](Nereids) support analyze database/table command #48031

Conversation

xiedeyantu commented Feb 18, 2025 • edited Loading

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

hello-stephen commented Feb 18, 2025

xiedeyantu commented Feb 18, 2025

xiedeyantu commented Feb 18, 2025

doris-robot commented Feb 18, 2025

doris-robot commented Feb 18, 2025

doris-robot commented Feb 18, 2025

starocean999 Feb 19, 2025

Choose a reason for hiding this comment

xiedeyantu Feb 19, 2025

Choose a reason for hiding this comment

starocean999 Feb 19, 2025

Choose a reason for hiding this comment

xiedeyantu Feb 19, 2025

Choose a reason for hiding this comment

xiedeyantu commented Feb 19, 2025

doris-robot commented Feb 19, 2025

doris-robot commented Feb 19, 2025

doris-robot commented Feb 19, 2025

xiedeyantu commented Feb 20, 2025

doris-robot commented Feb 20, 2025

doris-robot commented Feb 20, 2025

doris-robot commented Feb 20, 2025

xiedeyantu commented Feb 20, 2025

doris-robot commented Feb 20, 2025

doris-robot commented Feb 20, 2025

doris-robot commented Feb 20, 2025

xiedeyantu commented Feb 20, 2025

xiedeyantu commented Feb 18, 2025 •

edited

Loading