Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fix](persist) Fix the generated dropping tmp partition sql #43079 #43169

Merged
merged 1 commit into from
Nov 5, 2024
Merged

[fix](persist) Fix the generated dropping tmp partition sql #43079 #43169

merged 1 commit into from
Nov 5, 2024

Conversation

w41ter
Copy link
Contributor

@w41ter w41ter commented Nov 4, 2024

cherry pick from #43079

@w41ter
[fix](persist) Fix the generated dropping tmp partition sql (apache#4…
5c22317 
…3079)

The syntax is:

```
KW_DROP opt_tmp:isTempPartition KW_PARTITION ...
```
@w41ter
Copy link
Contributor Author

w41ter commented Nov 4, 2024

run buildall

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@doris-robot
Copy link

TPC-H: Total hot run time: 49460 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5c22317c699a3889f30e0851a5933205d9521654, data reload: false

------ Round 1 ----------------------------------
q1	17721	4460	4445	4445
q2	2072	158	145	145
q3	10254	1944	1981	1944
q4	10161	1253	1347	1253
q5	8520	3901	3964	3901
q6	245	126	125	125
q7	2098	1625	1642	1625
q8	9284	2788	2753	2753
q9	10399	10115	9796	9796
q10	8721	3627	3593	3593
q11	417	251	251	251
q12	477	298	302	298
q13	18388	3982	4087	3982
q14	351	344	335	335
q15	529	473	461	461
q16	553	465	470	465
q17	1158	1033	956	956
q18	7315	6792	6830	6792
q19	1761	1508	1562	1508
q20	513	314	304	304
q21	4540	4139	4124	4124
q22	496	404	404	404
Total cold run time: 115973 ms
Total hot run time: 49460 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4360	4315	4394	4315
q2	325	235	219	219
q3	4162	4192	4179	4179
q4	2778	2767	2774	2767
q5	7216	7162	7119	7119
q6	246	122	125	122
q7	3199	2877	2808	2808
q8	4416	4532	4530	4530
q9	13778	13597	13612	13597
q10	4243	4277	4323	4277
q11	751	682	696	682
q12	1040	872	868	868
q13	6743	3728	3766	3728
q14	452	439	414	414
q15	502	465	454	454
q16	657	589	615	589
q17	3767	3823	3896	3823
q18	8887	8697	8856	8697
q19	1768	1686	1732	1686
q20	2406	2182	2141	2141
q21	8507	8459	8438	8438
q22	1070	907	924	907
Total cold run time: 81273 ms
Total hot run time: 76360 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 213824 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5c22317c699a3889f30e0851a5933205d9521654, data reload: false

query1	937	398	413	398
query2	6538	2245	2147	2147
query3	6923	200	206	200
query4	23318	21947	21365	21365
query5	19727	6574	6570	6570
query6	288	224	245	224
query7	4339	297	299	297
query8	267	286	271	271
query9	3062	2652	2582	2582
query10	468	303	305	303
query11	16211	15028	15068	15028
query12	132	82	77	77
query13	1026	433	436	433
query14	17670	13470	13482	13470
query15	404	223	231	223
query16	6477	282	266	266
query17	1758	974	893	893
query18	896	315	313	313
query19	218	151	145	145
query20	102	100	97	97
query21	192	101	98	98
query22	5247	5030	5081	5030
query23	34533	33525	33695	33525
query24	7793	6320	6281	6281
query25	534	436	424	424
query26	1275	168	161	161
query27	2417	294	287	287
query28	6061	2220	2210	2210
query29	2863	2670	2758	2670
query30	245	168	171	168
query31	954	754	730	730
query32	72	66	59	59
query33	458	261	254	254
query34	871	478	475	475
query35	1115	924	933	924
query36	1298	1034	1091	1034
query37	173	62	60	60
query38	3097	2990	2889	2889
query39	1373	1317	1332	1317
query40	312	98	95	95
query41	41	38	39	38
query42	88	86	85	85
query43	659	604	556	556
query44	1185	723	726	723
query45	244	229	235	229
query46	1236	955	951	951
query47	2025	1700	1843	1700
query48	508	412	395	395
query49	651	380	388	380
query50	868	617	606	606
query51	4756	4799	4750	4750
query52	88	87	86	86
query53	223	184	194	184
query54	2688	2509	2463	2463
query55	88	90	78	78
query56	231	198	213	198
query57	1215	1110	1100	1100
query58	220	213	213	213
query59	3430	3162	3164	3162
query60	226	218	205	205
query61	99	97	97	97
query62	873	461	492	461
query63	203	178	182	178
query64	3546	1571	1455	1455
query65	3629	3555	3567	3555
query66	791	402	415	402
query67	15373	16454	17643	16454
query68	9467	650	657	650
query69	514	285	265	265
query70	1678	1434	1468	1434
query71	412	316	309	309
query72	6804	4892	4991	4892
query73	759	319	325	319
query74	6306	5878	5795	5795
query75	5100	3731	3657	3657
query76	5078	1149	1178	1149
query77	861	268	265	265
query78	12651	11716	11696	11696
query79	7840	656	649	649
query80	1776	390	390	390
query81	496	237	239	237
query82	1644	100	100	100
query83	172	134	135	134
query84	259	70	71	70
query85	890	318	320	318
query86	318	289	291	289
query87	3227	3020	3022	3020
query88	4656	2278	2299	2278
query89	443	285	277	277
query90	1935	221	216	216
query91	159	129	129	129
query92	60	51	51	51
query93	6212	571	603	571
query94	728	208	213	208
query95	2090	2021	1960	1960
query96	648	328	319	319
query97	6521	6473	6428	6428
query98	215	204	196	196
query99	3077	958	856	856
Total cold run time: 319824 ms
Total hot run time: 213824 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.98 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5c22317c699a3889f30e0851a5933205d9521654, data reload: false

query1	0.02	0.02	0.03
query2	0.07	0.02	0.02
query3	0.24	0.04	0.04
query4	1.79	0.07	0.06
query5	0.53	0.53	0.53
query6	1.22	0.60	0.61
query7	0.02	0.01	0.01
query8	0.03	0.03	0.02
query9	0.53	0.48	0.47
query10	0.53	0.53	0.54
query11	0.12	0.09	0.08
query12	0.12	0.09	0.09
query13	0.62	0.60	0.61
query14	0.76	0.79	0.77
query15	0.79	0.76	0.78
query16	0.38	0.38	0.38
query17	0.98	1.01	0.96
query18	0.23	0.26	0.25
query19	1.93	1.85	1.87
query20	0.01	0.01	0.02
query21	15.45	0.54	0.53
query22	2.06	2.08	1.89
query23	17.35	1.05	0.93
query24	5.08	1.10	1.05
query25	0.37	0.09	0.06
query26	0.59	0.16	0.14
query27	0.05	0.05	0.04
query28	7.91	0.73	0.77
query29	12.67	2.25	2.22
query30	0.61	0.52	0.52
query31	2.80	0.39	0.38
query32	3.38	0.49	0.49
query33	3.09	3.08	3.08
query34	15.24	4.79	4.78
query35	4.84	4.84	4.83
query36	1.05	1.02	1.02
query37	0.06	0.05	0.04
query38	0.04	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.15
query41	0.07	0.01	0.01
query42	0.02	0.01	0.02
query43	0.03	0.01	0.02
Total cold run time: 103.86 s
Total hot run time: 30.98 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 5c22317c699a3889f30e0851a5933205d9521654 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.5 seconds inserted 10000000 Rows, about 465K ops/s

@w41ter w41ter merged commit b238a76 into apache:branch-2.0 Nov 5, 2024
22 of 24 checks passed
@w41ter w41ter deleted the pick_43079_to_origin_branch-2.0 branch November 5, 2024 09:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@w41ter @doris-robot