Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[chore](nereids) Added compatibility with mysql alias filter #38640

Merged
merged 56 commits into from
Aug 21, 2024

Conversation

Toms1999
Copy link
Contributor

qt_filter_select4 """
   select * from filter_alias_test.test b where filter_alias_test.b.id = 1;
"""

qt_filter_select5 """
     select * from internal.filter_alias_test.test b where internal.filter_alias_test.b.id = 1;
"""

@Toms1999
Copy link
Contributor Author

run buildall

1 similar comment
@Toms1999
Copy link
Contributor Author

run buildall

@Toms1999
Copy link
Contributor Author

run buildall

1 similar comment
@Toms1999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38000 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c085183d45b8d04414b9795eda05ee3ab4edab88, data reload: false

------ Round 1 ----------------------------------
q1	17864	4313	4319	4313
q2	2062	212	210	210
q3	11815	971	1089	971
q4	10536	752	801	752
q5	7763	2863	2826	2826
q6	264	158	158	158
q7	1017	647	665	647
q8	9599	2095	2083	2083
q9	8594	6542	6571	6542
q10	7026	2249	2219	2219
q11	476	268	266	266
q12	430	255	257	255
q13	18063	2995	3020	2995
q14	295	252	253	252
q15	546	550	534	534
q16	520	399	404	399
q17	982	643	791	643
q18	7504	6674	6686	6674
q19	7349	1044	1080	1044
q20	720	350	343	343
q21	3887	2849	2888	2849
q22	1124	1025	1043	1025
Total cold run time: 118436 ms
Total hot run time: 38000 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4583	4327	4258	4258
q2	404	309	301	301
q3	2825	2650	2730	2650
q4	2037	1804	1716	1716
q5	5633	5728	5593	5593
q6	251	152	147	147
q7	2155	1754	1764	1754
q8	3289	3539	3450	3450
q9	8764	8628	8666	8628
q10	3597	3356	3258	3258
q11	643	523	533	523
q12	831	680	643	643
q13	17053	3172	3165	3165
q14	317	297	290	290
q15	554	510	498	498
q16	508	452	451	451
q17	1838	1555	1537	1537
q18	8498	7915	7806	7806
q19	4605	1517	1548	1517
q20	2141	1925	1915	1915
q21	14123	5367	5379	5367
q22	1193	1082	1080	1080
Total cold run time: 85842 ms
Total hot run time: 56547 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195413 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c085183d45b8d04414b9795eda05ee3ab4edab88, data reload: false

query1	1313	908	882	882
query2	6591	1970	1898	1898
query3	10715	3778	3790	3778
query4	57688	25521	23288	23288
query5	6204	737	722	722
query6	551	211	215	211
query7	6425	332	326	326
query8	555	440	449	440
query9	9233	2539	2513	2513
query10	631	352	334	334
query11	17162	14961	15547	14961
query12	222	139	132	132
query13	1682	464	439	439
query14	12421	6836	6945	6836
query15	267	195	196	195
query16	7444	513	536	513
query17	1150	640	629	629
query18	1901	343	337	337
query19	292	169	172	169
query20	162	134	132	132
query21	250	144	142	142
query22	4395	4391	4416	4391
query23	34309	33864	33768	33768
query24	5754	3045	2992	2992
query25	586	428	423	423
query26	721	187	183	183
query27	1755	306	312	306
query28	3800	2161	2132	2132
query29	732	458	445	445
query30	233	204	197	197
query31	1036	843	864	843
query32	132	80	78	78
query33	549	352	354	352
query34	951	506	495	495
query35	888	786	745	745
query36	1058	976	993	976
query37	162	102	105	102
query38	4010	3828	3857	3828
query39	1546	1503	1473	1473
query40	238	159	154	154
query41	137	134	137	134
query42	132	116	115	115
query43	535	511	519	511
query44	1113	769	777	769
query45	228	195	200	195
query46	1142	773	768	768
query47	1957	1846	1866	1846
query48	407	337	340	337
query49	913	573	582	573
query50	859	474	456	456
query51	7255	7098	7018	7018
query52	122	110	107	107
query53	291	221	219	219
query54	605	506	503	503
query55	94	89	91	89
query56	333	306	311	306
query57	1215	1113	1096	1096
query58	298	354	302	302
query59	3017	2824	2624	2624
query60	358	327	327	327
query61	151	147	149	147
query62	800	701	693	693
query63	256	223	225	223
query64	3449	1863	2847	1863
query65	3176	3169	3145	3145
query66	1043	670	661	661
query67	15339	15024	14915	14915
query68	7872	587	589	587
query69	671	443	348	348
query70	1199	1123	1099	1099
query71	545	314	317	314
query72	6736	2286	2070	2070
query73	1050	357	353	353
query74	9322	8920	8905	8905
query75	3928	2695	2725	2695
query76	4179	1054	980	980
query77	900	427	426	426
query78	9918	9032	8953	8953
query79	7411	543	553	543
query80	1665	605	616	605
query81	588	266	256	256
query82	954	163	162	162
query83	344	214	213	213
query84	299	95	97	95
query85	956	347	349	347
query86	415	324	331	324
query87	4329	4231	4176	4176
query88	4193	2495	2505	2495
query89	574	323	323	323
query90	1954	223	226	223
query91	152	126	129	126
query92	86	75	73	73
query93	5670	538	541	538
query94	751	319	323	319
query95	373	288	291	288
query96	622	284	290	284
query97	3233	3072	3064	3064
query98	241	252	238	238
query99	1752	1293	1289	1289
Total cold run time: 333821 ms
Total hot run time: 195413 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.34 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c085183d45b8d04414b9795eda05ee3ab4edab88, data reload: false

query1	0.04	0.05	0.04
query2	0.08	0.04	0.04
query3	0.22	0.06	0.06
query4	1.66	0.08	0.07
query5	0.53	0.51	0.49
query6	1.13	0.73	0.73
query7	0.02	0.02	0.02
query8	0.05	0.05	0.05
query9	0.56	0.48	0.49
query10	0.54	0.54	0.53
query11	0.17	0.13	0.12
query12	0.15	0.12	0.14
query13	0.63	0.60	0.59
query14	0.77	0.79	0.78
query15	0.85	0.83	0.83
query16	0.39	0.37	0.38
query17	1.07	0.98	0.96
query18	0.22	0.20	0.20
query19	1.78	1.69	1.66
query20	0.02	0.01	0.01
query21	15.39	0.67	0.65
query22	4.02	7.14	2.39
query23	18.31	1.40	1.19
query24	2.11	0.23	0.22
query25	0.16	0.08	0.08
query26	0.26	0.18	0.18
query27	0.08	0.09	0.07
query28	13.30	1.02	1.01
query29	12.71	3.36	3.36
query30	0.44	0.25	0.25
query31	2.81	0.41	0.40
query32	3.23	0.50	0.49
query33	2.93	2.94	2.97
query34	16.96	4.31	4.40
query35	4.51	4.44	4.46
query36	0.68	0.51	0.48
query37	0.22	0.19	0.18
query38	0.17	0.17	0.18
query39	0.06	0.05	0.06
query40	0.18	0.15	0.16
query41	0.11	0.07	0.06
query42	0.08	0.06	0.07
query43	0.07	0.07	0.06
Total cold run time: 109.67 s
Total hot run time: 31.34 s

@doris-robot
Copy link

TPC-H: Total hot run time: 37870 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c085183d45b8d04414b9795eda05ee3ab4edab88, data reload: false

------ Round 1 ----------------------------------
q1	17865	4415	4298	4298
q2	2055	209	204	204
q3	11726	946	1120	946
q4	10540	758	769	758
q5	7781	2864	2744	2744
q6	282	162	161	161
q7	1041	648	647	647
q8	9588	2095	2124	2095
q9	7490	6570	6553	6553
q10	7120	2228	2246	2228
q11	489	275	272	272
q12	436	263	263	263
q13	18663	3007	3027	3007
q14	306	265	262	262
q15	566	541	525	525
q16	525	428	405	405
q17	990	609	705	609
q18	7305	6762	6732	6732
q19	7127	1002	1072	1002
q20	710	361	342	342
q21	4242	2971	2793	2793
q22	1113	1053	1024	1024
Total cold run time: 117960 ms
Total hot run time: 37870 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4524	4354	4263	4263
q2	397	305	303	303
q3	2820	2614	2603	2603
q4	1996	1799	1741	1741
q5	5620	5702	5601	5601
q6	251	164	155	155
q7	2193	1773	1761	1761
q8	3231	3505	3481	3481
q9	8790	8794	8720	8720
q10	3553	3361	3330	3330
q11	635	526	534	526
q12	861	661	678	661
q13	17155	3155	3144	3144
q14	329	305	293	293
q15	558	524	529	524
q16	509	442	462	442
q17	1830	1549	1528	1528
q18	8346	8001	7702	7702
q19	2917	1533	1673	1533
q20	2176	1947	1935	1935
q21	13737	5458	5379	5379
q22	1164	1041	1071	1041
Total cold run time: 83592 ms
Total hot run time: 56666 ms

@doris-robot
Copy link

TPC-H: Total hot run time: 39002 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c085183d45b8d04414b9795eda05ee3ab4edab88, data reload: false

------ Round 1 ----------------------------------
q1	17981	4475	4336	4336
q2	2059	212	203	203
q3	11740	978	1167	978
q4	10626	736	754	736
q5	7882	2913	2840	2840
q6	265	159	159	159
q7	1034	669	649	649
q8	9587	2122	2110	2110
q9	8371	6631	6628	6628
q10	7086	2243	2229	2229
q11	499	265	270	265
q12	428	260	262	260
q13	17964	3067	3062	3062
q14	301	267	253	253
q15	575	560	528	528
q16	526	423	413	413
q17	980	740	759	740
q18	7782	7419	7229	7229
q19	9468	1152	1113	1113
q20	734	375	376	375
q21	4084	2995	2876	2876
q22	1193	1080	1020	1020
Total cold run time: 121165 ms
Total hot run time: 39002 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4976	4290	4341	4290
q2	409	310	300	300
q3	3003	2801	2763	2763
q4	2044	1724	1779	1724
q5	5720	5586	5577	5577
q6	233	145	147	145
q7	2157	1843	1803	1803
q8	3317	3442	3440	3440
q9	8812	8773	8988	8773
q10	3512	3256	3287	3256
q11	609	540	535	535
q12	815	658	675	658
q13	16160	3024	3239	3024
q14	343	289	318	289
q15	577	541	521	521
q16	540	462	459	459
q17	1852	1537	1551	1537
q18	8402	7680	7831	7680
q19	9658	1519	1594	1519
q20	2868	1910	1902	1902
q21	9423	5425	5303	5303
q22	1169	1082	1070	1070
Total cold run time: 86599 ms
Total hot run time: 56568 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196840 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c085183d45b8d04414b9795eda05ee3ab4edab88, data reload: false

query1	1325	918	910	910
query2	6724	1994	1961	1961
query3	10652	3770	3713	3713
query4	58524	24257	23162	23162
query5	6015	652	678	652
query6	555	222	239	222
query7	6460	328	327	327
query8	537	442	445	442
query9	9377	2558	2531	2531
query10	626	335	336	335
query11	17229	15158	15385	15158
query12	181	136	130	130
query13	1693	442	447	442
query14	12677	6801	7350	6801
query15	265	198	215	198
query16	7831	533	552	533
query17	1285	612	626	612
query18	2071	356	344	344
query19	337	203	188	188
query20	163	151	150	150
query21	262	164	162	162
query22	4875	4935	4847	4847
query23	34417	33835	33637	33637
query24	5637	3009	3046	3009
query25	603	452	423	423
query26	746	183	185	183
query27	1918	311	313	311
query28	3884	2176	2139	2139
query29	758	449	440	440
query30	217	201	182	182
query31	1040	832	782	782
query32	122	76	78	76
query33	557	343	343	343
query34	893	517	493	493
query35	890	775	772	772
query36	1087	960	956	956
query37	159	100	103	100
query38	3993	3983	3826	3826
query39	1571	1485	1485	1485
query40	238	156	158	156
query41	137	137	136	136
query42	133	115	115	115
query43	538	512	511	511
query44	1131	793	801	793
query45	236	193	192	192
query46	1124	758	774	758
query47	1945	1862	1888	1862
query48	414	342	346	342
query49	919	593	576	576
query50	887	457	458	457
query51	7267	7117	7173	7117
query52	121	108	108	108
query53	297	225	227	225
query54	641	516	511	511
query55	90	88	88	88
query56	320	309	310	309
query57	1224	1145	1159	1145
query58	303	292	312	292
query59	2961	2782	2692	2692
query60	356	328	338	328
query61	147	144	146	144
query62	817	673	702	673
query63	251	223	226	223
query64	4412	2359	1873	1873
query65	3253	3165	3187	3165
query66	1094	665	660	660
query67	15519	15260	15060	15060
query68	7638	605	593	593
query69	685	432	344	344
query70	1370	1143	1084	1084
query71	564	323	317	317
query72	6658	2329	2078	2078
query73	2169	360	363	360
query74	9446	8898	8819	8819
query75	4109	2769	2799	2769
query76	4538	1108	1060	1060
query77	832	448	436	436
query78	11036	9435	17284	9435
query79	9620	553	544	544
query80	1345	612	626	612
query81	577	254	260	254
query82	318	151	154	151
query83	359	216	212	212
query84	295	97	103	97
query85	860	358	358	358
query86	395	322	296	296
query87	4424	4224	4251	4224
query88	3824	2515	2559	2515
query89	424	316	323	316
query90	1954	232	231	231
query91	157	127	123	123
query92	83	76	77	76
query93	1125	561	547	547
query94	750	321	340	321
query95	380	291	291	291
query96	603	281	285	281
query97	3248	3081	3064	3064
query98	249	230	224	224
query99	1612	1347	1320	1320
Total cold run time: 336578 ms
Total hot run time: 196840 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.18 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c085183d45b8d04414b9795eda05ee3ab4edab88, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.05	0.06
query4	1.65	0.09	0.08
query5	0.52	0.50	0.50
query6	1.13	0.73	0.71
query7	0.02	0.01	0.02
query8	0.05	0.05	0.04
query9	0.55	0.50	0.48
query10	0.55	0.55	0.55
query11	0.16	0.12	0.12
query12	0.16	0.13	0.13
query13	0.66	0.59	0.58
query14	0.77	0.82	0.77
query15	0.84	0.82	0.83
query16	0.38	0.37	0.36
query17	0.96	0.98	1.00
query18	0.21	0.20	0.21
query19	1.79	1.74	1.72
query20	0.01	0.02	0.01
query21	15.40	0.67	0.65
query22	4.24	7.02	2.18
query23	18.25	1.37	1.26
query24	2.14	0.22	0.22
query25	0.17	0.09	0.08
query26	0.27	0.18	0.18
query27	0.08	0.08	0.08
query28	13.27	1.02	1.01
query29	12.67	3.37	3.31
query30	0.43	0.24	0.25
query31	2.79	0.41	0.40
query32	3.24	0.50	0.49
query33	2.95	2.94	2.99
query34	17.18	4.33	4.39
query35	4.43	4.41	4.41
query36	0.68	0.48	0.48
query37	0.21	0.18	0.17
query38	0.18	0.17	0.17
query39	0.07	0.06	0.05
query40	0.19	0.15	0.16
query41	0.12	0.07	0.06
query42	0.08	0.07	0.07
query43	0.06	0.06	0.06
Total cold run time: 109.87 s
Total hot run time: 31.18 s

Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Aug 21, 2024
Copy link
Contributor

PR approved by anyone and no changes requested.

@morrySnow morrySnow merged commit 076ea00 into apache:master Aug 21, 2024
28 of 30 checks passed
@yiguolei yiguolei mentioned this pull request Sep 5, 2024
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.6-merged dev/3.0.3-merged doing reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants