Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [opt](jdbc catalog) Compatible with higher ClickHouse JDBC Driver vesions #47831

Closed
wants to merge 1 commit into from

Conversation

zy-kkk
Copy link
Member

@zy-kkk zy-kkk commented Feb 12, 2025

cherry-pick from (#46026)

…sions (apache#46026)

### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:
1. Since clickhouse changes the database level in jdbc metadata from
schema to catalog in JDBC Driver 0.5.0 and later, we need to be
compatible with this change
2. Since clickhouse JDBC Driver supports getting metadata from prepared
statements only in Driver version 0.6.2 and later, if you use query tvf
to query clickhouse catalog, you need to use a driver later than this
version
3. Delete some tests and add them again later
@zy-kkk zy-kkk requested a review from dataroaring as a code owner February 12, 2025 09:11
@zy-kkk
Copy link
Member Author

zy-kkk commented Feb 12, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40729 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8fbff95162296d779a57f3d457d78d9458fe0e30, data reload: false

------ Round 1 ----------------------------------
q1	17603	7366	7191	7191
q2	2066	189	170	170
q3	10624	1074	1130	1074
q4	10583	723	693	693
q5	7745	2813	2832	2813
q6	235	146	144	144
q7	984	611	591	591
q8	9395	1956	2035	1956
q9	6694	6390	6374	6374
q10	7010	2304	2323	2304
q11	466	265	263	263
q12	396	212	210	210
q13	17782	2985	3029	2985
q14	232	201	208	201
q15	566	527	516	516
q16	675	610	591	591
q17	944	583	545	545
q18	7224	6783	6686	6686
q19	1410	1089	1102	1089
q20	479	200	198	198
q21	4090	3134	3160	3134
q22	1136	1001	1006	1001
Total cold run time: 108339 ms
Total hot run time: 40729 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7229	7176	7179	7176
q2	331	229	228	228
q3	2864	2957	2919	2919
q4	2067	1840	1816	1816
q5	5720	5728	5713	5713
q6	219	144	141	141
q7	2203	1794	1833	1794
q8	3362	3541	3520	3520
q9	8736	8879	8792	8792
q10	3606	3598	3550	3550
q11	603	496	493	493
q12	793	605	634	605
q13	8499	3138	3153	3138
q14	304	276	264	264
q15	566	534	523	523
q16	683	643	638	638
q17	1821	1592	1612	1592
q18	8279	7863	7701	7701
q19	1651	1575	1537	1537
q20	2107	1865	1863	1863
q21	5559	5356	5402	5356
q22	1162	1048	1057	1048
Total cold run time: 68364 ms
Total hot run time: 60407 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197806 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8fbff95162296d779a57f3d457d78d9458fe0e30, data reload: false

query1	1251	948	934	934
query2	6244	2174	2145	2145
query3	10990	4296	4383	4296
query4	67145	28434	23445	23445
query5	4942	452	432	432
query6	396	175	186	175
query7	5495	306	308	306
query8	331	227	221	221
query9	8671	2695	2678	2678
query10	456	256	260	256
query11	17362	15206	15843	15206
query12	165	106	99	99
query13	1471	430	449	430
query14	10641	7398	6989	6989
query15	209	185	177	177
query16	7547	489	494	489
query17	1084	584	578	578
query18	1814	329	326	326
query19	211	162	164	162
query20	117	115	116	115
query21	210	107	109	107
query22	4686	4558	4391	4391
query23	34560	34011	33876	33876
query24	6175	2991	2915	2915
query25	539	421	424	421
query26	668	169	172	169
query27	1795	351	353	351
query28	4108	2484	2469	2469
query29	711	489	456	456
query30	238	160	165	160
query31	1012	824	839	824
query32	66	56	58	56
query33	453	280	284	280
query34	937	509	510	509
query35	847	737	739	737
query36	1107	999	974	974
query37	120	72	75	72
query38	4109	4054	3983	3983
query39	1495	1479	1491	1479
query40	209	99	102	99
query41	49	49	48	48
query42	123	103	105	103
query43	554	523	506	506
query44	1198	838	830	830
query45	189	178	168	168
query46	1150	728	747	728
query47	2069	1971	1945	1945
query48	467	385	395	385
query49	730	396	404	396
query50	851	433	419	419
query51	7352	7230	6972	6972
query52	106	87	90	87
query53	254	184	180	180
query54	552	442	453	442
query55	77	73	79	73
query56	273	254	263	254
query57	1240	1092	1116	1092
query58	206	214	199	199
query59	3406	2916	3173	2916
query60	287	255	247	247
query61	110	111	117	111
query62	863	720	739	720
query63	220	190	200	190
query64	1374	677	633	633
query65	3295	3213	3214	3213
query66	704	300	319	300
query67	15979	15696	15671	15671
query68	3927	583	581	581
query69	419	266	258	258
query70	1199	1127	1121	1121
query71	362	261	254	254
query72	6407	4220	4028	4028
query73	753	350	348	348
query74	10405	9419	9279	9279
query75	3376	2648	2660	2648
query76	1781	1108	1148	1108
query77	478	293	275	275
query78	10568	9602	9669	9602
query79	1780	597	614	597
query80	1345	444	433	433
query81	528	240	236	236
query82	1284	122	118	118
query83	277	139	144	139
query84	286	82	80	80
query85	1027	314	289	289
query86	439	312	283	283
query87	4437	4337	4315	4315
query88	3605	2353	2355	2353
query89	413	284	290	284
query90	1937	184	182	182
query91	178	153	150	150
query92	71	49	50	49
query93	2598	548	546	546
query94	892	290	303	290
query95	364	255	254	254
query96	627	283	279	279
query97	3349	3187	3213	3187
query98	212	201	198	198
query99	1746	1427	1431	1427
Total cold run time: 321335 ms
Total hot run time: 197806 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.05 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8fbff95162296d779a57f3d457d78d9458fe0e30, data reload: false

query1	0.04	0.03	0.02
query2	0.07	0.03	0.02
query3	0.23	0.06	0.06
query4	1.63	0.10	0.10
query5	0.54	0.52	0.52
query6	1.13	0.72	0.72
query7	0.02	0.02	0.01
query8	0.04	0.04	0.03
query9	0.56	0.52	0.51
query10	0.55	0.54	0.55
query11	0.14	0.10	0.11
query12	0.16	0.11	0.11
query13	0.62	0.59	0.59
query14	2.83	2.84	2.73
query15	0.89	0.82	0.82
query16	0.39	0.39	0.37
query17	1.08	1.06	1.02
query18	0.23	0.21	0.21
query19	2.01	1.85	2.04
query20	0.01	0.01	0.01
query21	15.36	0.58	0.57
query22	2.65	2.07	1.76
query23	16.79	1.04	0.71
query24	3.63	0.42	1.14
query25	0.14	0.11	0.08
query26	0.51	0.13	0.14
query27	0.05	0.05	0.04
query28	11.17	1.09	1.06
query29	12.55	3.26	3.26
query30	0.25	0.06	0.06
query31	2.86	0.38	0.39
query32	3.26	0.46	0.45
query33	2.98	3.02	3.09
query34	17.19	4.55	4.47
query35	4.58	4.52	4.57
query36	0.68	0.51	0.49
query37	0.09	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.03	0.02
query40	0.17	0.12	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.02	0.02
Total cold run time: 108.31 s
Total hot run time: 32.05 s

@morningman morningman closed this Feb 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants