[fix](Nereids) lock table when generate distribute plan

[924060929]

Proposed changes

We should lock table when generate distribute plan, because insert overwrite by async materialized view will drop partitions parallel, and query thread will throw exception:

java.lang.RuntimeException: Cannot invoke "org.apache.doris.catalog.Partition.getBaseIndex()" because "partition" is null
    at org.apache.doris.nereids.util.Utils.execWithUncheckedException(Utils.java:76) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.nereids.glue.translator.PhysicalPlanTranslator.translatePlan(PhysicalPlanTranslator.java:278) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.nereids.NereidsPlanner.splitFragments(NereidsPlanner.java:341) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.nereids.NereidsPlanner.distribute(NereidsPlanner.java:400) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.nereids.NereidsPlanner.plan(NereidsPlanner.java:147) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.qe.StmtExecutor.executeByNereids(StmtExecutor.java:796) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.qe.StmtExecutor.execute(StmtExecutor.java:605) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.qe.StmtExecutor.queryRetry(StmtExecutor.java:558) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.qe.StmtExecutor.execute(StmtExecutor.java:548) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.qe.ConnectProcessor.executeQuery(ConnectProcessor.java:385) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:237) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.qe.MysqlConnectProcessor.handleQuery(MysqlConnectProcessor.java:260) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.qe.MysqlConnectProcessor.dispatch(MysqlConnectProcessor.java:288) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.qe.MysqlConnectProcessor.processOnce(MysqlConnectProcessor.java:342) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.mysql.ReadListener.lambda$handleEvent$0(ReadListener.java:52) ~[doris-fe.jar:1.2-SNAPSHOT]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?]
    at java.lang.Thread.run(Thread.java:833) ~[?:?]
Caused by: java.lang.NullPointerException: Cannot invoke "org.apache.doris.catalog.Partition.getBaseIndex()" because "partition" is null
    at org.apache.doris.planner.OlapScanNode.mockRowCountInStatistic(OlapScanNode.java:589) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.planner.OlapScanNode.finalizeForNereids(OlapScanNode.java:1733) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.nereids.util.Utils.execWithUncheckedException(Utils.java:74) ~[doris-fe.jar:1.2-SNAPSHOT]
    ... 17 more
2024-07-29 00:46:17,608 WARN (mysql-nio-pool-114|201) Analyze failed. stmt[210035, 49d3041004ba4b6a-b07fe4491d03c5de]
org.apache.doris.common.NereidsException: errCode = 2, detailMessage = Cannot invoke "org.apache.doris.catalog.Partition.getBaseIndex()" because "partition" is null
    at org.apache.doris.qe.StmtExecutor.executeByNereids(StmtExecutor.java:803) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.qe.StmtExecutor.execute(StmtExecutor.java:605) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.qe.StmtExecutor.queryRetry(StmtExecutor.java:558) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.qe.StmtExecutor.execute(StmtExecutor.java:548) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.qe.ConnectProcessor.executeQuery(ConnectProcessor.java:385) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:237) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.qe.MysqlConnectProcessor.handleQuery(MysqlConnectProcessor.java:260) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.qe.MysqlConnectProcessor.dispatch(MysqlConnectProcessor.java:288) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.qe.MysqlConnectProcessor.processOnce(MysqlConnectProcessor.java:342) ~[doris-fe.jar:1.2-SNAPSHOT]
    at org.apache.doris.mysql.ReadListener.lambda$handleEvent$0(ReadListener.java:52) ~[doris-fe.jar:1.2-SNAPSHOT]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?]
    at java.lang.Thread.run(Thread.java:833) ~[?:?]

this exception is too hard to reproduce, so I can not write a test case

[doris-robot]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

[924060929]

run buildall

[doris-robot]

TPC-H: Total hot run time: 41937 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0e2d19d6aa7f2479ce7a0ef19ba38933d1d84257, data reload: false

------ Round 1 ----------------------------------
q1	17607	4148	4090	4090
q2	2020	205	200	200
q3	10447	1270	1329	1270
q4	10177	857	918	857
q5	7632	3031	3018	3018
q6	222	141	142	141
q7	1086	638	619	619
q8	9471	1931	1962	1931
q9	8536	6658	6620	6620
q10	8785	3880	3882	3880
q11	435	260	262	260
q12	420	237	235	235
q13	17768	2940	2959	2940
q14	274	249	244	244
q15	524	486	504	486
q16	527	408	387	387
q17	985	940	916	916
q18	8046	7404	7286	7286
q19	2861	1153	1223	1153
q20	554	325	332	325
q21	5482	4791	4920	4791
q22	355	288	290	288
Total cold run time: 114214 ms
Total hot run time: 41937 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4117	4071	4040	4040
q2	328	225	218	218
q3	3009	3137	3182	3137
q4	2079	2000	2038	2000
q5	5615	5525	5453	5453
q6	231	150	142	142
q7	2218	1873	1783	1783
q8	3360	3436	3369	3369
q9	8726	8829	8751	8751
q10	4051	3951	4053	3951
q11	581	465	464	464
q12	783	645	599	599
q13	16411	3145	3164	3145
q14	310	273	283	273
q15	522	499	499	499
q16	468	434	434	434
q17	1759	1813	1744	1744
q18	8368	7711	7737	7711
q19	2439	1764	1743	1743
q20	2051	1874	1854	1854
q21	5893	5434	5527	5434
q22	549	463	459	459
Total cold run time: 73868 ms
Total hot run time: 57203 ms

[doris-robot]

TPC-DS: Total hot run time: 169893 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0e2d19d6aa7f2479ce7a0ef19ba38933d1d84257, data reload: false

query1	908	379	371	371
query2	6461	1672	1682	1672
query3	6662	221	219	219
query4	18971	17440	17253	17253
query5	3626	514	532	514
query6	267	171	173	171
query7	4593	301	305	301
query8	268	195	206	195
query9	8494	2395	2369	2369
query10	441	276	288	276
query11	10581	10054	10110	10054
query12	125	91	86	86
query13	1637	388	374	374
query14	9507	7312	6596	6596
query15	207	163	169	163
query16	6959	465	475	465
query17	969	592	568	568
query18	1835	285	297	285
query19	194	148	148	148
query20	91	86	91	86
query21	206	105	101	101
query22	4245	4113	4036	4036
query23	33944	33998	33896	33896
query24	9305	3184	3040	3040
query25	644	429	411	411
query26	1350	154	157	154
query27	3005	292	297	292
query28	7295	2048	2011	2011
query29	1113	445	454	445
query30	233	157	153	153
query31	968	792	823	792
query32	101	55	57	55
query33	679	328	345	328
query34	919	497	534	497
query35	846	751	751	751
query36	1092	923	868	868
query37	170	85	81	81
query38	2948	2832	2765	2765
query39	852	815	825	815
query40	271	113	129	113
query41	46	43	47	43
query42	122	97	98	97
query43	464	409	429	409
query44	1170	725	738	725
query45	215	181	181	181
query46	1075	806	792	792
query47	1860	1739	1719	1719
query48	360	300	301	300
query49	943	430	426	426
query50	890	448	433	433
query51	6934	6681	6640	6640
query52	96	92	87	87
query53	263	184	179	179
query54	634	456	476	456
query55	73	75	76	75
query56	266	267	255	255
query57	1125	1025	1053	1025
query58	273	267	278	267
query59	2560	2401	2327	2327
query60	313	279	275	275
query61	96	91	94	91
query62	885	662	644	644
query63	212	185	179	179
query64	5654	1903	1913	1903
query65	3175	3100	3077	3077
query66	1188	338	329	329
query67	15152	15089	14896	14896
query68	5755	588	581	581
query69	686	383	319	319
query70	1168	1083	1040	1040
query71	439	292	275	275
query72	7516	2699	2511	2511
query73	916	344	331	331
query74	6007	5672	5743	5672
query75	3404	2731	2753	2731
query76	3123	1277	1291	1277
query77	545	309	323	309
query78	9515	8929	8799	8799
query79	2584	537	533	533
query80	1695	503	560	503
query81	544	228	226	226
query82	1425	135	142	135
query83	310	181	173	173
query84	261	83	78	78
query85	1392	334	308	308
query86	487	291	291	291
query87	3282	3086	3093	3086
query88	3680	2441	2452	2441
query89	399	289	289	289
query90	1753	200	194	194
query91	122	112	109	109
query92	57	49	52	49
query93	2241	629	616	616
query94	788	351	306	306
query95	393	273	266	266
query96	620	286	284	284
query97	3242	3079	3080	3079
query98	217	197	194	194
query99	1645	1288	1295	1288
Total cold run time: 265237 ms
Total hot run time: 169893 ms

[doris-robot]

ClickBench: Total hot run time: 30.66 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0e2d19d6aa7f2479ce7a0ef19ba38933d1d84257, data reload: false

query1	0.05	0.04	0.04
query2	0.06	0.04	0.03
query3	0.22	0.05	0.05
query4	1.68	0.06	0.06
query5	0.48	0.48	0.48
query6	1.13	0.72	0.72
query7	0.02	0.02	0.01
query8	0.05	0.04	0.05
query9	0.57	0.51	0.52
query10	0.55	0.58	0.56
query11	0.16	0.12	0.12
query12	0.15	0.13	0.13
query13	0.62	0.61	0.60
query14	0.77	0.79	0.79
query15	0.91	0.87	0.88
query16	0.36	0.36	0.35
query17	1.01	0.98	1.00
query18	0.23	0.22	0.21
query19	1.83	1.71	1.78
query20	0.01	0.02	0.01
query21	15.40	0.73	0.66
query22	3.75	7.48	1.93
query23	17.97	1.40	1.30
query24	2.27	0.22	0.22
query25	0.20	0.09	0.08
query26	0.32	0.21	0.21
query27	0.46	0.24	0.23
query28	13.18	1.00	0.98
query29	12.53	3.27	3.25
query30	0.26	0.06	0.05
query31	2.85	0.41	0.41
query32	3.24	0.49	0.51
query33	2.89	2.96	2.96
query34	15.44	4.24	4.29
query35	4.31	4.31	4.30
query36	0.67	0.49	0.49
query37	0.19	0.16	0.17
query38	0.17	0.15	0.15
query39	0.05	0.03	0.04
query40	0.16	0.13	0.13
query41	0.10	0.04	0.04
query42	0.05	0.04	0.05
query43	0.05	0.04	0.04
Total cold run time: 107.37 s
Total hot run time: 30.66 s

[github-actions]

PR approved by at least one committer and no changes requested.

[github-actions]

PR approved by anyone and no changes requested.