Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

mysql_to_doris构建实时同步任务失败 #261

Closed
iskuli opened this issue Sep 3, 2023 · 1 comment
Closed

mysql_to_doris构建实时同步任务失败 #261

iskuli opened this issue Sep 3, 2023 · 1 comment
Labels
bug Something isn't working
Milestone
v3.8.0

Comments

@iskuli
Copy link

iskuli commented Sep 3, 2023 •
edited by baisui1981
Loading

  1. 手动同步是成功的
  2. doris的目标表已经删除
  3. 构建实时任务，在stream脚本部署时提示字段不匹配以下是错误信息

字段add_dt source和sink端，两边映射的类型不一致
从反馈信息，使用mysql5 驱动能正常执行，但，使用mysql8 不能正常执行
res: https://github.com/qlangtech/tis-parent/issues/1

Query schema: [add_dt: DATE, trade_time: TIMESTAMP(3), pay_time: TIMESTAMP(3), dt: DATE, trade_id: INT, trade_no: VARCHAR(40), src_tids: VARCHAR(255), trade_type: INT, trade_status: INT, refund_status: INT, is_del: TINYINT, platform_id: INT, platform_name: VARCHAR(50), plat: VARCHAR(255), shop_id: INT, shop_no: VARCHAR(20), shop_name2: VARCHAR(128), department: VARCHAR(50), dept_name: VARCHAR(50), dept_group2: VARCHAR(150), goods_id: INT, goods_no: VARCHAR(40), goods_name: VARCHAR(255), short_goods_name: VARCHAR(255), brand_id: INT, brand_no: VARCHAR(255), brand_name: VARCHAR(255), classify_id: INT, classify_name: VARCHAR(255), general_classify_name: VARCHAR(255), order_num: DECIMAL(19, 4), order_price: DECIMAL(19, 4), paid: DECIMAL(19, 4), receiver_area: VARCHAR(128), receiver_province_id: INT, receiver_city_id: INT, receiver_district_id: INT, warehouse_id: INT, warehouse_no: VARCHAR(40), warehouse_name: VARCHAR(64), logistics_id: INT, logistics_code: VARCHAR(20), logistics_name: VARCHAR(40), customer_id: INT, buyer_nick: VARCHAR(100), buyer_message: VARCHAR(65535), cs_remark: VARCHAR(65535), platform_goods_id: VARCHAR(40), platform_spec_id: VARCHAR(40), flag_name: VARCHAR(255), shop_status: INT, suite_no: VARCHAR(40), suite_name: VARCHAR(255), shop_name: VARCHAR(120), dept_group: VARCHAR(100)]
Sink schema: [add_dt: VARCHAR(10), trade_time: VARCHAR(19), pay_time: VARCHAR(19), dt: VARCHAR(10), trade_id: INT, trade_no: VARCHAR(120), src_tids: VARCHAR(765), trade_type: INT, trade_status: INT, refund_status: INT, is_del: TINYINT, platform_id: INT, platform_name: VARCHAR(150), plat: VARCHAR(765), shop_id: INT, shop_no: VARCHAR(60), shop_name2: VARCHAR(384), department: VARCHAR(150), dept_name: VARCHAR(150), dept_group2: VARCHAR(450), goods_id: INT, goods_no: VARCHAR(120), goods_name: VARCHAR(765), short_goods_name: VARCHAR(765), brand_id: INT, brand_no: VARCHAR(765), brand_name: VARCHAR(765), classify_id: INT, classify_name: VARCHAR(765), general_classify_name: VARCHAR(765), order_num: VARCHAR(19), order_price: VARCHAR(19), paid: VARCHAR(19), receiver_area: VARCHAR(384), receiver_province_id: INT, receiver_city_id: INT, receiver_district_id: INT, warehouse_id: INT, warehouse_no: VARCHAR(120), warehouse_name: VARCHAR(192), logistics_id: INT, logistics_code: VARCHAR(60), logistics_name: VARCHAR(120), customer_id: INT, buyer_nick: VARCHAR(300), buyer_message: VARCHAR(65000), cs_remark: VARCHAR(65000), platform_goods_id: VARCHAR(120), platform_spec_id: VARCHAR(120), flag_name: VARCHAR(765), shop_status: INT, suite_no: VARCHAR(120), suite_name: VARCHAR(765), shop_name: VARCHAR(360), dept_group: VARCHAR(300)]
2023-09-03 16:16:03 INFO  executeaction- com.qlangtech.tis.coredefine.module.action.CoreAction:doDeployIncrSyncChannal
2023-09-03 16:16:03 INFO  c.q.tis.plugin.incr.TISSinkFactory- sinkFactories size:1
2023-09-03 16:16:03 INFO  c.q.p.incr.flink.utils.UberJarUtil- streamUberJar path:/opt/software/tis/tis-uber/data/cfg_repo/streamscript/shishi/0/shishi-incr.jar
2023-09-03 16:16:03 INFO  c.q.tis.plugin.incr.TISSinkFactory- sinkFactories size:1
Sun Sep 03 16:16:03 CST 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
2023-09-03 16:16:03 INFO  c.q.t.p.d.c.BasicDataXRdbmsWriter- table:t2,cols:add_dt,trade_time,pay_time,dt,trade_id,trade_no,src_tids,trade_type,trade_status,refund_status,is_del,platform_id,platform_name,plat,shop_id,shop_no,shop_name2,department,dept_name,dept_group2,goods_id,goods_no,goods_name,short_goods_name,brand_id,brand_no,brand_name,classify_id,classify_name,general_classify_name,order_num,order_price,paid,receiver_area,receiver_province_id,receiver_city_id,receiver_district_id,warehouse_id,warehouse_no,warehouse_name,logistics_id,logistics_code,logistics_name,customer_id,buyer_nick,buyer_message,cs_remark,platform_goods_id,platform_spec_id,flag_name,shop_status,suite_no,suite_name,shop_name,dept_group already exist ,skip the create table step
Sun Sep 03 16:16:03 CST 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
Sun Sep 03 16:16:03 CST 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
2023-09-03 16:16:03 INFO  c.q.t.p.ds.BasicDataSourceFactory- tabmeta:t2,colsSize:55,cols:add_dt,trade_time,pay_time,dt,trade_id,trade_no,src_tids,trade_type,trade_status,refund_status,is_del,platform_id,platform_name,plat,shop_id,shop_no,shop_name2,department,dept_name,dept_group2,goods_id,goods_no,goods_name,short_goods_name,brand_id,brand_no,brand_name,classify_id,classify_name,general_classify_name,order_num,order_price,paid,receiver_area,receiver_province_id,receiver_city_id,receiver_district_id,warehouse_id,warehouse_no,warehouse_name,logistics_id,logistics_code,logistics_name,customer_id,buyer_nick,buyer_message,cs_remark,platform_goods_id,platform_spec_id,flag_name,shop_status,suite_no,suite_name,shop_name,dept_group
2023-09-03 16:16:03 INFO  c.q.t.p.flink.client.FlinkClient- start submit jar request,entryClass:com.qlangtech.plugins.incr.flink.TISFlinkCDCStart
2023-09-03 16:16:03 INFO  c.q.p.i.f.TISFlinkClassLoaderFactory- create Flink app classloader:file:/opt/software/tis/tis-uber/data/cfg_repo/streamscript/shishi/0/shishi-incr.jar,resolveOrder:CHILD_FIRST
2023-09-03 16:16:03 INFO  c.q.t.extension.impl.PluginManifest- start to explode archive:/opt/software/tis/tis-uber/data/libs/plugins/flink/shishi.tpi
2023-09-03 16:16:04 INFO  c.q.t.e.init.InitReactorRunner- Started initialization
2023-09-03 16:16:04 INFO  c.q.t.e.init.InitReactorRunner- Attained null
2023-09-03 16:16:04 INFO  c.q.t.e.init.InitReactorRunner- Listed all plugins
2023-09-03 16:16:04 INFO  c.q.t.e.init.InitReactorRunner- Attained null
2023-09-03 16:16:04 INFO  c.q.t.e.init.InitReactorRunner- Attained null
2023-09-03 16:16:04 INFO  c.q.t.e.init.InitReactorRunner- Prepared all plugins
2023-09-03 16:16:04 INFO  c.q.t.e.init.InitReactorRunner- Attained null
2023-09-03 16:16:04 INFO  c.q.t.e.init.InitReactorRunner- Attained null
2023-09-03 16:16:04 INFO  c.q.t.e.init.InitReactorRunner- Attained null
2023-09-03 16:16:04 INFO  c.q.t.e.init.InitReactorRunner- Started all plugins
2023-09-03 16:16:04 INFO  c.q.t.e.init.InitReactorRunner- Attained null
2023-09-03 16:16:04 INFO  c.q.t.e.init.InitReactorRunner- Completed initialization
2023-09-03 16:16:04 INFO  c.q.t.e.init.InitReactorRunner- Attained null
2023-09-03 16:16:04 INFO  c.q.tis.extension.PluginManager- Plugin flink/shishi:3.7.2 dynamically installed
2023-09-03 16:16:04 INFO  c.q.t.p.flink.client.FlinkClient- currThread:qtp1166807841-92,0. PackagedProgram create,Consume:39 ms
2023-09-03 16:16:04 INFO  c.q.p.incr.flink.TISFlinkCDCStart- start to load extendsion of BasicFlinkSourceHandle
2023-09-03 16:16:04 INFO  c.q.t.e.impl.ClassicPluginStrategy- Scout-loading ExtensionList: class com.qlangtech.tis.realtime.BasicFlinkSourceHandle
2023-09-03 16:16:04 INFO  c.q.tis.plugin.incr.TISSinkFactory- sinkFactories size:1
2023-09-03 16:16:04 INFO  c.q.t.p.ds.BasicDataSourceFactory- tabmeta:t2,colsSize:55,cols:add_dt,trade_time,pay_time,dt,trade_id,trade_no,src_tids,trade_type,trade_status,refund_status,is_del,platform_id,platform_name,plat,shop_id,shop_no,shop_name2,department,dept_name,dept_group2,goods_id,goods_no,goods_name,short_goods_name,brand_id,brand_no,brand_name,classify_id,classify_name,general_classify_name,order_num,order_price,paid,receiver_area,receiver_province_id,receiver_city_id,receiver_district_id,warehouse_id,warehouse_no,warehouse_name,logistics_id,logistics_code,logistics_name,customer_id,buyer_nick,buyer_message,cs_remark,platform_goods_id,platform_spec_id,flag_name,shop_status,suite_no,suite_name,shop_name,dept_group
2023-09-03 16:16:04 INFO  c.q.t.p.ds.BasicDataSourceFactory- tabmeta:t2,colsSize:55,cols:add_dt,trade_time,pay_time,dt,trade_id,trade_no,src_tids,trade_type,trade_status,refund_status,is_del,platform_id,platform_name,plat,shop_id,shop_no,shop_name2,department,dept_name,dept_group2,goods_id,goods_no,goods_name,short_goods_name,brand_id,brand_no,brand_name,classify_id,classify_name,general_classify_name,order_num,order_price,paid,receiver_area,receiver_province_id,receiver_city_id,receiver_district_id,warehouse_id,warehouse_no,warehouse_name,logistics_id,logistics_code,logistics_name,customer_id,buyer_nick,buyer_message,cs_remark,platform_goods_id,platform_spec_id,flag_name,shop_status,suite_no,suite_name,shop_name,dept_group
Sun Sep 03 16:16:04 CST 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
2023-09-03 16:16:04 INFO  c.q.t.p.d.c.BasicDataXRdbmsWriter- table:t2,cols:add_dt,trade_time,pay_time,dt,trade_id,trade_no,src_tids,trade_type,trade_status,refund_status,is_del,platform_id,platform_name,plat,shop_id,shop_no,shop_name2,department,dept_name,dept_group2,goods_id,goods_no,goods_name,short_goods_name,brand_id,brand_no,brand_name,classify_id,classify_name,general_classify_name,order_num,order_price,paid,receiver_area,receiver_province_id,receiver_city_id,receiver_district_id,warehouse_id,warehouse_no,warehouse_name,logistics_id,logistics_code,logistics_name,customer_id,buyer_nick,buyer_message,cs_remark,platform_goods_id,platform_spec_id,flag_name,shop_status,suite_no,suite_name,shop_name,dept_group already exist ,skip the create table step
Sun Sep 03 16:16:04 CST 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
2023-09-03 16:16:04 INFO  c.q.t.p.ds.BasicDataSourceFactory- tabmeta:t2,colsSize:55,cols:add_dt,trade_time,pay_time,dt,trade_id,trade_no,src_tids,trade_type,trade_status,refund_status,is_del,platform_id,platform_name,plat,shop_id,shop_no,shop_name2,department,dept_name,dept_group2,goods_id,goods_no,goods_name,short_goods_name,brand_id,brand_no,brand_name,classify_id,classify_name,general_classify_name,order_num,order_price,paid,receiver_area,receiver_province_id,receiver_city_id,receiver_district_id,warehouse_id,warehouse_no,warehouse_name,logistics_id,logistics_code,logistics_name,customer_id,buyer_nick,buyer_message,cs_remark,platform_goods_id,platform_spec_id,flag_name,shop_status,suite_no,suite_name,shop_name,dept_group
2023-09-03 16:16:04 INFO  c.q.tis.plugin.incr.TISSinkFactory- sinkFactories size:1
Sun Sep 03 16:16:04 CST 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
2023-09-03 16:16:04 INFO  c.q.t.p.ds.BasicDataSourceFactory- tabmeta:t2,colsSize:55,cols:add_dt,trade_time,pay_time,dt,trade_id,trade_no,src_tids,trade_type,trade_status,refund_status,is_del,platform_id,platform_name,plat,shop_id,shop_no,shop_name2,department,dept_name,dept_group2,goods_id,goods_no,goods_name,short_goods_name,brand_id,brand_no,brand_name,classify_id,classify_name,general_classify_name,order_num,order_price,paid,receiver_area,receiver_province_id,receiver_city_id,receiver_district_id,warehouse_id,warehouse_no,warehouse_name,logistics_id,logistics_code,logistics_name,customer_id,buyer_nick,buyer_message,cs_remark,platform_goods_id,platform_spec_id,flag_name,shop_status,suite_no,suite_name,shop_name,dept_group
2023-09-03 16:16:04 INFO  c.q.t.c.module.action.CoreAction- flink sync app:shishi
 compile and package consume:6ms an error occur:The main method caused an error: Column types of query result and sink for registered table 'default_catalog.default_database.t2' do not match.
Cause: Incompatible types for sink column 'add_dt' at position 0.

Query schema: [add_dt: DATE, trade_time: TIMESTAMP(3), pay_time: TIMESTAMP(3), dt: DATE, trade_id: INT, trade_no: VARCHAR(40), src_tids: VARCHAR(255), trade_type: INT, trade_status: INT, refund_status: INT, is_del: TINYINT, platform_id: INT, platform_name: VARCHAR(50), plat: VARCHAR(255), shop_id: INT, shop_no: VARCHAR(20), shop_name2: VARCHAR(128), department: VARCHAR(50), dept_name: VARCHAR(50), dept_group2: VARCHAR(150), goods_id: INT, goods_no: VARCHAR(40), goods_name: VARCHAR(255), short_goods_name: VARCHAR(255), brand_id: INT, brand_no: VARCHAR(255), brand_name: VARCHAR(255), classify_id: INT, classify_name: VARCHAR(255), general_classify_name: VARCHAR(255), order_num: DECIMAL(19, 4), order_price: DECIMAL(19, 4), paid: DECIMAL(19, 4), receiver_area: VARCHAR(128), receiver_province_id: INT, receiver_city_id: INT, receiver_district_id: INT, warehouse_id: INT, warehouse_no: VARCHAR(40), warehouse_name: VARCHAR(64), logistics_id: INT, logistics_code: VARCHAR(20), logistics_name: VARCHAR(40), customer_id: INT, buyer_nick: VARCHAR(100), buyer_message: VARCHAR(65535), cs_remark: VARCHAR(65535), platform_goods_id: VARCHAR(40), platform_spec_id: VARCHAR(40), flag_name: VARCHAR(255), shop_status: INT, suite_no: VARCHAR(40), suite_name: VARCHAR(255), shop_name: VARCHAR(120), dept_group: VARCHAR(100)]
Sink schema:  [add_dt: VARCHAR(10), trade_time: VARCHAR(19), pay_time: VARCHAR(19), dt: VARCHAR(10), trade_id: INT, trade_no: VARCHAR(120), src_tids: VARCHAR(765), trade_type: INT, trade_status: INT, refund_status: INT, is_del: TINYINT, platform_id: INT, platform_name: VARCHAR(150), plat: VARCHAR(765), shop_id: INT, shop_no: VARCHAR(60), shop_name2: VARCHAR(384), department: VARCHAR(150), dept_name: VARCHAR(150), dept_group2: VARCHAR(450), goods_id: INT, goods_no: VARCHAR(120), goods_name: VARCHAR(765), short_goods_name: VARCHAR(765), brand_id: INT, brand_no: VARCHAR(765), brand_name: VARCHAR(765), classify_id: INT, classify_name: VARCHAR(765), general_classify_name: VARCHAR(765), order_num: VARCHAR(19), order_price: VARCHAR(19), paid: VARCHAR(19), receiver_area: VARCHAR(384), receiver_province_id: INT, receiver_city_id: INT, receiver_district_id: INT, warehouse_id: INT, warehouse_no: VARCHAR(120), warehouse_name: VARCHAR(192), logistics_id: INT, logistics_code: VARCHAR(60), logistics_name: VARCHAR(120), customer_id: INT, buyer_nick: VARCHAR(300), buyer_message: VARCHAR(65000), cs_remark: VARCHAR(65000), platform_goods_id: VARCHAR(120), platform_spec_id: VARCHAR(120), flag_name: VARCHAR(765), shop_status: INT, suite_no: VARCHAR(120), suite_name: VARCHAR(765), shop_name: VARCHAR(360), dept_group: VARCHAR(300)]
2023-09-03 16:16:04 ERROR  c.q.t.m.c.v.TisExceptionInterceptor- null
java.lang.reflect.InvocationTargetException: null
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.qlangtech.tis.runtime.module.action.BasicModule.execute(BasicModule.java:118)
	at sun.reflect.GeneratedMethodAccessor41.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at ognl.OgnlRuntime.invokeMethod(OgnlRuntime.java:899)
	at ognl.OgnlRuntime.callAppropriateMethod(OgnlRuntime.java:1544)
	at ognl.ObjectMethodAccessor.callMethod(ObjectMethodAccessor.java:68)
	at com.opensymphony.xwork2.ognl.accessor.XWorkMethodAccessor.callMethodWithDebugInfo(XWorkMethodAccessor.java:98)
	at com.opensymphony.xwork2.ognl.accessor.XWorkMethodAccessor.callMethod(XWorkMethodAccessor.java:90)
	at ognl.OgnlRuntime.callMethod(OgnlRuntime.java:1620)
	at ognl.ASTMethod.getValueBody(ASTMethod.java:91)
	at ognl.SimpleNode.evaluateGetValueBody(SimpleNode.java:212)
	at ognl.SimpleNode.getValue(SimpleNode.java:258)
	at ognl.Ognl.getValue(Ognl.java:470)
	at ognl.Ognl.getValue(Ognl.java:434)
	at com.opensymphony.xwork2.ognl.OgnlUtil$3.execute(OgnlUtil.java:401)
	at com.opensymphony.xwork2.ognl.OgnlUtil.compileAndExecuteMethod(OgnlUtil.java:453)
	at com.opensymphony.xwork2.ognl.OgnlUtil.callMethod(OgnlUtil.java:399)
	at com.opensymphony.xwork2.DefaultActionInvocation.invokeAction(DefaultActionInvocation.java:438)
	at com.opensymphony.xwork2.DefaultActionInvocation.invokeActionOnly(DefaultActionInvocation.java:293)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:254)
	at org.apache.struts2.interceptor.debugging.DebuggingInterceptor.intercept(DebuggingInterceptor.java:250)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at com.opensymphony.xwork2.interceptor.DefaultWorkflowInterceptor.doIntercept(DefaultWorkflowInterceptor.java:179)
	at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:99)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at com.opensymphony.xwork2.validator.ValidationInterceptor.doIntercept(ValidationInterceptor.java:263)
	at org.apache.struts2.interceptor.validation.AnnotationValidationInterceptor.doIntercept(AnnotationValidationInterceptor.java:49)
	at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:99)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at com.opensymphony.xwork2.interceptor.ConversionErrorInterceptor.doIntercept(ConversionErrorInterceptor.java:142)
	at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:99)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at com.opensymphony.xwork2.interceptor.ParametersInterceptor.doIntercept(ParametersInterceptor.java:137)
	at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:99)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at com.opensymphony.xwork2.interceptor.ParametersInterceptor.doIntercept(ParametersInterceptor.java:137)
	at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:99)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at com.opensymphony.xwork2.interceptor.StaticParametersInterceptor.intercept(StaticParametersInterceptor.java:201)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at org.apache.struts2.interceptor.MultiselectInterceptor.intercept(MultiselectInterceptor.java:67)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at org.apache.struts2.interceptor.DateTextFieldInterceptor.intercept(DateTextFieldInterceptor.java:133)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at org.apache.struts2.interceptor.CheckboxInterceptor.intercept(CheckboxInterceptor.java:89)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at org.apache.struts2.interceptor.FileUploadInterceptor.intercept(FileUploadInterceptor.java:243)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at com.opensymphony.xwork2.interceptor.ModelDrivenInterceptor.intercept(ModelDrivenInterceptor.java:101)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at com.opensymphony.xwork2.interceptor.ScopedModelDrivenInterceptor.intercept(ScopedModelDrivenInterceptor.java:142)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at com.opensymphony.xwork2.interceptor.ChainingInterceptor.intercept(ChainingInterceptor.java:160)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at com.opensymphony.xwork2.interceptor.PrepareInterceptor.doIntercept(PrepareInterceptor.java:175)
	at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:99)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at org.apache.struts2.interceptor.I18nInterceptor.intercept(I18nInterceptor.java:121)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at org.apache.struts2.interceptor.ServletConfigInterceptor.intercept(ServletConfigInterceptor.java:167)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at com.opensymphony.xwork2.interceptor.AliasInterceptor.intercept(AliasInterceptor.java:203)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at com.opensymphony.xwork2.interceptor.ExceptionMappingInterceptor.intercept(ExceptionMappingInterceptor.java:196)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at com.qlangtech.tis.manage.common.valve.OperationLogInterceptor.doIntercept(OperationLogInterceptor.java:64)
	at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:99)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at com.qlangtech.tis.manage.common.valve.TisExceptionInterceptor.doIntercept(TisExceptionInterceptor.java:86)
	at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:99)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at com.qlangtech.tis.manage.spring.aop.AuthorityCheckAdvice.doIntercept(AuthorityCheckAdvice.java:92)
	at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:99)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at com.opensymphony.xwork2.interceptor.ParametersInterceptor.doIntercept(ParametersInterceptor.java:137)
	at com.opensymphony.xwork2.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:99)
	at com.opensymphony.xwork2.DefaultActionInvocation.invoke(DefaultActionInvocation.java:249)
	at org.apache.struts2.factory.StrutsActionProxy.execute(StrutsActionProxy.java:48)
	at org.apache.struts2.dispatcher.Dispatcher.serviceAction(Dispatcher.java:574)
	at org.apache.struts2.dispatcher.ExecuteOperations.executeAction(ExecuteOperations.java:79)
	at org.apache.struts2.dispatcher.servlet.StrutsServlet.service(StrutsServlet.java:80)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
	at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411)
	at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651)
	at com.qlangtech.tis.manage.common.DefaultFilter.doFilter(DefaultFilter.java:169)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:59)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.Server.handle(Server.java:501)
	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
	at java.lang.Thread.run(Thread.java:748)
Caused by: com.qlangtech.tis.lang.TisException: The main method caused an error: Column types of query result and sink for registered table 'default_catalog.default_database.t2' do not match.
Cause: Incompatible types for sink column 'add_dt' at position 0.

Query schema: [add_dt: DATE, trade_time: TIMESTAMP(3), pay_time: TIMESTAMP(3), dt: DATE, trade_id: INT, trade_no: VARCHAR(40), src_tids: VARCHAR(255), trade_type: INT, trade_status: INT, refund_status: INT, is_del: TINYINT, platform_id: INT, platform_name: VARCHAR(50), plat: VARCHAR(255), shop_id: INT, shop_no: VARCHAR(20), shop_name2: VARCHAR(128), department: VARCHAR(50), dept_name: VARCHAR(50), dept_group2: VARCHAR(150), goods_id: INT, goods_no: VARCHAR(40), goods_name: VARCHAR(255), short_goods_name: VARCHAR(255), brand_id: INT, brand_no: VARCHAR(255), brand_name: VARCHAR(255), classify_id: INT, classify_name: VARCHAR(255), general_classify_name: VARCHAR(255), order_num: DECIMAL(19, 4), order_price: DECIMAL(19, 4), paid: DECIMAL(19, 4), receiver_area: VARCHAR(128), receiver_province_id: INT, receiver_city_id: INT, receiver_district_id: INT, warehouse_id: INT, warehouse_no: VARCHAR(40), warehouse_name: VARCHAR(64), logistics_id: INT, logistics_code: VARCHAR(20), logistics_name: VARCHAR(40), customer_id: INT, buyer_nick: VARCHAR(100), buyer_message: VARCHAR(65535), cs_remark: VARCHAR(65535), platform_goods_id: VARCHAR(40), platform_spec_id: VARCHAR(40), flag_name: VARCHAR(255), shop_status: INT, suite_no: VARCHAR(40), suite_name: VARCHAR(255), shop_name: VARCHAR(120), dept_group: VARCHAR(100)]
Sink schema:  [add_dt: VARCHAR(10), trade_time: VARCHAR(19), pay_time: VARCHAR(19), dt: VARCHAR(10), trade_id: INT, trade_no: VARCHAR(120), src_tids: VARCHAR(765), trade_type: INT, trade_status: INT, refund_status: INT, is_del: TINYINT, platform_id: INT, platform_name: VARCHAR(150), plat: VARCHAR(765), shop_id: INT, shop_no: VARCHAR(60), shop_name2: VARCHAR(384), department: VARCHAR(150), dept_name: VARCHAR(150), dept_group2: VARCHAR(450), goods_id: INT, goods_no: VARCHAR(120), goods_name: VARCHAR(765), short_goods_name: VARCHAR(765), brand_id: INT, brand_no: VARCHAR(765), brand_name: VARCHAR(765), classify_id: INT, classify_name: VARCHAR(765), general_classify_name: VARCHAR(765), order_num: VARCHAR(19), order_price: VARCHAR(19), paid: VARCHAR(19), receiver_area: VARCHAR(384), receiver_province_id: INT, receiver_city_id: INT, receiver_district_id: INT, warehouse_id: INT, warehouse_no: VARCHAR(120), warehouse_name: VARCHAR(192), logistics_id: INT, logistics_code: VARCHAR(60), logistics_name: VARCHAR(120), customer_id: INT, buyer_nick: VARCHAR(300), buyer_message: VARCHAR(65000), cs_remark: VARCHAR(65000), platform_goods_id: VARCHAR(120), platform_spec_id: VARCHAR(120), flag_name: VARCHAR(765), shop_status: INT, suite_no: VARCHAR(120), suite_name: VARCHAR(765), shop_name: VARCHAR(360), dept_group: VARCHAR(300)]
	at com.qlangtech.tis.lang.TisException.create(TisException.java:88)
	at com.qlangtech.tis.coredefine.module.action.CoreAction.doDeployIncrSyncChannal(CoreAction.java:554)
	... 119 common frames omitted
Caused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Column types of query result and sink for registered table 'default_catalog.default_database.t2' do not match.
Cause: Incompatible types for sink column 'add_dt' at position 0.

Query schema: [add_dt: DATE, trade_time: TIMESTAMP(3), pay_time: TIMESTAMP(3), dt: DATE, trade_id: INT, trade_no: VARCHAR(40), src_tids: VARCHAR(255), trade_type: INT, trade_status: INT, refund_status: INT, is_del: TINYINT, platform_id: INT, platform_name: VARCHAR(50), plat: VARCHAR(255), shop_id: INT, shop_no: VARCHAR(20), shop_name2: VARCHAR(128), department: VARCHAR(50), dept_name: VARCHAR(50), dept_group2: VARCHAR(150), goods_id: INT, goods_no: VARCHAR(40), goods_name: VARCHAR(255), short_goods_name: VARCHAR(255), brand_id: INT, brand_no: VARCHAR(255), brand_name: VARCHAR(255), classify_id: INT, classify_name: VARCHAR(255), general_classify_name: VARCHAR(255), order_num: DECIMAL(19, 4), order_price: DECIMAL(19, 4), paid: DECIMAL(19, 4), receiver_area: VARCHAR(128), receiver_province_id: INT, receiver_city_id: INT, receiver_district_id: INT, warehouse_id: INT, warehouse_no: VARCHAR(40), warehouse_name: VARCHAR(64), logistics_id: INT, logistics_code: VARCHAR(20), logistics_name: VARCHAR(40), customer_id: INT, buyer_nick: VARCHAR(100), buyer_message: VARCHAR(65535), cs_remark: VARCHAR(65535), platform_goods_id: VARCHAR(40), platform_spec_id: VARCHAR(40), flag_name: VARCHAR(255), shop_status: INT, suite_no: VARCHAR(40), suite_name: VARCHAR(255), shop_name: VARCHAR(120), dept_group: VARCHAR(100)]
Sink schema:  [add_dt: VARCHAR(10), trade_time: VARCHAR(19), pay_time: VARCHAR(19), dt: VARCHAR(10), trade_id: INT, trade_no: VARCHAR(120), src_tids: VARCHAR(765), trade_type: INT, trade_status: INT, refund_status: INT, is_del: TINYINT, platform_id: INT, platform_name: VARCHAR(150), plat: VARCHAR(765), shop_id: INT, shop_no: VARCHAR(60), shop_name2: VARCHAR(384), department: VARCHAR(150), dept_name: VARCHAR(150), dept_group2: VARCHAR(450), goods_id: INT, goods_no: VARCHAR(120), goods_name: VARCHAR(765), short_goods_name: VARCHAR(765), brand_id: INT, brand_no: VARCHAR(765), brand_name: VARCHAR(765), classify_id: INT, classify_name: VARCHAR(765), general_classify_name: VARCHAR(765), order_num: VARCHAR(19), order_price: VARCHAR(19), paid: VARCHAR(19), receiver_area: VARCHAR(384), receiver_province_id: INT, receiver_city_id: INT, receiver_district_id: INT, warehouse_id: INT, warehouse_no: VARCHAR(120), warehouse_name: VARCHAR(192), logistics_id: INT, logistics_code: VARCHAR(60), logistics_name: VARCHAR(120), customer_id: INT, buyer_nick: VARCHAR(300), buyer_message: VARCHAR(65000), cs_remark: VARCHAR(65000), platform_goods_id: VARCHAR(120), platform_spec_id: VARCHAR(120), flag_name: VARCHAR(765), shop_status: INT, suite_no: VARCHAR(120), suite_name: VARCHAR(765), shop_name: VARCHAR(360), dept_group: VARCHAR(300)]
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372)
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)
	at org.apache.flink.client.program.PackagedProgramUtils.getPipelineFromProgram(PackagedProgramUtils.java:158)
	at org.apache.flink.client.program.PackagedProgramUtils.createJobGraph(PackagedProgramUtils.java:82)
	at org.apache.flink.client.program.PackagedProgramUtils.createJobGraph(PackagedProgramUtils.java:117)
	at com.qlangtech.tis.plugins.flink.client.FlinkClient.submitJar(FlinkClient.java:90)
	at com.qlangtech.plugins.incr.flink.launch.FlinkTaskNodeController.deploy(FlinkTaskNodeController.java:167)
	at com.qlangtech.plugins.incr.flink.launch.FlinkTaskNodeController.deploy(FlinkTaskNodeController.java:137)
	at com.qlangtech.tis.coredefine.module.action.TISK8sDelegate.deploy(TISK8sDelegate.java:137)
	at com.qlangtech.tis.coredefine.module.action.CoreAction.doDeployIncrSyncChannal(CoreAction.java:548)
	... 119 common frames omitted
Caused by: com.qlangtech.tis.async.message.client.consumer.MQConsumeException: Column types of query result and sink for registered table 'default_catalog.default_database.t2' do not match.
Cause: Incompatible types for sink column 'add_dt' at position 0.

Query schema: [add_dt: DATE, trade_time: TIMESTAMP(3), pay_time: TIMESTAMP(3), dt: DATE, trade_id: INT, trade_no: VARCHAR(40), src_tids: VARCHAR(255), trade_type: INT, trade_status: INT, refund_status: INT, is_del: TINYINT, platform_id: INT, platform_name: VARCHAR(50), plat: VARCHAR(255), shop_id: INT, shop_no: VARCHAR(20), shop_name2: VARCHAR(128), department: VARCHAR(50), dept_name: VARCHAR(50), dept_group2: VARCHAR(150), goods_id: INT, goods_no: VARCHAR(40), goods_name: VARCHAR(255), short_goods_name: VARCHAR(255), brand_id: INT, brand_no: VARCHAR(255), brand_name: VARCHAR(255), classify_id: INT, classify_name: VARCHAR(255), general_classify_name: VARCHAR(255), order_num: DECIMAL(19, 4), order_price: DECIMAL(19, 4), paid: DECIMAL(19, 4), receiver_area: VARCHAR(128), receiver_province_id: INT, receiver_city_id: INT, receiver_district_id: INT, warehouse_id: INT, warehouse_no: VARCHAR(40), warehouse_name: VARCHAR(64), logistics_id: INT, logistics_code: VARCHAR(20), logistics_name: VARCHAR(40), customer_id: INT, buyer_nick: VARCHAR(100), buyer_message: VARCHAR(65535), cs_remark: VARCHAR(65535), platform_goods_id: VARCHAR(40), platform_spec_id: VARCHAR(40), flag_name: VARCHAR(255), shop_status: INT, suite_no: VARCHAR(40), suite_name: VARCHAR(255), shop_name: VARCHAR(120), dept_group: VARCHAR(100)]
Sink schema:  [add_dt: VARCHAR(10), trade_time: VARCHAR(19), pay_time: VARCHAR(19), dt: VARCHAR(10), trade_id: INT, trade_no: VARCHAR(120), src_tids: VARCHAR(765), trade_type: INT, trade_status: INT, refund_status: INT, is_del: TINYINT, platform_id: INT, platform_name: VARCHAR(150), plat: VARCHAR(765), shop_id: INT, shop_no: VARCHAR(60), shop_name2: VARCHAR(384), department: VARCHAR(150), dept_name: VARCHAR(150), dept_group2: VARCHAR(450), goods_id: INT, goods_no: VARCHAR(120), goods_name: VARCHAR(765), short_goods_name: VARCHAR(765), brand_id: INT, brand_no: VARCHAR(765), brand_name: VARCHAR(765), classify_id: INT, classify_name: VARCHAR(765), general_classify_name: VARCHAR(765), order_num: VARCHAR(19), order_price: VARCHAR(19), paid: VARCHAR(19), receiver_area: VARCHAR(384), receiver_province_id: INT, receiver_city_id: INT, receiver_district_id: INT, warehouse_id: INT, warehouse_no: VARCHAR(120), warehouse_name: VARCHAR(192), logistics_id: INT, logistics_code: VARCHAR(60), logistics_name: VARCHAR(120), customer_id: INT, buyer_nick: VARCHAR(300), buyer_message: VARCHAR(65000), cs_remark: VARCHAR(65000), platform_goods_id: VARCHAR(120), platform_spec_id: VARCHAR(120), flag_name: VARCHAR(765), shop_status: INT, suite_no: VARCHAR(120), suite_name: VARCHAR(765), shop_name: VARCHAR(360), dept_group: VARCHAR(300)]
	at com.qlangtech.tis.plugins.incr.flink.chunjun.source.ChunjunSourceFunction.start(ChunjunSourceFunction.java:125)
	at com.qlangtech.tis.plugins.incr.flink.chunjun.source.ChunjunSourceFunction.start(ChunjunSourceFunction.java:56)
	at com.qlangtech.plugins.incr.flink.TISFlinkCDCStart.deploy(TISFlinkCDCStart.java:154)
	at com.qlangtech.plugins.incr.flink.TISFlinkCDCStart.main(TISFlinkCDCStart.java:76)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)
	... 128 common frames omitted
Caused by: org.apache.flink.table.api.ValidationException: Column types of query result and sink for registered table 'default_catalog.default_database.t2' do not match.
Cause: Incompatible types for sink column 'add_dt' at position 0.

Query schema: [add_dt: DATE, trade_time: TIMESTAMP(3), pay_time: TIMESTAMP(3), dt: DATE, trade_id: INT, trade_no: VARCHAR(40), src_tids: VARCHAR(255), trade_type: INT, trade_status: INT, refund_status: INT, is_del: TINYINT, platform_id: INT, platform_name: VARCHAR(50), plat: VARCHAR(255), shop_id: INT, shop_no: VARCHAR(20), shop_name2: VARCHAR(128), department: VARCHAR(50), dept_name: VARCHAR(50), dept_group2: VARCHAR(150), goods_id: INT, goods_no: VARCHAR(40), goods_name: VARCHAR(255), short_goods_name: VARCHAR(255), brand_id: INT, brand_no: VARCHAR(255), brand_name: VARCHAR(255), classify_id: INT, classify_name: VARCHAR(255), general_classify_name: VARCHAR(255), order_num: DECIMAL(19, 4), order_price: DECIMAL(19, 4), paid: DECIMAL(19, 4), receiver_area: VARCHAR(128), receiver_province_id: INT, receiver_city_id: INT, receiver_district_id: INT, warehouse_id: INT, warehouse_no: VARCHAR(40), warehouse_name: VARCHAR(64), logistics_id: INT, logistics_code: VARCHAR(20), logistics_name: VARCHAR(40), customer_id: INT, buyer_nick: VARCHAR(100), buyer_message: VARCHAR(65535), cs_remark: VARCHAR(65535), platform_goods_id: VARCHAR(40), platform_spec_id: VARCHAR(40), flag_name: VARCHAR(255), shop_status: INT, suite_no: VARCHAR(40), suite_name: VARCHAR(255), shop_name: VARCHAR(120), dept_group: VARCHAR(100)]
Sink schema:  [add_dt: VARCHAR(10), trade_time: VARCHAR(19), pay_time: VARCHAR(19), dt: VARCHAR(10), trade_id: INT, trade_no: VARCHAR(120), src_tids: VARCHAR(765), trade_type: INT, trade_status: INT, refund_status: INT, is_del: TINYINT, platform_id: INT, platform_name: VARCHAR(150), plat: VARCHAR(765), shop_id: INT, shop_no: VARCHAR(60), shop_name2: VARCHAR(384), department: VARCHAR(150), dept_name: VARCHAR(150), dept_group2: VARCHAR(450), goods_id: INT, goods_no: VARCHAR(120), goods_name: VARCHAR(765), short_goods_name: VARCHAR(765), brand_id: INT, brand_no: VARCHAR(765), brand_name: VARCHAR(765), classify_id: INT, classify_name: VARCHAR(765), general_classify_name: VARCHAR(765), order_num: VARCHAR(19), order_price: VARCHAR(19), paid: VARCHAR(19), receiver_area: VARCHAR(384), receiver_province_id: INT, receiver_city_id: INT, receiver_district_id: INT, warehouse_id: INT, warehouse_no: VARCHAR(120), warehouse_name: VARCHAR(192), logistics_id: INT, logistics_code: VARCHAR(60), logistics_name: VARCHAR(120), customer_id: INT, buyer_nick: VARCHAR(300), buyer_message: VARCHAR(65000), cs_remark: VARCHAR(65000), platform_goods_id: VARCHAR(120), platform_spec_id: VARCHAR(120), flag_name: VARCHAR(765), shop_status: INT, suite_no: VARCHAR(120), suite_name: VARCHAR(765), shop_name: VARCHAR(360), dept_group: VARCHAR(300)]
	at org.apache.flink.table.planner.connectors.DynamicSinkUtils.createSchemaMismatchException(DynamicSinkUtils.java:432)
	at org.apache.flink.table.planner.connectors.DynamicSinkUtils.validateSchemaAndApplyImplicitCast(DynamicSinkUtils.java:255)
	at org.apache.flink.table.planner.delegation.PlannerBase$$anonfun$2.apply(PlannerBase.scala:210)
	at org.apache.flink.table.planner.delegation.PlannerBase$$anonfun$2.apply(PlannerBase.scala:201)
	at scala.Option.map(Option.scala:146)
	at org.apache.flink.table.planner.delegation.PlannerBase.translateToRel(PlannerBase.scala:201)
	at org.apache.flink.table.planner.delegation.PlannerBase$$anonfun$1.apply(PlannerBase.scala:162)
	at org.apache.flink.table.planner.delegation.PlannerBase$$anonfun$1.apply(PlannerBase.scala:162)
	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
	at scala.collection.Iterator$class.foreach(Iterator.scala:891)
	at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
	at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
	at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
	at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
	at scala.collection.AbstractTraversable.map(Traversable.scala:104)
	at org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:162)
	at org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1518)
	at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:740)
	at org.apache.flink.table.api.internal.StatementSetImpl.execute(StatementSetImpl.java:99)
	at com.qlangtech.tis.realtime.TISTableEnvironment.executeMultiStatment(TISTableEnvironment.java:53)
	at com.qlangtech.tis.realtime.TableRegisterFlinkSourceHandle.processTableStream(TableRegisterFlinkSourceHandle.java:95)
	at com.qlangtech.tis.realtime.BasicFlinkSourceHandle.consume(BasicFlinkSourceHandle.java:101)
	at com.qlangtech.tis.realtime.BasicFlinkSourceHandle.consume(BasicFlinkSourceHandle.java:51)
	at com.qlangtech.tis.plugins.incr.flink.chunjun.source.ChunjunSourceFunction.start(ChunjunSourceFunction.java:123)
	... 136 common frames omitted
@baisui1981
Copy link
Member

baisui1981 commented Sep 22, 2023 •
edited
Loading

修改完成了,Doris JDBC 在映射 date和datetime类型会将字段类型 映射成OTHER类型，需要将其类型纠正：

https://github.com/qlangtech/plugins/blob/cc159533dc42845c6c3bf9f8e11e57246d9725bd/tis-datax/tis-datax-doris-plugin/src/main/java/com/qlangtech/tis/plugin/ds/doris/DorisSourceFactory.java#L110-L130

@baisui1981 baisui1981 added bug Something isn't working 3.8.0 labels Oct 4, 2023
@baisui1981 baisui1981 added this to the v3.8.0 milestone Oct 4, 2023
baisui1981 added a commit to qlangtech/plugins that referenced this issue Oct 4, 2023
@baisui1981
add decimalv3 type recognize for doris for issue datavane/tis#261
8d060ec
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
v3.8.0
Development

No branches or pull requests
2 participants
@baisui1981 @iskuli