Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade debezium to 2.7.1.Final #792

Merged
merged 6 commits into from
Oct 8, 2024
Merged

Upgrade debezium to 2.7.1.Final #792

Changes from 1 commit
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
4818269
Upgrade debezium to 2.7.1.Final
subkanthi Sep 5, 2024
3ceef5c
Fix MySQLConverter for debezium 7.1
subkanthi Sep 6, 2024
a9feb2f
Added converter logic to use defaultServiceRegistr
subkanthi Sep 8, 2024
9a8f3ba
Upgrade debezium to 2.7.2
subkanthi Sep 25, 2024
c9aba45
Fixed DataTypeConverter API changes in Debezium 2.7.2
subkanthi Sep 25, 2024
980af39
Merge branch '2.4.0' of github.com:Altinity/clickhouse-sink-connector…
subkanthi Sep 26, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Loading
Loading status checks…
Fixed DataTypeConverter API changes in Debezium 2.7.2
  • Loading branch information
@subkanthi
subkanthi committed Sep 25, 2024

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode
commit c9aba452997d71f220f9606c70c833c239c8d8b5
21 changes: 14 additions & 7 deletions ...ght/src/main/java/com/altinity/clickhouse/debezium/embedded/parser/DataTypeConverter.java
View file
Original file line number Diff line number Diff line change
@@ -42,23 +42,30 @@ public static String convertToString(ClickHouseSinkConnectorConfig config, Strin
new DefaultBeanRegistry();

// Convert ClickHouseConnectorConfig to configuration.
Configuration configuration = Configuration.create().
Configuration configuration = Configuration.create()
.with(BinlogConnectorConfig.DECIMAL_HANDLING_MODE, "decimalHandlingMode")
.with(BinlogConnectorConfig.TIME_PRECISION_MODE, "temporalPrecisionMode")
.with(BinlogConnectorConfig.BIGINT_UNSIGNED_HANDLING_MODE, "bigIntUnsignedHandlingMode")
.with(BinlogConnectorConfig.BINARY_HANDLING_MODE, "binaryHandlingMode")
.with(BinlogConnectorConfig.EVENT_CONVERTING_FAILURE_HANDLING_MODE, "eventConvertingFailureHandlingMode")
.build();

final MySqlConnectorConfig connectorConfig = new MySqlConnectorConfig(configuration);

// Convert Properties to Configuration.
Configuration configuration = Configuration.create().build();
// Iterate through properties and fill configuration.
for (Map.Entry<Object, Object> entry : properties.entrySet()) {
configuration = configuration.edit().with(entry.getKey().toString(), entry.getValue().toString()).build();
}
// Configuration configuration = Configuration.create().build();
// // Iterate through properties and fill configuration.
// for (Map.Entry<Object, Object> entry : properties.entrySet()) {
// configuration = configuration.edit().with(entry.getKey().toString(), entry.getValue().toString()).build();
// }
ServiceRegistry serviceRegistry = new DefaultServiceRegistry( Configuration.create().build(), new DefaultBeanRegistry());
BinlogCharsetRegistry charsetRegistry = new MySqlCharsetRegistryServiceProvider().createService(Configuration.create().build(), serviceRegistry);
MySqlValueConverters mysqlConverter = new MySqlValueConverters(
JdbcValueConverters.DecimalMode.PRECISE,
TemporalPrecisionMode.ADAPTIVE,
JdbcValueConverters.BigIntUnsignedMode.LONG,
CommonConnectorConfig.BinaryHandlingMode.BYTES,
x ->x, CommonConnectorConfig.EventConvertingFailureHandlingMode.WARN, charsetRegistry.getCharacterConverter());
x ->x, CommonConnectorConfig.EventConvertingFailureHandlingMode.WARN, connectorConfig.getServiceRegistry());


String convertedDataType = null;
Loading