Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ReplicatedReplacingMergeTree table engine to sink connector #495

Closed
subkanthi opened this issue Mar 8, 2024 · 1 comment · Fixed by #492 or #522
Closed

Add ReplicatedReplacingMergeTree table engine to sink connector #495

subkanthi opened this issue Mar 8, 2024 · 1 comment · Fixed by #492 or #522
Labels
kafka Issues related to Kafka version qa-verified label to mark issues that were verified by QA
Milestone

Comments

@subkanthi
Copy link
Collaborator

Related to : #473
This addresses the Kafka version.

@subkanthi
Copy link
Collaborator Author

subkanthi commented Mar 30, 2024

Adding the configuration parameter

--- a/sink-connector/deploy/sink-connector-setup-database.sh
+++ b/sink-connector/deploy/sink-connector-setup-database.sh
@@ -65,7 +65,7 @@ if [[ $1 == "apicurio" ]]; then
         "schema.evolution": false,
 
         "deduplication.policy": "off",
-        "auto.create.tables.replicated": "true"
+        "auto.create.tables.replicated": true

tested using datatypes collection

34c8e0e14263 :) show create table temporal_types_YEAR4;

SHOW CREATE TABLE temporal_types_YEAR4

Query id: ae0ce662-47c4-43bc-b36c-027395233ef8

┌─statement──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐
│ CREATE TABLE datatypes.temporal_types_YEAR4
(
    `Type` String,
    `Minimum_Value` Int32,
    `Mid_Value` Int32,
    `Maximum_Value` Int32,
    `Null_Value` Nullable(Int32),
    `_version` UInt64,
    `is_deleted` UInt8
)
ENGINE = ReplicatedReplacingMergeTree('/clickhouse/tables/{shard}/temporal_types_YEAR4', '{replica}', _version, is_deleted)
PRIMARY KEY Type
ORDER BY Type
SETTINGS index_granularity = 8192 │
└────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘

1 row in set. Elapsed: 0.002 sec. 

34c8e0e14263 :) select * from  temporal_types_YEAR4;

SELECT *
FROM temporal_types_YEAR4

Query id: 089165f0-7faf-43c6-90d4-d7463f925a59

┌─Type────┬─Minimum_Value─┬─Mid_Value─┬─Maximum_Value─┬─Null_Value─┬──────_version─┬─is_deleted─┐
│ YEAR(4) │          1901 │      2022 │          2155 │       ᴺᵁᴸᴸ │ 1711839562223 │          0 │
└─────────┴───────────────┴───────────┴───────────────┴────────────┴───────────────┴────────────┘

1 row in set. Elapsed: 0.004 sec. 

@svb-alt svb-alt added this to the 2.2.0 milestone Apr 4, 2024
@svb-alt svb-alt removed the 2.0.2 label Apr 4, 2024
@svb-alt svb-alt modified the milestones: 2.2.0, 2.0.2 Apr 4, 2024
@Selfeer Selfeer added the qa-verified label to mark issues that were verified by QA label Apr 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kafka Issues related to Kafka version qa-verified label to mark issues that were verified by QA
Projects
None yet
3 participants