Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[NEW VERSION] Support Kafka 3.3.1 #486

Closed
5 tasks done
Tracked by #260
lfrancke opened this issue Sep 30, 2022 · 9 comments
Closed
5 tasks done
Tracked by #260

[NEW VERSION] Support Kafka 3.3.1 #486

lfrancke opened this issue Sep 30, 2022 · 9 comments
Assignees
@soenkeliebau
Labels
release/22.11.0

Comments

@lfrancke
Copy link
Member

lfrancke commented Sep 30, 2022 •
edited by maltesander
Loading

Which new version of Apache Kafka should we support?

3.3.1

Additional information

https://downloads.apache.org/kafka/3.3.0/RELEASE_NOTES.html
https://downloads.apache.org/kafka/3.3.1/RELEASE_NOTES.html

Changes required

Maybe

Implementation checklist

  • Update the Docker image
  • Update documentation to include supported version(s)
  • Update operator to support the new version (if needed)
  • Update integration tests to test use the new versions (in addition or replacing old versions
  • Update examples to use new versions
@lfrancke lfrancke moved this to Refinement: Waiting for in Stackable Engineering Sep 30, 2022
@lfrancke lfrancke mentioned this issue Sep 30, 2022
Closed
@maltesander maltesander self-assigned this Oct 3, 2022
@maltesander maltesander moved this from Refinement: Waiting for to Refinement: In Progress in Stackable Engineering Oct 3, 2022
@maltesander maltesander moved this from Refinement: In Progress to Refinement Acceptance: Waiting for in Stackable Engineering Oct 3, 2022
@maltesander maltesander removed their assignment Oct 3, 2022
@sbernauer sbernauer changed the title [NEW VERSION] Support Kafka 3.2.3 [NEW VERSION] Support Kafka 3.3.0 Oct 4, 2022
@lfrancke
Copy link
Member Author

lfrancke commented Oct 4, 2022

Do we really want to support 3.3 already?
@soenkeliebau opinions?

@soenkeliebau
Copy link
Member

I'd have no huge issue with it, Kafka has traditionally been fairly quick with x.y.1 releases, so something might show up shortly..

@lfrancke lfrancke moved this from Refinement Acceptance: Waiting for to Refinement Acceptance: Done in Stackable Engineering Oct 4, 2022
@sbernauer
Copy link
Member

3.3.1 is out haha :D Should i update the ticket?

@lfrancke
Copy link
Member Author

lfrancke commented Oct 6, 2022

Please do, thanks :)

@sbernauer sbernauer changed the title [NEW VERSION] Support Kafka 3.3.0 [NEW VERSION] Support Kafka 3.3.1 Oct 7, 2022
@maltesander maltesander moved this from Ready for Development to Development: In Progress in Stackable Engineering Oct 11, 2022
@maltesander maltesander self-assigned this Oct 11, 2022
@maltesander maltesander mentioned this issue Oct 11, 2022
Closed
7 tasks
@maltesander maltesander moved this from Development: In Progress to Development: In Review in Stackable Engineering Oct 11, 2022
@maltesander maltesander moved this from Development: In Review to Development: Done in Stackable Engineering Oct 11, 2022
@bors bors bot closed this as completed in c1912ad Oct 11, 2022
@soenkeliebau soenkeliebau moved this from Development: Done to Acceptance: Waiting for in Stackable Engineering Oct 12, 2022
@soenkeliebau soenkeliebau moved this from Acceptance: Waiting for to Acceptance: In Progress in Stackable Engineering Oct 12, 2022
@soenkeliebau
Copy link
Member

Called it!
Happy with this change in principle, but the integration tests keep failing, do we think there is any relationship between that and this change? @maltesander

@maltesander
Copy link
Member

From the last nightly test what i see the failed tests are only from TLS. 3.3.1, 3.2.0, 3.1.0 all fail and pass.

--- FAIL: kuttl (2180.29s)
    --- FAIL: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/smoke_kafka-2.8.1-stackable0_zookeeper-3.6.3-stackable0.7.1_use-client-tls-false (119.32s)
        --- FAIL: kuttl/harness/tls_kafka-3.3.1-stackable0.1.0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-true_use-client-auth-tls-false_use-internal-tls-true (147.23s)
        --- FAIL: kuttl/harness/tls_kafka-3.3.1-stackable0.1.0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-true_use-client-auth-tls-true_use-internal-tls-true (173.48s)
        --- FAIL: kuttl/harness/tls_kafka-3.3.1-stackable0.1.0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-true_use-client-auth-tls-true_use-internal-tls-false (174.55s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.7.0-stackable0.7.1_upgrade_old-3.2.0-stackable0.1.0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-false_use-client-auth-tls-true (88.88s)
        --- PASS: kuttl/harness/tls_kafka-3.3.1-stackable0.1.0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-false_use-client-auth-tls-false_use-internal-tls-true (42.12s)
        --- FAIL: kuttl/harness/tls_kafka-3.3.1-stackable0.1.0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-true_use-client-auth-tls-false_use-internal-tls-false (118.27s)
        --- PASS: kuttl/harness/tls_kafka-3.3.1-stackable0.1.0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-false_use-client-auth-tls-false_use-internal-tls-false (39.86s)
        --- FAIL: kuttl/harness/tls_kafka-3.3.1-stackable0.1.0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-false_use-client-auth-tls-true_use-internal-tls-false (124.41s)
        --- FAIL: kuttl/harness/tls_kafka-3.3.1-stackable0.1.0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-false_use-client-auth-tls-true_use-internal-tls-true (130.70s)
        --- FAIL: kuttl/harness/tls_kafka-3.2.0-stackable0.1.0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-true_use-client-auth-tls-true_use-internal-tls-true (128.64s)
        --- FAIL: kuttl/harness/tls_kafka-3.2.0-stackable0.1.0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-true_use-client-auth-tls-true_use-internal-tls-false (122.24s)
        --- FAIL: kuttl/harness/tls_kafka-3.2.0-stackable0.1.0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-true_use-client-auth-tls-false_use-internal-tls-true (119.39s)
        --- FAIL: kuttl/harness/tls_kafka-3.2.0-stackable0.1.0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-true_use-client-auth-tls-false_use-internal-tls-false (125.42s)
        --- PASS: kuttl/harness/tls_kafka-3.2.0-stackable0.1.0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-false_use-client-auth-tls-false_use-internal-tls-true (45.20s)
        --- PASS: kuttl/harness/tls_kafka-3.2.0-stackable0.1.0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-false_use-client-auth-tls-false_use-internal-tls-false (46.11s)
        --- FAIL: kuttl/harness/tls_kafka-3.2.0-stackable0.1.0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-false_use-client-auth-tls-true_use-internal-tls-true (143.01s)
        --- FAIL: kuttl/harness/tls_kafka-3.2.0-stackable0.1.0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-false_use-client-auth-tls-true_use-internal-tls-false (125.93s)
        --- FAIL: kuttl/harness/tls_kafka-3.1.0-stackable0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-true_use-client-auth-tls-true_use-internal-tls-true (138.74s)
        --- FAIL: kuttl/harness/tls_kafka-3.1.0-stackable0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-true_use-client-auth-tls-true_use-internal-tls-false (136.84s)
        --- FAIL: kuttl/harness/tls_kafka-3.1.0-stackable0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-true_use-client-auth-tls-false_use-internal-tls-false (121.11s)
        --- FAIL: kuttl/harness/tls_kafka-3.1.0-stackable0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-true_use-client-auth-tls-false_use-internal-tls-true (124.12s)
        --- PASS: kuttl/harness/smoke_kafka-3.3.1-stackable0.1.0_zookeeper-3.8.0-stackable0.7.1_use-client-tls-true (79.31s)
        --- FAIL: kuttl/harness/tls_kafka-3.1.0-stackable0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-false_use-client-auth-tls-true_use-internal-tls-true (118.11s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.7.0-stackable0.7.1_upgrade_old-3.2.0-stackable0.1.0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-false_use-client-auth-tls-false (80.06s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.7.0-stackable0.7.1_upgrade_old-3.1.0-stackable0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-true_use-client-auth-tls-true (79.29s)
        --- PASS: kuttl/harness/tls_kafka-3.1.0-stackable0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-false_use-client-auth-tls-false_use-internal-tls-true (43.22s)
        --- FAIL: kuttl/harness/tls_kafka-3.1.0-stackable0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-false_use-client-auth-tls-true_use-internal-tls-false (136.59s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.7.0-stackable0.7.1_upgrade_old-3.1.0-stackable0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-true_use-client-auth-tls-false (106.15s)
        --- PASS: kuttl/harness/tls_kafka-3.1.0-stackable0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-false_use-client-auth-tls-false_use-internal-tls-false (43.89s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.7.0-stackable0.7.1_upgrade_old-3.1.0-stackable0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-false_use-client-auth-tls-true (91.46s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.7.0-stackable0.7.1_upgrade_old-3.1.0-stackable0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-false_use-client-auth-tls-false (77.10s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.7.0-stackable0.7.1_upgrade_old-2.8.1-stackable0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-true_use-client-auth-tls-true (95.35s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.7.0-stackable0.7.1_upgrade_old-2.8.1-stackable0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-false_use-client-auth-tls-true (84.98s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.7.0-stackable0.7.1_upgrade_old-2.8.1-stackable0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-true_use-client-auth-tls-false (110.63s)
        --- FAIL: kuttl/harness/tls_kafka-2.8.1-stackable0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-true_use-client-auth-tls-true_use-internal-tls-true (132.79s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.7.0-stackable0.7.1_upgrade_old-2.8.1-stackable0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-false_use-client-auth-tls-false (78.46s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.6.3-stackable0.7.1_upgrade_old-3.2.0-stackable0.1.0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-true_use-client-auth-tls-true (92.91s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.6.3-stackable0.7.1_upgrade_old-3.2.0-stackable0.1.0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-true_use-client-auth-tls-false (82.32s)
        --- FAIL: kuttl/harness/tls_kafka-2.8.1-stackable0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-true_use-client-auth-tls-true_use-internal-tls-false (124.84s)
        --- FAIL: kuttl/harness/tls_kafka-2.8.1-stackable0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-true_use-client-auth-tls-false_use-internal-tls-true (116.49s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.6.3-stackable0.7.1_upgrade_old-3.2.0-stackable0.1.0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-false_use-client-auth-tls-true (83.96s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.6.3-stackable0.7.1_upgrade_old-3.1.0-stackable0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-true_use-client-auth-tls-true (81.68s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.6.3-stackable0.7.1_upgrade_old-3.2.0-stackable0.1.0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-false_use-client-auth-tls-false (97.73s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.6.3-stackable0.7.1_upgrade_old-3.1.0-stackable0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-true_use-client-auth-tls-false (86.88s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.6.3-stackable0.7.1_upgrade_old-3.1.0-stackable0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-false_use-client-auth-tls-true (83.65s)
        --- FAIL: kuttl/harness/tls_kafka-2.8.1-stackable0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-true_use-client-auth-tls-false_use-internal-tls-false (118.65s)
        --- FAIL: kuttl/harness/tls_kafka-2.8.1-stackable0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-false_use-client-auth-tls-true_use-internal-tls-true (121.98s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.6.3-stackable0.7.1_upgrade_old-3.1.0-stackable0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-false_use-client-auth-tls-false (85.09s)
        --- PASS: kuttl/harness/upgrade_zookeeper-3.6.3-stackable0.7.1_upgrade_old-2.8.1-stackable0_upgrade_new-3.3.1-stackable0.1.0_use-client-tls-true_use-client-auth-tls-true (83.55s)
        --- FAIL: kuttl/harness/tls_kafka-2.8.1-stackable0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-false_use-client-auth-tls-true_use-internal-tls-false (119.85s)

I think all fail because:

    logger.go:42: 01:48:55 | tls_kafka-2.8.1-stackable0_zookeeper-latest-3.8.0-stackable0.7.1_use-client-tls-false_use-client-auth-tls-true_use-internal-tls-false/30-prepare-test-kafka | test step failed 30-prepare-test-kafka
    case.go:361: failed in step 30-prepare-test-kafka
    case.go:363: command "" exceeded 30 sec timeout, context deadline exceeded

I will have a closer look, i dont think its related to 3.3.1. This is no flakiness either but rather a problem with TLS / Tests.

@soenkeliebau
Copy link
Member

ok.

@maltesander
Copy link
Member

Hopefully fixed by #494

@soenkeliebau soenkeliebau moved this from Acceptance: In Progress to Done in Stackable Engineering Oct 13, 2022
@sbernauer
Copy link
Member

Nightly passed 🥳

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@soenkeliebau soenkeliebau

Labels
release/22.11.0
Projects
Stackable Engineering
Archived in project
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Merged by Bors] - Adapted versions to 3.3.1 stackabletech/kafka-operator
4 participants
@lfrancke @soenkeliebau @maltesander @sbernauer