Added Kafka (KRaft Mode) module

[noctarius]

What does this PR do?

This PR adds a new module for Kafka, running in KRaft (Zookeeper-less) mode

Why is it important?

New modules are always important :-)

Related issues

• Relates [Enhancement]: Kafka module #1033

How to test this PR

Simple test for the module is included

[netlify]

✅ Deploy Preview for testcontainers-go ready!

Name	Link
🔨 Latest commit	fbb2799
🔍 Latest deploy log	https://app.netlify.com/sites/testcontainers-go/deploys/642c23bb1fffbe0008f7091f
😎 Deploy Preview	https://deploy-preview-1034--testcontainers-go.netlify.app/modules/kafka
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify site settings.

[mdelapenya]

Hi @noctarius this is awesome! I have one question regarding how you created the scaffolding, as I'm not sure if you used the module generator tool, as described here?

It will generate the scaffolding and will automatically add it to the docs site (golang.testcontainers.org).

[noctarius]

I just copy and pasted what I found for other modules, so no, I didn't use the tool 🤷‍♂️
Let me run it now and see what comes out of it

[sonarqubecloud]

Kudos, SonarCloud Quality Gate passed!   

0 Bugs
0 Vulnerabilities
0 Security Hotspots
0 Code Smells

No Coverage information
No Duplication information

[mdelapenya]

Hey @noctarius sorry for the radio silence, but we have been working on a more consistent module design, so I'd ask you to visit the docs on how to adhere to this design here: https://golang.testcontainers.org/modules/

In two sentences, the entrypoint must be RunContainer(ctx, opts ...testcontainers.ContainerCustomizer and we explain there how to create own in-module customizers. The Couchbase module is a good place to look at how to transfer state from the container request to the running container where there is data that does not belong to the container request type.

I'd be very happy to review your PR following this new design 🙏

[weeco]

@noctarius Just recently we released an official Redpanda module, maybe that helps you for integration tests. It starts faster than any Kafka container (generally more lightweight), it's Kafka API compatible and also comes with schema registry support.

[mdelapenya]

@noctarius did you take a look at #1034 (comment)?

In any case, please let me know if you want to keep this Kafka module, I could dedicate time with you to update the PR to use the new design for modules

[srenatus]

Just a comment from the sidelines, I think it's worthwhile to keep this. If you're testing an application that should be compatible with Apache Kafka and Redpanda, I think it does make sense to test with them both.

[mdelapenya]

I think it does make sense to test with them both.

@srenatus cool then. Is anybody willing to contribute it? I'd start a new PR, or rewrite this one, using the new APIs for modules, just copying the functionality in this PR.

[noctarius]

Hey folks! Sorry for the long abstinence. Happy to make a new version of this but not sure when I get to that. If anyone wants to chime in, feel free :)

[mdelapenya]

I have a working PR for this. Will submit and close this one.

Thanks for the initial work here @noctarius!! I will add you to #636 as contributor of the kafka module