Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tests(kafka-connect): fixes integration tests setup #12531

Merged
merged 6 commits into from
Feb 4, 2025
Merged

tests(kafka-connect): fixes integration tests setup #12531

Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
10e319e
tests(kafka-connect): fixes integration tests setup
sgomezvillamor Feb 3, 2025
49dc86a
confluent install from ziip
sgomezvillamor Feb 3, 2025
91ff618
confluent connect plugin install
sgomezvillamor Feb 3, 2025
e49bb2b
Merge branch 'master' into tests-ingestion-kafka-connect-fix-setup
sgomezvillamor Feb 4, 2025
c1f1760
Update docker-compose.override.yml
sgomezvillamor Feb 4, 2025
02aa1ae
Update docker-compose.override.yml
sgomezvillamor Feb 4, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
25 changes: 17 additions & 8 deletions metadata-ingestion/tests/integration/kafka-connect/docker-compose.override.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,21 +21,30 @@ services:
- bash
- -c
- |
echo "Installing Connector"
echo "Install confluent CLI"
# https://docs.confluent.io/confluent-cli/current/install.html#tarball-or-zip-installation
wget https://packages.confluent.io/confluent-cli/archives/4.16.0/confluent_linux_amd64.tar.gz
mkdir -p /tmp/confluent-cli
tar -xvf confluent_linux_amd64.tar.gz -C /tmp/confluent-cli
export PATH=/tmp/confluent-cli/confluent:$PATH
echo "Done!"
echo "Installing Connectors"
#
confluent-hub install --no-prompt confluentinc/kafka-connect-jdbc:10.2.5
confluent connect plugin install --force confluentinc/kafka-connect-jdbc:10.2.5
#
confluent-hub install --no-prompt confluentinc/connect-transforms:1.4.1
confluent connect plugin install --force confluentinc/connect-transforms:1.4.1
#
confluent-hub install --no-prompt confluentinc/kafka-connect-datagen:0.6.0
confluent connect plugin install --force confluentinc/kafka-connect-datagen:0.6.0
#
confluent-hub install --no-prompt debezium/debezium-connector-mysql:1.7.0
confluent connect plugin install --force debezium/debezium-connector-mysql:1.7.0
#
confluent-hub install --no-prompt wepay/kafka-connect-bigquery:1.6.8
confluent connect plugin install --force wepay/kafka-connect-bigquery:1.6.8
#
confluent-hub install --no-prompt mongodb/kafka-connect-mongodb:1.10.1
confluent connect plugin install --force mongodb/kafka-connect-mongodb:1.10.1
#
confluent-hub install --no-prompt confluentinc/kafka-connect-s3:10.5.1
confluent connect plugin install --force confluentinc/kafka-connect-s3:10.5.1
#
mkdir -p /usr/share/confluent-hub-components/confluentinc-kafka-connect-jdbc/lib
#
curl -k -SL "https://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-8.0.27.tar.gz" \
| tar -xzf - -C /usr/share/confluent-hub-components/confluentinc-kafka-connect-jdbc/lib \
Expand Down
Loading