samza-grid-docker.md

Samza Grid Container

About

The docker container has the samza grid installed.

A Samza grid comprises three different systems:

• YARN,
• Kafka,
• and ZooKeeper.

Build and create the container

Steps:

• Build with Dockerbuild.bat

Dockerbuild.bat

• Create the container with docker-samza-run.bat

docker-samza-run.bat

Connection

Yarn UI

Yarn UI should be available at http://localhost:8088/cluster

where you can view the Samza jobs running at http://localhost:8088/cluster/apps

TCP Connection

From your laptop, with ncat, you can verify that you have access to the services from your laptop

ncat -z localhost 22 && echo tcp connection to sshd succeeded
ncat -z localhost 2181 && echo tcp connection to zookeeper succeeded
ncat -z localhost 9092 && echo tcp connection to kafka succeeded
ncat -z localhost 8032 && echo tcp connection to resource manager succeeded
ncat -z localhost 8042 && echo tcp connection to node manager succeeded

You should see:

tcp connection to sshd succeeded
tcp connection to zookeeper succeeded
tcp connection to kafka succeeded
tcp connection to resource manager succeeded
tcp connection to node manager succeeded

Bash

• Connect in the container wit bash and docker-samza-bash.bat

docker-samza-bash.bat

Sftp (ssh)

You can connect via ssh with the user root and the password welcome.

Start and stop service

The software are installed in /opt/samza/deploy/

In the container, the grid script permits to start and stop services.

# in order first zookeeper then kafka
grid start zookeeper
grid start kafka
# or all
grid start all
grid

 Usage..
  $ grid
  $ grid standalone
  $ grid start [yarn|kafka|zookeeper|all]
  $ grid stop [yarn|kafka|zookeeper|all]