Stand up a Raspberry Pi based Kubernetes cluster with Ansible
- Raspberry Pis are rad
- Ansible is awesome
- Kubernetes is keen
ARM is going to be the datacenter and home computing platform of the future. It makes a lot of sense to start getting used to working in its unique environment.
Also, it's cheaper than a year of GKE. Plus, why not run Kubernetes in your home?
- Raspberry Pi 3 (3 or more)
- Class 10 SD Cards
- Network connection (wireless or wired) with access to the internet
In the all.yml file, these are the verified tested versions of a running from scratch cluster. Kubernetes can run a different version from the cluster version, but in testing these versions are matched. I've worked to make sure that 3 versions are supported,
meaning 1.11/10/9.x
, so anything kube 1.8.x
and older definitely won't work.
Flannel is usually always 0.10.0
, docker is always 18.03.1
. Your mileage may vary, but these worked in testing. Weave is preferred CNI since they fixed the bug in RPi firmware. :)
- version_kubernetes:
1.11.0
,1.10.5
,1.9.9
- version_kube_cluster:
1.11.0
,1.10.5
,1.9.9
- version_flannel:
0.10.0
- version_docker:
18.03.1~ce-0~debian
-
Raspbian Lite (installed on each Raspberry Pi)
-
Raspberry Pis should have static IPs
- Requirement for Kubernetes and Ansible inventory
- You can set these via OS configuration or DHCP reservations (your choice)
- Ensure that each Raspberry Pi has a unique hostname in file
/etc/hostname
(run the hostnames.yml playbook)
-
Ability to SSH into all Raspberry Pis and escalate privileges with sudo
- The pi user is fine just change its password
-
Ansible 2.2 or higher
-
kubectl
should be available on the system you intend to use to interact with the Kubernetes cluster.- If you are going to login to one of the Raspberry Pis to interact with the cluster
kubectl
is installed and configured by default on the master Kubernetes master. - If you are administering the cluster from a remote machine (your laptop, desktop, server, bastion host, etc.)
kubectl
will not be installed on the remote machine but it will be configured to interact with the newly built cluster oncekubectl
is installed.
- If you are going to login to one of the Raspberry Pis to interact with the cluster
- Since Raspbian Lite is being used it's recommended that the video memory of the Raspberry Pi 3s be set to its lowest setting (16 MB).
- Setup SSH key pairs so your password is not required every time Ansible runs
Make sure SSH is enabled on each Pi.
- Enable ssh on your headless Raspberry Pis using step-3 instructions here
- Basically just create an empty file named ssh on the root of your Pis /boot partition. This should be all that is required.
git clone git@github.com:KptnKMan/rak8s.git
Modify the inventory
file to suit your environment. Change the names to your liking and the IPs to the addresses of your Raspberry Pis.
If your SSH user on the Raspberry Pis are not the Raspbian default pi
user modify remote_user
in the ansible.cfg
.
This doesn't always work, so if you get an error here, you can still continue if you can ssh to the Pis.
ansible -m ping all
I prepared a cluster setup script for you.
- The script will not work if you have not enabled SSH!
- You will be prompted for the current/default password. If you have not changed it, it will be the default password.
ansible-playbook cluster_prep.yml --ask-pass
ansible-playbook cluster.yml
Test your Kubernetes cluster is up and running:
kubectl get nodes
The output should look something like this:
NAME STATUS ROLES AGE VERSION
pik8s000 Ready master 2d v1.10.5
pik8s001 Ready <none> 2d v1.10.5
pik8s002 Ready <none> 2d v1.10.5
pik8s003 Ready <none> 2d v1.10.5
pik8s005 Ready <none> 2d v1.10.5
pik8s004 Ready <none> 2d v1.10.5
rak8s installs the non-HTTPS version of the Kubernetes dashboard. This is not recommended for production clusters but, it simplifies the setup. Access the dashboard by running:
kubectl proxy
Then open a web browser and navigate to: http://localhost:8001/api/v1/namespaces/kube-system/services/https:kubernetes-dashboard:/proxy/
If you run into any problems please join our welcoming Discourse community. If you find a bug please open an issue and pull requests are always welcome.
rak8s (pronounced rackets - /ˈrækɪts/)
Coined by Kendrick Coleman on 13 Jan 2018
These playbooks were assembled using a handful of very helpful guides:
- K8s on (vanilla) Raspbian Lite by Alex Ellis
- Installing kubeadm
- kubernetes/dashboard - Access control - Admin privileges
- Install using the convenience script
A very special thanks to Alex Ellis and the OpenFaaS community for their assitance in answering questions and making sense of some errors.