Using python3.6 alpine base image adds java,pandas, numpy,pyspark and spark as rundeps. This image can be used as container image when you run spark-submit on k8.
kubernetes kafka spark numpy flatbuffers pymongo pandas pyspark java-8 alpine-image spark-submit container-image spark-on-kubernetes
-
Updated
Nov 11, 2022 - Dockerfile