Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adapt to use docker image #20

Merged
merged 8 commits into from
Nov 12, 2021
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 6 additions & 1 deletion CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,13 @@ All notable changes to this project will be documented in this file.

## [Unreleased]

## [0.1.0] - 2021-10-27
- `operator-rs` `0.3.0` → `0.4.0` ([#20]).
- Adapted pod image and container command to docker image ([#20]).
- Adapted documentation to represent new workflow with docker images ([#20]).

[#20]: https://github.com/stackabletech/hdfs-operator/pull/20

## [0.1.0] - 2021-10-27

### Changed
- Switched to operator-rs tag 0.3.0 ([#13])
Expand Down
56 changes: 28 additions & 28 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 0 additions & 2 deletions README.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,4 @@

This is a Kubernetes Operator to manage Apache HDFS ensembles.

It is written by https://www.stackable.de[Stackable] in Rust, and it is supposed to be used with the https://github.com/stackabletech/agent[Stackable Agent] instead of the Kubernetes kubelet.

The docs can be found in the `docs` subdirectory, and they are published together with docs for all other Stackable products at https://docs.stackable.tech.
24 changes: 0 additions & 24 deletions deploy/config-spec/properties.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -7,11 +7,6 @@ spec:
examples:
- "ldap://[2001:db8::7]/c=GB?objectClass?one"
comment: "Specified in https://tools.ietf.org/html/rfc3986#appendix-B"
- unit: &unitDirectory
name: "directory"
regex: "^/|(/[\\w-]+)+$"
examples:
- "/tmp/xyz"

properties:
- property:
Expand Down Expand Up @@ -156,22 +151,3 @@ properties:
required: true
asOfVersion: "0.0.0"
description: "The datanode http server address and port."

###################################################################################################
# env vars
###################################################################################################
- property: &javaHome
propertyNames:
- name: "JAVA_HOME"
kind:
type: "env"
datatype:
type: "string"
unit: *unitDirectory
roles:
- name: "namenode"
required: true
- name: "datanode"
required: true
asOfVersion: "0.0.0"
description: "Points to the Java installation folder."
12 changes: 0 additions & 12 deletions deploy/crd/hdfscluster.crd.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -85,9 +85,6 @@ spec:
required:
- port
type: object
javaHome:
nullable: true
type: string
metricsPort:
format: uint16
minimum: 0.0
Expand Down Expand Up @@ -167,9 +164,6 @@ spec:
required:
- port
type: object
javaHome:
nullable: true
type: string
metricsPort:
format: uint16
minimum: 0.0
Expand Down Expand Up @@ -275,9 +269,6 @@ spec:
required:
- port
type: object
javaHome:
nullable: true
type: string
metricsPort:
format: uint16
minimum: 0.0
Expand Down Expand Up @@ -343,9 +334,6 @@ spec:
required:
- port
type: object
javaHome:
nullable: true
type: string
metricsPort:
format: uint16
minimum: 0.0
Expand Down
2 changes: 1 addition & 1 deletion docs/modules/ROOT/pages/building.adoc
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
= Building the Operator

This operator is written in Rust.
It is developed against the latest stable Rust release (1.54 at the time of writing).
It is developed against the latest stable Rust release (1.56 at the time of writing).

cargo build
7 changes: 6 additions & 1 deletion docs/modules/ROOT/pages/index.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -2,4 +2,9 @@

This is an operator for Kubernetes that can manage https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/HdfsUserGuide.html[Apache HDFS] clusters.

WARNING: This operator does _not_ work with containers/container images. It relies on the https://github.com/stackabletech/agent/[Stackable Agent] to run on "bare metal" via systemd.
WARNING: This operator only works with images from the https://repo.stackable.tech/#browse/browse:docker:v2%2Fstackable%2Fhadoop[Stackable] repository

[source]
----
docker pull docker.stackable.tech/stackable/hadoop:<version>
----
10 changes: 4 additions & 6 deletions docs/modules/ROOT/pages/usage.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -18,11 +18,10 @@ To create a single node Apache HDFS (v3.2.2) cluster with Prometheus metrics exp
default:
selector:
matchLabels:
kubernetes.io/arch: stackable-linux
kubernetes.io/os: linux
replicas: 1
config:
javaHome: /usr/lib/jvm/java-11-openjdk-amd64/
dfsNamenodeNameDir: file:///tmp/hdfs/nn
dfsNamenodeNameDir: /stackable/data
ipcAddress:
port: 9000
httpAddress:
Expand All @@ -33,11 +32,10 @@ To create a single node Apache HDFS (v3.2.2) cluster with Prometheus metrics exp
default:
selector:
matchLabels:
kubernetes.io/arch: stackable-linux
kubernetes.io/os: linux
replicas: 1
config:
javaHome: /usr/lib/jvm/java-11-openjdk-amd64/
dfsDatanodeNameDir: file:///tmp/hdfs/dn
dfsDatanodeNameDir: /stackable/data
httpAddress:
port: 61000
metricsPort: 51000
Expand Down
10 changes: 4 additions & 6 deletions examples/simple-hdfs-cluster.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9,11 +9,10 @@ spec:
default:
selector:
matchLabels:
kubernetes.io/os: stackable-linux
kubernetes.io/os: linux
replicas: 1
config:
javaHome: /usr/lib/jvm/java-11-openjdk-amd64/
dfsNamenodeNameDir: file:///tmp/hdfs/nn
dfsNamenodeNameDir: /stackable/hadoop/namenode/data
ipcAddress:
port: 9000
httpAddress:
Expand All @@ -24,11 +23,10 @@ spec:
default:
selector:
matchLabels:
kubernetes.io/os: stackable-linux
kubernetes.io/os: linux
replicas: 1
config:
javaHome: /usr/lib/jvm/java-11-openjdk-amd64/
dfsDatanodeNameDir: file:///tmp/hdfs/dn
dfsDatanodeNameDir: /stackable/hadoop/datannode/data
httpAddress:
port: 61000
metricsPort: 51000
Expand Down
2 changes: 1 addition & 1 deletion rust/crd/Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ repository = "https://github.com/stackabletech/hdfs-operator"
version = "0.2.0-nightly"

[dependencies]
stackable-operator = { git = "https://github.com/stackabletech/operator-rs.git", tag = "0.3.0" }
stackable-operator = { git = "https://github.com/stackabletech/operator-rs.git", tag = "0.4.0" }

duplicate = "0.3.0"
semver = "1.0"
Expand Down
Loading