Skip to content
This repository has been archived by the owner on Dec 4, 2024. It is now read-only.

Spark 2.0.0-2.2.0-1
Compare
Choose a tag to compare
@triclambert triclambert released this 11 Sep 18:20
· 323 commits to master since this release
2.0.0-2.2.0-1
de1c275

Improvements

  • Kerberos support changed to use common code from spark-core instead of custom implementation.
  • Added file and environment-based secret support.
  • Kerberos key tab/TGT login from the DC/OS Spark CLI in cluster mode (uses file-based secrets).
  • Added CNI network label support.
  • CLI doesn't require spark-submit to be present on client machine.

Bug fixes

  • Drivers are successfully re-launched when --supervise flag is set.
  • CLI works on 1.9 and 1.10 DC/OS clusters.

Breaking changes

  • Setting spark.app_id has been removed (e.g. dcos config set spark.app_id <dispatcher_app_id>). To submit jobs with a given dispatcher use dcos spark --name <dispatcher_app_id>.
  • principal is now service_account and secret is now service_account_secret.
Assets 2
Loading