Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade to Spark 2.4 #5782

Closed
droazen opened this issue Mar 11, 2019 · 1 comment · Fixed by #5990
Closed

Upgrade to Spark 2.4 #5782

droazen opened this issue Mar 11, 2019 · 1 comment · Fixed by #5990
Assignees
Labels

Comments

@droazen
Copy link
Contributor

droazen commented Mar 11, 2019

No description provided.

@tomwhite
Copy link
Contributor

We'll need to test on a cluster as a part of this work.

One benefit will be that Spark 2.4.1 will allow us to run tests using Java 11. See disq-bio/disq#88. (Even though it looks like Spark won't support Java 11 until Spark 3, according to https://issues.apache.org/jira/browse/SPARK-24417, Spark 2.4.1 will allow us to at least run tests using Java 11.)

There are also fixes for #1524 and #3840.

@tomwhite tomwhite changed the title Upgrade to Spark 2.4.1 Upgrade to Spark 2.4 Jun 10, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants