-
Notifications
You must be signed in to change notification settings - Fork 32
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Mango using Partitioned parquet ADAM #361
Conversation
Test FAILed. |
More recent test of this Mango code with partitioned dataset of the large Platinum genome files can be done with this command
The "warm-up period", done upfront when using the |
@@ -297,6 +297,9 @@ class VizReadsArgs extends Args4jBase with ParquetArgs { | |||
@Args4jOption(required = false, name = "-preload", usage = "Chromosomes to prefetch, separated by commas (,).") | |||
var preload: String = null | |||
|
|||
@Args4jOption(required = false, name = "-parquetIsBinned", usage = "This turns on binned parquet pre-fetch warmup step") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
-parquetIsBinned -> isPartitioned
This is replaced by #370 |
Replaces #358
works with ADAM: #1911
Example mango run
The problem with "chr" fix was resolved by querying both with and without "chr" prefix