Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run conversion from main pipeline script. #414

Merged
merged 1 commit into from
Oct 18, 2024
Merged

Run conversion from main pipeline script. #414

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions src/hats_import/pipeline.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,11 +6,13 @@
from dask.distributed import Client

import hats_import.catalog.run_import as catalog_runner
import hats_import.hipscat_conversion.run_conversion as conversion_runner
import hats_import.index.run_index as index_runner
import hats_import.margin_cache.margin_cache as margin_runner
import hats_import.soap.run_soap as soap_runner
import hats_import.verification.run_verification as verification_runner
from hats_import.catalog.arguments import ImportArguments
from hats_import.hipscat_conversion.arguments import ConversionArguments
from hats_import.index.arguments import IndexArguments
from hats_import.margin_cache.margin_cache_arguments import MarginCacheArguments
from hats_import.runtime_arguments import RuntimeArguments
Expand Down Expand Up @@ -50,6 +52,8 @@ def pipeline_with_client(args: RuntimeArguments, client: Client):
soap_runner.run(args, client)
elif isinstance(args, VerificationArguments):
verification_runner.run(args)
elif isinstance(args, ConversionArguments):
conversion_runner.run(args, client)
else:
raise ValueError("unknown args type")

Expand Down