Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consolidate pipeline logic #88

Merged
merged 6 commits into from
Jun 21, 2023
Merged

Consolidate pipeline logic #88

merged 6 commits into from
Jun 21, 2023

Conversation

delucchi-cmu
Copy link
Contributor

Change Description

Consolidates logic for instantiating dask clients, and provides a single pipeline method call. Adds option to send an email on pipeline success.

@delucchi-cmu delucchi-cmu requested review from a team and smcguire-cmu and removed request for a team June 14, 2023 19:50
@codecov
Copy link

codecov bot commented Jun 14, 2023

Codecov Report

Merging #88 (9105d84) into main (24b0cb4) will not change coverage.
The diff coverage is 100.00%.

❗ Current head 9105d84 differs from pull request most recent head 331698a. Consider uploading reports for the commit 331698a to get more accurate results

@@            Coverage Diff            @@
##              main       #88   +/-   ##
=========================================
  Coverage   100.00%   100.00%           
=========================================
  Files           20        20           
  Lines          812       805    -7     
=========================================
- Hits           812       805    -7     
Impacted Files Coverage Δ
src/hipscat_import/catalog/map_reduce.py 100.00% <ø> (ø)
src/hipscat_import/association/run_association.py 100.00% <100.00%> (ø)
src/hipscat_import/catalog/__init__.py 100.00% <100.00%> (ø)
src/hipscat_import/catalog/run_import.py 100.00% <100.00%> (ø)
src/hipscat_import/index/run_index.py 100.00% <100.00%> (ø)
src/hipscat_import/margin_cache/__init__.py 100.00% <100.00%> (ø)
src/hipscat_import/margin_cache/margin_cache.py 100.00% <100.00%> (ø)
...cat_import/margin_cache/margin_cache_map_reduce.py 100.00% <100.00%> (ø)
src/hipscat_import/runtime_arguments.py 100.00% <100.00%> (ø)

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@delucchi-cmu delucchi-cmu requested a review from maxwest-uw June 20, 2023 16:33
.github/workflows/testing-and-coverage.yml Outdated Show resolved Hide resolved
src/hipscat_import/pipeline.py Outdated Show resolved Hide resolved
@delucchi-cmu delucchi-cmu requested a review from maxwest-uw June 21, 2023 14:19
@delucchi-cmu delucchi-cmu merged commit f0cd4bf into main Jun 21, 2023
@delucchi-cmu delucchi-cmu deleted the delucchi/pipeline branch July 12, 2023 15:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants