Skip to content
This repository has been archived by the owner on Jan 29, 2024. It is now read-only.

Include downloading of raw files in the integration test #532

Open
jankrepl opened this issue Dec 20, 2021 · 1 comment
Open

Include downloading of raw files in the integration test #532

jankrepl opened this issue Dec 20, 2021 · 1 comment

Comments

@jankrepl
Copy link
Contributor

🚀 Feature

Recently, we implemented bbs_database download for multiple different sources. It might be a good idea to extend our integration test to actually use this download (rather than using data committed to the repo).

Motivation

  • We make sure that our ETL pipeline works end to end
  • Possibility to detect upstream changes on the source servers
@Stannislav
Copy link
Contributor

We might consider only running this sparsely, e.g. only on merges to master or according to some schedule?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants