-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Env vars + partial parsing #3885
Labels
Comments
This was referenced Sep 15, 2021
gshank
added a commit
that referenced
this issue
Oct 20, 2021
4 tasks
gshank
added a commit
that referenced
this issue
Oct 20, 2021
gshank
added a commit
that referenced
this issue
Oct 21, 2021
gshank
added a commit
that referenced
this issue
Oct 21, 2021
gshank
added a commit
that referenced
this issue
Oct 26, 2021
gshank
added a commit
that referenced
this issue
Oct 26, 2021
@gshank Up to you whether we keep this issue open, or close it and open a new one for env vars in other files ( |
4 tasks
gshank
added a commit
that referenced
this issue
Oct 29, 2021
gshank
added a commit
that referenced
this issue
Oct 29, 2021
gshank
added a commit
that referenced
this issue
Oct 29, 2021
gshank
added a commit
that referenced
this issue
Nov 1, 2021
gshank
added a commit
that referenced
this issue
Nov 2, 2021
gshank
added a commit
that referenced
this issue
Nov 2, 2021
gshank
added a commit
that referenced
this issue
Nov 3, 2021
gshank
added a commit
that referenced
this issue
Nov 3, 2021
1 task
gshank
added a commit
that referenced
this issue
Nov 5, 2021
4 tasks
gshank
added a commit
that referenced
this issue
Nov 8, 2021
gshank
added a commit
that referenced
this issue
Nov 8, 2021
gshank
added a commit
that referenced
this issue
Nov 8, 2021
4 tasks
iknox-fa
pushed a commit
that referenced
this issue
Feb 8, 2022
iknox-fa
pushed a commit
that referenced
this issue
Feb 8, 2022
iknox-fa
pushed a commit
that referenced
this issue
Feb 8, 2022
iknox-fa
pushed a commit
that referenced
this issue
Feb 8, 2022
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
If an env var value needed at parse time (input to
ref
/source
/config
or yaml property) has changed, and partial parsing is enabled, dbt will not re-parse affected nodes and is likely to yield incorrect results.Reproduction case: gist
--no-partial-parse
) when they change an env var value needed at parse time.partial_parse.msgpack
). If any env var values change, trigger a full re-parse, and say that a change in env vars is the reason. Note: I'm not sure how this would work in deployment environments that set contextual env vars, such as dbt Cloud scheduled runs.env_var
macro, and then store those env vars ina separate map object, similar to how we handledepends_on
for that nodedocs
blocks. Then, if we detect a change in env var values, we can trigger re-parse for only those nodes which depend on that env var, plus (if the node is a macro) any nodes that depend on the macro. (It would be great to do this for--vars
someday as well.)The text was updated successfully, but these errors were encountered: