dbt-core v1.10.0b1

dbt-core 1.10.0-b1 - March 12, 2025

Breaking Changes

• Add invocations_started_at field to artifact metadata (#11272)

Features

• Add new hard_deletes="new_record" mode for snapshots. (#10235)
• Add batch context object to model jinja context (#11025)
• Ensure pre/post hooks only run on first/last batch respectively for microbatch model batches (#11094, #11104)
• Support "tags" in Saved Queries (#11155)
• Calculate source freshness via a SQL query (#8797)
• Add freshness definition on model for adaptive job (#11123)
• Meta config for dimensions measures and entities (#None)
• Add doc_blocks to manifest for nodes and columns (#11000, #11001)
• Initial implementation of sample mode (#11227, #11230, #11231, #11248, #11252, #11254, #11258)
• Combine --sample and --sample-window CLI params (#11299)
• Allow for sampling of ref'd seeds (#11300)
• Enable sample mode for 'build' command (#11298)
• Allow sampling nodes snapshots depend on and of snapshots as a dependency (#11301)

Fixes

• dbt retry does not respect --threads (#10584)
• update adapter version messages (#10230)
• Catch DbtRuntimeError for hooks (#11012)
• Access DBUG flag more consistently with the rest of the codebase in ManifestLoader (#11068)
• Improve the performance characteristics of add_test_edges() (#10950)
• Implement partial parsing for singular data test configs in yaml files (#10801)
• Fix debug log messages for microbatch batch execution information (#11111)
• Fix running of extra "last" batch when there is only one batch (#11112)
• Fix interpretation of PartialSuccess to result in non-zero exit code (#11114)
• Warn about invalid usages of concurrent_batches config (#11122)
• Error writing generic test at run time (#11110)
• Run check_modified_contract for state:modified (#11034)
• Fix unrendered_config for tests from dbt_project.yml (#11146)
• Make partial parsing reparse referencing nodes of newly versioned models. (#8872)
• Ensure warning about microbatch lacking filter inputs is always fired (#11159)
• Fix microbatch dbt list --output json (#10556, #11098)
• Fix for custom fields in generic test config for not_null and unique tests (#11208)
• Loosen validation on freshness to accomodate previously wrong but harmless config. (#11123)
• Handle --limit -1 properly in ShowTaskDirect so that it propagates None instead of a negative int (#None)
• _get_doc_blocks is crashing parsing if .format is called (#11310)
• Fix microbatch execution to not block main thread nor hang (#11243, #11306)
• Fixes parsing errors when using the new YAML format for snapshots (#11164)

Under the Hood

• Create a no-op exposure runner (#, #)
• Improve selection peformance by optimizing the select_children() and select_parents() functions. (#11099)
• Change exception type from DbtInternalException to UndefinedMacroError when macro not found in 'run operation' command (#11192)
• Create LogNodeResult event (#, #)
• Fix error counts for exposures (#, #)
• Misc fixes for group info in logging (#11218)
• Add secondary profiles to profile.py (#XPLAT-241)

Dependencies

• Upgrading dbt-semantic-interfaces to 0.8.3 for custom grain support in offset windows (#None)
• Bump codecov/codecov-action from 4 to 5 (#11009)

Contributors

• @DevonFulcher (#None)
• @Threynaud (#11068)
• @WilliamDee (#None, #None)
• @amardatar (#11164)
• @d-cole (#8872)
• @dave-connors-3 (#10230)
• @donjin-master (#10584)
• @internetcoffeephone (#10556, #11098)
• @theyostalservice (#11155)

dbt-core v1.9.3

dbt-core 1.9.3 - March 07, 2025

Fixes

• Fix microbatch execution to not block main thread nor hang (#11243, #11306)

dbt-core v1.9.2

dbt-core 1.9.2 - January 29, 2025

Fixes

• Error writing generic test at run time (#11110)
• Run check_modified_contract for state:modified (#11034)
• Fix unrendered_config for tests from dbt_project.yml (#11146)
• Ensure warning about microbatch lacking filter inputs is always fired (#11159)
• Fix microbatch dbt list --output json (#10556, #11098)

Contributors

• @internetcoffeephone (#10556, #11098)

dbt-core v1.9.1

dbt-core 1.9.1 - December 16, 2024

Fixes

• update adapter version messages (#10230)
• Fix debug log messages for microbatch batch execution information (#11111)
• Fix running of extra "last" batch when there is only one batch (#11112)
• Fix interpretation of PartialSuccess to result in non-zero exit code (#11114)
• Warn about invalid usages of concurrent_batches config (#11122)

Contributors

• @dave-connors-3 (#10230)

dbt-core v1.9.0

dbt-core 1.9.0 - Dr. Susan La Flesche Picotte (December 09, 2024)

Breaking Changes

• Fix changing the current working directory when using dpt deps, clean and init. (#8997)

Features

• Parseable JSON and text output in quiet mode for dbt show and dbt compile (#9840)
• serialize inferred primary key (#9824)
• Add unit_test: selection method (#10053)
• Maximally parallelize dbt clone in clone command" (#7914)
• Add --host flag to dbt docs serve, defaulting to '127.0.0.1' (#10229)
• Update data_test to accept arbitrary config options (#10197)
• add pre_model and post_model hook calls to data and unit tests to be able to provide extra config options (#10198)
• add --empty value to jinja context as flags.EMPTY (#10317)
• Warning message for snapshot timestamp data types (#10234)
• Support cumulative_type_params & sub-daily granularities in semantic manifest. (#10360)
• Add time_granularity to metric spec. (#10376)
• Support standard schema/database fields for snapshots (#10301)
• Support ref and source in foreign key constraint expressions, bump dbt-common minimum to 1.6 (#8062)
• Support new semantic layer time spine configs to enable sub-daily granularity. (#10475)
• Add order_by and limit fields to saved queries. (#10531)
• Add support for behavior flags (#10618)
• Enable --resource-type and --exclude-resource-type CLI flags and environment variables for dbt test (#10656)
• Allow configuring snapshot column names (#10185)
• Add custom_granularities to YAML spec for time spines. (#9265)
• Add basic functionality for creating microbatch incremental models (#9490, #10635, #10637, #10638, #10636, #10662, #10639)
• Execute microbatch models in batches (#10700)
• Create 'skip_nodes_if_on_run_start_fails' behavior change flag (#7387)
• Allow snapshots to be defined in YAML. (#10246)
• Write microbatch compiled/run targets to separate files, one per batch (#10714)
• Track incremental_strategy as part of model_run tracking event (#10761)
• Support required 'begin' config for microbatch models (#10701)
• Parse-time validation of microbatch configs: require event_time, batch_size, lookback and validate input event_time (#10709)
• Added the --inline-direct parameter to 'dbt show' (#10770)
• Enable specification of dbt_valid_to for current records (#10187)
• Enable retry support for microbatch models (#10715, #10729)
• Use unrendered database and schema source properties during state:modified, behind state_modified_compare_more_unrendered_values behavoiur flag (#9573)
• Ensure microbatch models respect full_refresh model config (#10785)
• Adds validations for custom_granularities to ensure unique naming. (#9265)
• Enable use of multi-column unique key in snapshots (#9992)
• Change gating of microbatch feature to be behind project flag / behavior flag (#10798)
• Ensure --event-time-start is before --event-time-end (#10786)
• Ensure microbatch models use same current_time value (#10819)
• Emit warning when microbatch model has no input with event_time config (#10926)
• Emit debug logging event whenever artifacts are written (#10937)
• Support --empty for snapshots (#10372)
• Add new hard_deletes="new_record" mode for snapshots. (#10235)
• Allow microbatch batches to run in parallel (#10853, #10855)
• Add batch context object to model jinja context (#11025)
• Ensure pre/post hooks only run on first/last batch respectively for microbatch model batches (#11094, #11104)

Fixes

• Remove unused check_new method (#7586)
• Test case for merge_exclude_columns (#8267)
• Convert "Skipping model due to fail_fast" message to DEBUG level (#8774)
• Restore previous behavior for --favor-state: only favor defer_relation if not selected in current command" (#10107)
• Unit test fixture (csv) returns null for empty value (#9881)
• Fix json format log and --quiet for ls and jinja print by converting print call to fire events (#8756)
• Add resource type to saved_query (#10168)
• Fix: Order-insensitive unit test equality assertion for expected/actual with multiple nulls (#10167)
• Renaming or removing a contracted model should raise a BreakingChange warning/error (#10116)
• prefer disabled project nodes to external node (#10224)
• Fix issues with selectors and inline nodes (#8943, #9269)
• Fix snapshot config to work in yaml files (#4000)
• Improve handling of error when loading schema file list (#10284)
• Use model alias for the CTE identifier generated during ephemeral materialization (#5273)
• Implement state:modified for saved queries (#10294)
• Saved Query node fail during skip (#10029)
• DOn't warn on unit_test config paths that are properly used (#10311)
• Fix setting silence of warn_error_options via dbt_project.yaml flags (#10160)
• Attempt to provide test fixture tables with all values to set types correctly for comparisong with source tables (#10365)
• Limit data_tests deprecation to root_project (#9835)
• CLI flags should take precedence over env var flags (#10304)
• Fix typing for artifact schemas (#10442)
• Fix over deletion of generated_metrics in partial parsing (#10450)
• Fix error constructing warn_error_options (#10452)
• Do not update varchar column definitions if a contract exists (#10362)
• fix all_constraints access, disabled node parsing of non-uniquely named resources (#10509)
• respect --quiet and --warn-error-options for flag deprecations (#10105)
• Propagate measure label when using create_metrics (#10536)
• Fix state:modified check for exports ([#10138](https://github.com/dbt-labs/dbt-co...

dbt-core v1.9.0rc2

dbt-core 1.9.0-rc2 - December 02, 2024

Features

• Add batch context object to model jinja context (#11025)

dbt-core v1.7.19

dbt-core 1.7.19 - December 02, 2024

Under the Hood

• Remove support and testing for Python 3.8, which is now EOL. (#10861)
• Pin mashumaro < 3.15 (#11087)

dbt-core v1.9.0rc1

dbt-core 1.9.0-rc1 - November 25, 2024

Features

• Parseable JSON and text output in quiet mode for dbt show and dbt compile (#9840)
• Change gating of microbatch feature to be behind project flag / behavior flag (#10798)
• Add new hard_deletes="new_record" mode for snapshots. (#10235)
• Allow microbatch batches to run in parallel (#10853, #10855)

Fixes

• override materialization python models (#8520)
• Support disabling unit tests via config. (#9109, #10540)
• unit tests with versioned refs (#10880, #10528, #10623)
• Fix 'no attribute .config' error when ref-ing a microbatch model from non-Model context (#10928)
• Ensure inferred primary_key is a List[str] with no null values (#10983)
• Correct when custom microbatch macro deprecation warning is fired (#10994)
• Validate manifest has group_map during group_lookup init (#10988)
• Fix plural of 'partial success' in log message (#10999)
• Emit batch-level exception with node_info on microbatch batch run failure (#10840)
• Fix restrict-access to not apply within a package (#10134)
• Make microbatch models skippable (#11021)
• Catch DbtRuntimeError for hooks (#11012)

Under the Hood

• Upgrade protobuf (#10658)

Dependencies

• Bump minimum dbt-adapters version to 1.9.0 (#10996)

Contributors

• @devmessias (#8520, #10880, #10528, #10623)
• @tsturge (#9109, #10540)

dbt-core v1.8.9

dbt-core 1.8.9 - November 21, 2024

Under the Hood

• Pin dbt-common and dbt-adapters with upper bound of 2.0. (#11024)

dbt-core v1.9.0b4

dbt-core 1.9.0-b4 - November 06, 2024

Features

• Emit debug logging event whenever artifacts are written (#10937)
• Support --empty for snapshots (#10372)

Fixes

• Ensure KeyboardInterrupt/SystemExit halts microbatch model execution (#10862)
• Handle exceptions in get_execution_status more broadly to better ensure run_results.json gets written (#10934)

Under the Hood

• Behavior change for mf timespine without yaml configuration (#10959)
• Behavior change for cumulative metric type param (#10960)

Contributors

• @DevonFulcher (#10959, #10960)