• Fix union_relations error from #473 when no include/exclude parameters are provided (#505, #509)

• A cross-database implementation of any_value() (#497, #501)
• A cross-database implementation of bool_or() (#504)

• also ignore dbt_packages/ directory #463
• Remove block comments to make date_spine macro compatible with the Athena connector (#462)

• type_timestamp macro now explicitly casts postgres and redshift warehouse timestamp data types as timestamp without time zone, to be consistent with Snowflake behaviour (timestamp_ntz).
• union_relations macro will now raise an exception if the use of include or exclude results in no columns (#473, #266).
• get_relations_by_pattern() works with foreign data wrappers on Postgres again. (#357, #476)
• star() will only alias columns if a prefix/suffix is provided, to allow the unmodified output to still be used in group by clauses etc. #468
• The sequential_values test is now compatible with quoted columns #479
• pivot() escapes values containing apostrophes #503

• grahamwetzler (#473)
• Aesthet (#476)
• Kamitenshi (#462)
• nickperrott (#468)
• jelstongreen (#468)
• armandduijn (#479)
• mdutoo (#503)

• dbt ONE POINT OH is here! This version of dbt-utils requires any version (minor and patch) of v1, which means far less need for compatibility releases in the future.
• The partition column in the mutually_exclusive_ranges test is now always called partition_by_col. This enables compatibility with --store-failures when multiple columns are concatenated together. If you have models built on top of the failures table, update them to reflect the new column name. (#423, #430)

• codigo-ergo-sum (#430)

🚨 This is a compatibility release in preparation for dbt-core v1.0.0 (🎉). Projects using dbt-utils 0.7.4 with dbt-core v1.0.0 can expect to see a deprecation warning. This will be resolved in dbt_utils v0.8.0.

• Regression in get_column_values() where the default would not be respected if the model didn't exist. (#444, #448)

• get_url_host() macro now correctly handles URLs beginning with android-app:// (#426)

• foundinblank

• get_column_values() now works correctly with mixed-quoting styles on Snowflake (#424, #440)
• Remove extra semicolon in insert_by_period materialization that was causing errors (#439)
• Swap limit 0 out for {{ limit_zero() }} on the slugify() tests to allow for compatibility with tsql-utils (#437)

• sean-rose
• @swanderz

🚨🚨 We have renamed the master branch to main. If you have a local version of dbt-utils, you will need to update to the new branch. See the GitHub docs for more details.

• Bump require-dbt-version to have an upper bound of '<=1.0.0'.
• Url link fixes within the README for not_constant, dateadd, datediff and updated the header Logger to Jinja Helpers. (#431)
• Fully qualified a cte_name.* in the equality test to avoid an Exasol error (#420)
• get_url_host() macro now correctly handles URLs beginning with android-app:// (#426)

• joemarkiewicz
• TimoKruth
• foundinblank

• Fix bug introduced in 0.7.2 in dbt_utils.star which could cause the except argument to drop columns that were not explicitly specified (#418)
• Remove deprecated argument from not_null_proportion (#416)
• Change final select statement in not_null_proportion to avoid false positive failures (#416)

• Add not_null_proportion schema test that allows the user to specify the minimum (at_least) tolerated proportion (e.g., 0.95) of non-null values (#411)

• Allow user to provide any case type when defining the exclude argument in dbt_utils.star() (#403)
• Log whole row instead of just column name in 'accepted_range' schema test to allow better visibility into failures (#413)
• Use column name to group in 'get_column_values ' to allow better cross db functionality (#407)

• Declare compatibility with dbt v0.21.0, which has no breaking changes for this package (#398)

dbt v0.20.0 or greater is required for this release. If you are not ready to upgrade, consider using a previous release of this package.

In accordance with the version upgrade, this package release includes breaking changes to:

• Generic (schema) tests
• dispatch functionality

The order of (optional) arguments has changed in the get_column_values macro.

Before:

{% macro get_column_values(table, column, order_by='count(*) desc', max_records=none, default=none) -%}
...
{% endmacro %}

After:

{% macro get_column_values(table, column, max_records=none, default=none) -%}
...
{% endmacro %}

If you were relying on the position to match up your optional arguments, this may be a breaking change — in general, we recommend that you explicitly declare any optional arguments (if not all of your arguments!)

-- before: This works on previous version of dbt-utils, but on 0.7.0, the `50` would be passed through as the `order_by` argument
{% set payment_methods = dbt_utils.get_column_values(
        ref('stg_payments'),
        'payment_method',
        50
) %}

-- after
{% set payment_methods = dbt_utils.get_column_values(
        ref('stg_payments'),
        'payment_method',
        max_records=50
) %}

• Add new argument, order_by, to get_column_values (code originally in #289 from @clausherther, merged via #349)
• Add slugify macro, and use it in the pivot macro. 🚨 This macro uses the re module, which is only available in dbt v0.19.0+. As a result, this feature introduces a breaking change. (#314)
• Add not_null_proportion schema test that allows the user to specify the minimum (at_least) tolerated proportion (e.g., 0.95) of non-null values

• Update the default implementation of concat macro to use || operator (#373 from @ChristopheDuong). Note this may be a breaking change for adapters that support concat() but not ||, such as Apache Spark.

• Use power() instead of pow() in generate_series() and haversine_distance() as they are synonyms in most SQL dialects, but some dialects only have power() (#354 from @swanderz)
• Make get_column_values return the default value passed as a parameter instead of an empty string before compilation (#304 from @jmriego

• make sequential_values schema test use dbt_utils.type_timestamp() to allow for compatibility with db's without timestamp data type. #376 from @swanderz

• Add new accepted_range test (#276 @joellabes)
• Make expression_is_true work as a column test (code originally in #226 from @elliottohara, merged via #313)
• Add new schema test, not_accepted_values (#284 @JavierMonton)
• Support a new argument, zero_length_range_allowed in the mutually_exclusive_ranges test (#307 @zemekeneng)
• Add new schema test, sequential_values (#318, inspired by @hundredwatt)
• Support quarter in the postgres__last_day macro (#333 @seunghanhong)
• Add new argument, unit, to haversine_distance (#340 @bastienboutonnet)
• Add new schema test, fewer_rows_than (code originally in #221 from @dmarts, merged via #343)

• Handle booleans gracefully in the unpivot macro (#305 @avishalom)
• Fix a bug in get_relation_by_prefix that happens with Snowflake external tables. Now the macro will retrieve tables that match the prefix which are external tables (#351)
• Fix cardinality_equality test when the two tables' column names differed (#334 @joellabes)

• Fix Markdown formatting for hub rendering (#336 @coapacetic)
• Reorder readme and improve docs

• Fix insert_by_period to support dbt v0.19.0, with backwards compatibility for earlier versions (#319, #320)

• Speed up CI via threads, workflows (#315, #316)
• Fix equality test when used with ephemeral models + explicit column set (#321)
• Fix get_query_results_as_dict integration test with consistent ordering (#322)
• All macros are now properly dispatched, making it possible for non-core adapters to implement a shim package for dbt-utils (#312) Thanks @chaerinlee1 and @swanderz
• Small, non-breaking changes to accomodate TSQL (can't group by column number references, no real TRUE/FALSE values, aggregation CTEs need named columns) (#310) Thanks @swanderz
• Make get_relations_by_pattern and get_relations_by_prefix more powerful by returning relation.type (#323)

• Bump require-dbt-version to [">=0.18.0", "<0.20.0"] to support dbt v0.19.0 (#308, #309)

• Fix the logic in get_tables_by_pattern_sql to ensure non-default arguments are respected (#279)

• Fix the logic in get_tables_by_pattern_sql for matching a schema pattern on BigQuery (#275)

• 🚨 dbt v0.18.0 or greater is required for this release. If you are not ready to upgrade, consider using a previous release of this package
• 🚨 The get_tables_by_prefix, union_tables and get_tables_by_pattern macros have been removed

• Upgrade your dbt project to v0.18.0 using these instructions.
• Upgrade your packages.yml file to use version 0.6.0 of this package. Run dbt clean and dbt deps.
• If your project uses the get_tables_by_prefix macro, replace it with get_relations_by_prefix. All arguments have retained the same name.
• If your project uses the union_tables macro, replace it with union_relations. While the order of arguments has stayed consistent, the tables argument has been renamed to relations. Further, the default value for the source_column_name argument has changed from '_dbt_source_table' to '_dbt_source_relation' — you may want to explicitly define this argument to avoid breaking changes.

-- before:
{{ dbt_utils.union_tables(
    tables=[ref('my_model'), source('my_source', 'my_table')],
    exclude=["_loaded_at"]
) }}

-- after:
{{ dbt_utils.union_relations(
    relations=[ref('my_model'), source('my_source', 'my_table')],
    exclude=["_loaded_at"],
    source_column_name='_dbt_source_table'
) }}

• If your project uses the get_tables_by_pattern macro, replace it with get_tables_by_pattern_sql — all arguments are consistent.

• Switch usage of adapter_macro to adapter.dispatch, and define dbt_utils_dispatch_list, enabling users of community-supported database plugins to add or override macro implementations specific to their database (#267)
• Use add_ephemeral_prefix instead of hard-coding a string literal, to support database adapters that use different prefixes (#267)
• Implement a quote_columns argument in the unique_combination_of_columns schema test (#270 @JoshuaHuntley)

• Remove deprecated macros get_tables_by_prefix and union_tables (#268)
• Remove get_tables_by_pattern macro, which is equivalent to the get_tables_by_pattern_sql macro (the latter has a more logical name) (#268)

• Improve release process, and fix tests (#251)
• Make deprecation warnings more useful (#258 @tayloramurphy)
• Add more docs for date_spine (#265 @calvingiles)