-
Notifications
You must be signed in to change notification settings - Fork 984
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Release 0.18.0 #367
Merged
Release 0.18.0 #367
Changes from all commits
Commits
Show all changes
60 commits
Select commit
Hold shift + click to select a range
23b1604
Update run.md
rsenseman d938e39
First cut of 0.18.0 docs
jtcohen6 12b341f
Visual revision
jtcohen6 dcc560c
Add more info about selectors
jtcohen6 fc60a67
Add prerelease note to migration guide
jtcohen6 5f267f7
Update list. Add word prerelease
jtcohen6 3d1919f
Merge pull request #302 from fishtown-analytics/feature/node-selectio…
jtcohen6 98c8c3c
Update migration guide. Add beta release FAQs
jtcohen6 cf46161
Add changelog, rm joke
jtcohen6 b0188c3
Merge branch 'current' of github.com:fishtown-analytics/docs.getdbt.c…
jtcohen6 89cc482
Merge pull request #314 from fishtown-analytics/fix/add-beta-faqs
jtcohen6 b4f9185
Write docs on asset-paths
clrcrl c8bdbd5
Add changelog component and update migration guide
clrcrl 87b7879
Merge pull request #315 from fishtown-analytics/asset-paths
jtcohen6 2faaf15
Revise migration guide to account for new docs
jtcohen6 697aa34
Add steps to PR template
jtcohen6 b47e965
Try relative link [skip ci]
jtcohen6 80b6b6b
Merge pull request #319 from fishtown-analytics/fix/migguide-template
jtcohen6 fef7f62
Add service account impersonation documentation
bbhoss ff7cc53
Update website/docs/reference/warehouse-profiles/bigquery-profile.md
bbhoss 81023d3
add changelog pragma
bbhoss 9e098e1
update migration guide
bbhoss aa057d3
add note about eventual consistency
bbhoss ac23013
Merge pull request #323 from bbhoss/patch-1
jtcohen6 d8a825a
Merge current
jtcohen6 190df72
Merge branch 'next' of github.com:fishtown-analytics/docs.getdbt.com …
jtcohen6 6ccfcdb
Document adapter.dispatch
jtcohen6 dbc911f
Add initial docs for --defer and --state
jtcohen6 a5fcc49
Fix env var naming
jtcohen6 0b6160e
Merge current
jtcohen6 0a76b49
Merge branch 'next' of github.com:fishtown-analytics/docs.getdbt.com …
jtcohen6 bade18d
Merge branch 'feature/deferred-runs' of github.com:fishtown-analytics…
jtcohen6 551b84a
PR feedback
jtcohen6 0a7c4ce
Merge pull request #329 from fishtown-analytics/feature/deferred-runs
jtcohen6 c58259c
Update algolia API key for next
jtcohen6 3058a26
Merge pull request #339 from fishtown-analytics/fix/algolia-api-key
jtcohen6 102599e
Fix merge conflict
jtcohen6 86abe00
Merge pull request #328 from fishtown-analytics/feature/adapter-dispatch
jtcohen6 e270703
First cut of state: method docs
jtcohen6 85f51af
Fix spacing
jtcohen6 b19f322
Reword note
jtcohen6 9dd44d7
Slightly clearer, then dayenu
jtcohen6 86414b8
Merge pull request #344 from fishtown-analytics/feature/state-selecti…
jtcohen6 5f624d4
Merge branch 'next' into patch-1
rsenseman 20b410e
add line to changed documentation page
rsenseman 06492cd
Merge pull request #286 from rsenseman/patch-1
jtcohen6 295a4de
merge current
jtcohen6 1dc6e8f
Refactor node selection docs
jtcohen6 a801081
Add workflow pro-tip for slim CI
jtcohen6 9e69362
Docs for full_refresh config
jtcohen6 7b2525f
Docs for BQ policy_tags
jtcohen6 221691b
Docs for Snowflake query_tag
jtcohen6 907100b
More concise impersonate BQ SA docs
jtcohen6 196ca3a
Docs for BQ TTL
jtcohen6 4474968
PR feedback
jtcohen6 da12f6b
Project-level overviews in dbt-docs
jtcohen6 b14110a
Merge pull request #363 from fishtown-analytics/feature/better-0180-docs
jtcohen6 cc92f60
Merge current
jtcohen6 b640a55
Update migration guide
jtcohen6 57cb993
Fix hyphen
jtcohen6 File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
82 changes: 82 additions & 0 deletions
82
website/docs/docs/guides/migration-guide/upgrading-to-0-18-0.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,82 @@ | ||
--- | ||
title: "Upgrading to 0.18.0" | ||
|
||
--- | ||
|
||
### Resources | ||
|
||
- [Changelog](https://github.com/fishtown-analytics/dbt/blob/dev/marian-anderson/CHANGELOG.md) | ||
- [Discussion: Prerelease](https://discourse.getdbt.com/t/prerelease-v0-18-0-marian-anderson/1545) | ||
|
||
## Breaking changes | ||
|
||
Please be aware of the following changes in v0.18.0. While breaking, we do not expect these to affect the majority of projects. | ||
|
||
### Adapter macros | ||
|
||
- dbt only has access to adapter plugin macros from the currently-in-use adapter or one of its dependencies, rather than all installed adapters in the namespace. | ||
- `adapter_macro` is no longer a macro and will raise a deprecation warning. Use `adapter.dispatch` instead. | ||
|
||
### Data tests | ||
|
||
- Data tests are written as CTEs instead of subqueries. Adapter plugins for databases that don't support CTEs may need to override this behavior. | ||
|
||
### Python requirements | ||
- Upgraded `snowflake-connector-python` dependency to 2.2.10 and enabled the SSO token cache | ||
|
||
## New features | ||
|
||
For more details, see [new and changed documentation](#new-and-changed-documentation) below. | ||
|
||
:::info [β] Beta Features | ||
There are several pieces of net-new functionality in v0.18.0, with iterative improvements to come. If you encounter unexpected behavior, please post in Slack or open an issue. | ||
::: | ||
|
||
### Node selection | ||
- methods: `config`, `test_type`, `test_name`, `package`, [β] `state` | ||
- intersections | ||
- nth-parent/child | ||
- [β] version-controlled YAML selectors | ||
- [β] defer unselected node references to state defined by a previous run's artifacts | ||
|
||
### Adapter macros | ||
- `adapter.dispatch` replaces `adapter_macro`, with much greater flexibility | ||
- Schema tests are now defined via `dispatch`, such that non-core plugins | ||
can override schema test definitions | ||
|
||
### Docs | ||
- Include static assets (such as images) in auto-generated docs site | ||
- Improved resource search | ||
- Project-level overviews | ||
|
||
### Database-specific | ||
- Specify IAM profile when connecting to Redshift | ||
- Snowflake query tags at connection and model level | ||
- Impersonate a BigQuery service account when connecting via oauth | ||
- Adding policy tags to BigQuery columns | ||
- Configure time-to-live for BigQuery tables | ||
|
||
## New and changed documentation | ||
|
||
**Core** | ||
- [node selection syntax](node-selection/syntax) | ||
- [list (ls)](commands/list) | ||
- [deferring to previous run state](run#deferring-to-previous-run-state) | ||
- [adapter.dispatch](adapter#dispatch) | ||
- [`asset-paths` config](asset-paths) (also updated [dbt_project.yml](dbt_project.yml.md) and [description](description)) | ||
- [flag for colorized logs](run#enable-or-disable-colorized-logs) | ||
- [`full_refresh` config](full_refresh) | ||
|
||
**Docs** | ||
- [project-level overviews](documentation#custom-project-level-overviews) | ||
|
||
**Redshift** | ||
- [`iam_profile`](redshift-profile#specifying-an-iam-profile) | ||
|
||
**Snowflake** | ||
- `query_tag` in [profile](snowflake-profile), [model config](snowflake-configs#query-tags) | ||
|
||
**BigQuery** | ||
- [`impersonate_service_account`](https://docs.getdbt.com/reference/warehouse-profiles/bigquery-profile#service-account-impersonation) | ||
- [`policy_tags`](bigquery-configs#policy-tags) | ||
- [`hours_to_expiration`](bigquery-configs#controlling-table-expiration) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,4 @@ | ||
--- | ||
title: What is a beta release? | ||
--- | ||
This is a chance to try out brand-new functionality. You get to start planning for use cases that the next minor version will unlock. We get to hear from you about unexpected behavior and nasty bugs, so that the release candidate has more polish and fewer surprises. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,18 @@ | ||
--- | ||
title: Why would I want to impersonate a service account? | ||
--- | ||
|
||
You may want your models to be built using a dedicated service account that has | ||
elevated access to read or write data to the specified project or dataset. | ||
Typically, this requires you to create a service account key for running under | ||
development or on your CI server. By specifing the email address of the service | ||
account you want to build models as, you can use [Application Default Credentials](https://cloud.google.com/sdk/gcloud/reference/auth/application-default) or the | ||
service's configured service account (when running in GCP) to assume the identity | ||
of the service account with elevated permissions. | ||
|
||
This allows you to reap the advantages of using federated identity for developers | ||
(via ADC) without needing to grant individual access to read and write data | ||
directly, and without needing to create separate service account and keys for | ||
each user. It also allows you to completely eliminate the need for service | ||
account keys in CI as long as your CI is running on GCP (Cloud Build, Jenkins, | ||
GitLab/Github Runners, etc). |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,4 @@ | ||
--- | ||
title: Why are there "prerelease" docs? | ||
--- | ||
We want to give beta testers the information they need to try out new features, without adding confusion to the current docs site. This is served from a long-lived `next` branch of the docs repo. Feedback on prerelease docs is also welcome—use the "Edit this page" feature at the bottom. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do we need to remove this?