Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Iceberg drop columns #1153

Open
3 tasks done
vitstransky opened this issue Dec 10, 2024 · 0 comments
Open
3 tasks done

[Feature] Iceberg drop columns #1153

vitstransky opened this issue Dec 10, 2024 · 0 comments
Labels
enhancement New feature or request iceberg Related to the iceberg file format

Comments

@vitstransky
Copy link

Is this your first time submitting a feature request?

  • I have read the expectations for open source contributors
  • I have searched the existing issues, and I could not find an existing issue for this feature
  • I am requesting a straightforward extension of existing dbt-spark functionality, rather than a Big Idea better suited to a discussion

Describe the feature

Hello,

Iceberg version 2 supports dropping columns as documented https://iceberg.apache.org/docs/1.7.0/spark-ddl/#alter-table-drop-column. However, when I drop a column in my source data and try to run dbt, I encounter the following error: "Iceberg does not support dropping columns from tables," as implemented https://github.com/dbt-labs/dbt-spark/blob/0ccce2fdc7f2d6341e3b8fd7630eea516c427b65/dbt/include/spark/macros/adapters.sql#L404-L413.

Is it possible to implement this feature, or is there any blocker preventing it?

Describe alternatives you've considered

No response

Who will this benefit?

No response

Are you interested in contributing this feature?

Yes, I do

Anything else?

No response

@vitstransky vitstransky added enhancement New feature or request triage labels Dec 10, 2024
@amychen1776 amychen1776 added iceberg Related to the iceberg file format and removed triage labels Dec 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request iceberg Related to the iceberg file format
Projects
None yet
Development

No branches or pull requests

2 participants