Skip to content

[Bug] Complex types are truncated during describe extended #473

Open
@mikealfare

Description

Is this a new bug in dbt-spark?

  • I believe this is a new bug in dbt-spark
  • I have searched the existing issues, and I could not find an existing issue for this bug

Current Behavior

Complex types are truncated when running this macro:
https://github.com/dbt-labs/dbt-spark/blob/3fc624cb99488e803956304c9dea2c10facab08d/dbt/include/spark/macros/adapters.sql#L281-L286

This happens due to DESCRIBE EXTENDED, which truncates the results before returning them.

Expected Behavior

The types should be complete.

Steps To Reproduce

  • create a model (e.g. my_model) with a sufficiently complex type
  • run DESCRIBE EXTENDED my_model
  • look at the resulting type for the complex column

Relevant log output

No response

Environment

- OS:
- Python:
- dbt-core:
- dbt-spark:

Additional Context

No response

Metadata

Assignees

No one assigned

    Labels

    pkg:dbt-sparkIssue affects dbt-sparktype:bugSomething isn't working as documented

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions