[Bug] Complex types are truncated during describe extended
#473
Open
Description
Is this a new bug in dbt-spark?
- I believe this is a new bug in dbt-spark
- I have searched the existing issues, and I could not find an existing issue for this bug
Current Behavior
Complex types are truncated when running this macro:
https://github.com/dbt-labs/dbt-spark/blob/3fc624cb99488e803956304c9dea2c10facab08d/dbt/include/spark/macros/adapters.sql#L281-L286
This happens due to DESCRIBE EXTENDED
, which truncates the results before returning them.
Expected Behavior
The types should be complete.
Steps To Reproduce
- create a model (e.g. my_model) with a sufficiently complex type
- run
DESCRIBE EXTENDED my_model
- look at the resulting type for the complex column
Relevant log output
No response
Environment
- OS:
- Python:
- dbt-core:
- dbt-spark:
Additional Context
No response