Replies: 1 comment
-
|
Yes! I'm focusing on schema right now, but lineage is definitely something I want to cover eventually. :) |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Because recap can read from lots of different data sources, I started to wonder about lineage. Any thought about adding a module to write lineage between datasets in the catalog?
dbt (etc) knows most of what happens in the DWH, but E/L is often standalone with little lineage. Simple libraries for parsing api output from fivetran/hightouch, singer logs, or logging from python scripts could go a long way in adding both lineage and possibly observability.
Beta Was this translation helpful? Give feedback.
All reactions