1 Release published by 1 person

• v0.15.0rc3

  published Dec 11, 2024

62 Pull requests merged by 24 people

• docs(ingest): add docs on the SQL parser

  #12103 merged Dec 12, 2024

• feat(ingest): improve query fingerprinting

  #12104 merged Dec 12, 2024

• fix(ingest/snowflake): further improve dot handling

  #12110 merged Dec 12, 2024

• feat(structuredProperties): add hide property and show as badge validators

  #12099 merged Dec 12, 2024

• chore(deps): bump nanoid from 3.3.7 to 3.3.8 in /docs-website

  #12114 merged Dec 12, 2024

• chore(deps): bump nanoid from 3.3.6 to 3.3.8 in /datahub-web-react

  #12086 merged Dec 12, 2024

• fix(datahub-client): adds missing archiveAppendix to artifactid when publishing

  #12112 merged Dec 12, 2024

• feat(forms) Clean up form prompts on structured property deletion

  #12053 merged Dec 12, 2024

• feat(openapi-v3): add minimal timeseries aspect support

  #12096 merged Dec 12, 2024

• fix(ui): dereference errors

  #12034 merged Dec 12, 2024

• feat(datahub-client): additionally generates java8 artefacts

  #12106 merged Dec 12, 2024

• feat(glossary): support multiple ownership types

  #12050 merged Dec 12, 2024

• fix(ingestion/lookml): resolve CLL issue caused by column name casing.

  #11876 merged Dec 12, 2024

• docs(ingest/snowflake): update permissions for dynamic tables

  #12074 merged Dec 12, 2024

• fix(ingest/tableau): apply page_size regardless of object count

  #12026 merged Dec 12, 2024

• fix(ingest/snowflake): handle dots in snowflake table names

  #12105 merged Dec 12, 2024

• feat(cli): add --workers arg in delete command

  #12102 merged Dec 12, 2024

• fix(ingest/sdk): report recipe correctly

  #12101 merged Dec 12, 2024

• fix(ingest): always resolve platform for browse path v2

  #12045 merged Dec 12, 2024

• feat(spark):OpenLineage 1.25.0

  #12041 merged Dec 12, 2024

• feat(ingest/snowflake): ingest secure, dynamic, hybrid table metadata

  #12094 merged Dec 12, 2024

• docs(champions): Update directory of DH Champions

  #12089 merged Dec 12, 2024

• feat(ui) Add full support for structured properties on assets

  #12100 merged Dec 12, 2024

• feat(structuredProps) Add frontend for managing structured props and filtering by them

  #12097 merged Dec 11, 2024

• fix(ui) Add backwards compatibility to the UI for old policy filters

  #12017 merged Dec 11, 2024

• feat: Enrich superset ingestion

  #11688 merged Dec 11, 2024

• fix(ingest/tableau): project_path_pattern use in _is_denied_project

  #12010 merged Dec 11, 2024

• feat(structuredProperties) Add new settings aspect plus graphql changes for structured props

  #12052 merged Dec 11, 2024

• feat(ingest/kafka): Flag for optional schemas ingestion

  #12077 merged Dec 11, 2024

• fix(ingest/abs): detect jsonl schema

  #11775 merged Dec 11, 2024

• fix(ingest/gc): minor tweak gc source

  #12093 merged Dec 11, 2024

• docs(ingest/athena): update recipe with aws key pair example

  #12076 merged Dec 11, 2024

• fix(cli): don't use /api in gms url

  #12083 merged Dec 11, 2024

• feat(ingest/snowflake): allow option for incremental properties

  #12080 merged Dec 11, 2024

• fix(openapi): fix sort criteria parameter

  #12090 merged Dec 11, 2024

• feat(ingest): allow max_workers=1 with ASYNC_BATCH rest sink

  #12088 merged Dec 10, 2024

• docs(structured properties) add guide

  #12070 merged Dec 10, 2024

• feat(ui) Add alchemy component library to FE

  #12054 merged Dec 10, 2024

• fix(openapi): adds in previously ignored keep alive value

  #12068 merged Dec 10, 2024

• build(ci): codecov integration

  #12073 merged Dec 10, 2024

• build(datahub-frontend): enable code-coverage

  #12072 merged Dec 10, 2024

• fix(entity-service): prevent mutation of systemMetdata on prev

  #12081 merged Dec 10, 2024

• fix(ingest): replace sqllineage/sqlparse with our SQL parser

  #12020 merged Dec 10, 2024

• build(coverage): rename python coverage reports

  #12071 merged Dec 10, 2024

• fix(entity-service): handle no-op system-metadata batches

  #12055 merged Dec 10, 2024

• build(metadata-events): fix shell interpreter mismatch in build script

  #12066 merged Dec 10, 2024

• fix(plugin-logging): adjust error logging in plugin registry

  #12064 merged Dec 10, 2024

• fix(py-sdk): DataJobPatchBuilder handling timestamps, output edges

  #12067 merged Dec 10, 2024

• feat: Add parent container hierarchy label to the container

  #11705 merged Dec 9, 2024

• fix(web) disallow deselecting all degrees on impact analysis view

  #12063 merged Dec 9, 2024

• feat(airflow): drop Airflow < 2.3 support + make plugin v2 the default

  #12056 merged Dec 9, 2024

• feat(ingestion/tableau): hidden asset handling

  #11559 merged Dec 9, 2024

• feat(tableau): adds more reporting metrics to better understand lineage construction in tableau ingestion

  #12008 merged Dec 9, 2024

• fix(ingest/gc): Additional dataprocess cleanup fixes

  #12049 merged Dec 7, 2024

• fix(ingest/sagemaker): Adding option to control retry for any aws source

  #8727 merged Dec 7, 2024

• feat(ingest/superset): initial support for superset datasets

  #11972 merged Dec 6, 2024

• refactor(ingest/sql): add _get_view_definition helper method

  #12033 merged Dec 6, 2024

• fix(ingest/powerbi): reduce type cast usage

  #12004 merged Dec 6, 2024

• fix(ingest/snowflake): Add handling of Hybrid Table type for Snowflake ingestion

  #12039 merged Dec 6, 2024

• fix(logs): add actor urn on unauthorised

  #12030 merged Dec 6, 2024

• fix(ingest): avoid shell entities during view lineage generation

  #12044 merged Dec 6, 2024

• feat(snowflake): adding oauth token bypass to snowflake

  #12048 merged Dec 6, 2024

18 Pull requests opened by 14 people

• config(docker-profiles): clean-up

  #12051 opened Dec 6, 2024

• feat(ui-plugin) - Allow custom userContext states to be added

  #12057 opened Dec 8, 2024

• fix: pulsar ingestion fails when Avro schema is missing namespace or name

  #12058 opened Dec 8, 2024

• fix(ingest/databricks): Fix profiling

  #12060 opened Dec 9, 2024

• feat(ingest/looker): Added `delta-lake` to platform naming convention involving 2 parts

  #12061 opened Dec 9, 2024

• feat(ingest): add looker meta extractor support in sql parsing

  #12062 opened Dec 9, 2024

• Add variable to show full title in lineage by default

  #12078 opened Dec 10, 2024

• test(ingest/tableau): add test for extract_project_hierarchy scenario

  #12079 opened Dec 10, 2024

• fix(ingest/kafka-connect): update connection test url, handle api failures

  #12082 opened Dec 10, 2024

• tests(datahub-client): new tests for the AvroSchemaConverter

  #12087 opened Dec 10, 2024

• docs(release): v0.3.7.7

  #12091 opened Dec 10, 2024

• feat(ingest/airflow): Add way to disable Airflow plugin without a restart

  #12098 opened Dec 11, 2024

• fix(ingestion/tableau): honor the key projectNameWithin in pagination

  #12107 opened Dec 12, 2024

• fix(ui): dereference issues

  #12109 opened Dec 12, 2024

• feat(ui) Add finishing touches to the structured props feature

  #12111 opened Dec 12, 2024

• refactor(ingest): cleanup structured properties validation

  #12115 opened Dec 12, 2024

• feat(airflow): add `DatahubRestHook.make_graph` method

  #12116 opened Dec 12, 2024

• feat(ingest/datahub): report progress on db ingestion

  #12117 opened Dec 13, 2024

5 Issues closed by 4 people

• DBT initialization error in CLI ingestion

  #11931 closed Dec 11, 2024

• kafka ingestion source ingests schemas for all topics and ignores topic_patterns

  #11907 closed Dec 11, 2024

• Redshift Multi-AZ cannot use STL scan

  #11922 closed Dec 11, 2024

• Tableau ingestion didn't avoid unpublished sheets.

  #6421 closed Dec 9, 2024

• Okta oidc is failing post authentication

  #11886 closed Dec 6, 2024

7 Issues opened by 7 people

• Json schema dataset not showing lineage

  #12113 opened Dec 12, 2024

• datahub plugins must be installed with pydantic v1

  #12108 opened Dec 12, 2024

• Probably a good idea would be to verify the private key existence here. E.g. `listdescriptors(private=True)`

  #12092 opened Dec 11, 2024

• Dagster logo does not display in UI when using acryl_datahub_dagster_plugin

  #12084 opened Dec 10, 2024

• Groups are not persistent (disappears after creation) in the Frontend (UI).

  #12075 opened Dec 10, 2024

• Cannot connect to Self-Hosted Tableau Server via Proxy Server with HTTPS

  #12069 opened Dec 10, 2024

• It seems like there is a bug in PostgreSQL where passwords containing two or more consecutive $$ special characters are being converted into numbers when applied

  #12059 opened Dec 9, 2024

20 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• feat(ingestion/tableau): verify role assignment to user in `test_connection`.

  #12042 commented on Dec 12, 2024 • 22 new comments

• feat(UI): add user location to user profile page

  #12016 commented on Dec 12, 2024 • 8 new comments

• fix(ingestion/dremio): Ignore filtered containers in schema allowdeny pattern

  #11959 commented on Dec 12, 2024 • 6 new comments

• Enhancements to the user pic list selection within entities

  #11803 commented on Dec 9, 2024 • 2 new comments

• feat(ingest/lookml): Added ability to ingest view files shared between models, that has the same connection

  #12046 commented on Dec 6, 2024 • 0 new comments

• chore(dep): exclude end of life dependency

  #12007 commented on Dec 6, 2024 • 0 new comments

• feat(cli): added cli option for ingestion source

  #11980 commented on Dec 12, 2024 • 0 new comments

• fix(spark): Fix Finegrained lineage and handle spark rdd map where input and output is the same

  #11956 commented on Dec 11, 2024 • 0 new comments

• fix(ingestion): fix stateful ingestion for GCS source

  #11879 commented on Dec 11, 2024 • 0 new comments

• fix(ingestion/oracle): Improved foreign key handling

  #11867 commented on Dec 10, 2024 • 0 new comments

• Add mirrors for building in enterprise environments

  #11854 commented on Dec 11, 2024 • 0 new comments

• feat(ingestion/hive): Add lineage functionality for hive tables from/to file storage

  #11841 commented on Dec 6, 2024 • 0 new comments

• fix(pdl): Add Dataplatform Instance urn pdl file

  #11754 commented on Dec 9, 2024 • 0 new comments

• feat(ui): support all entities with display names in browse paths v2

  #11657 commented on Dec 11, 2024 • 0 new comments

• Feature/update logic mssql lineage

  #10959 commented on Dec 11, 2024 • 0 new comments

• feat(Dataquality aspect): Added Data Quality Metrics aspect to emit data quality metrics metadata into Datahub

  #9265 commented on Dec 6, 2024 • 0 new comments

• OOM (Out of Memory Errors) in DataHub 0.13+ when ingesting Bigquery metadata

  #11147 commented on Dec 13, 2024 • 0 new comments

• Feature Request: Custom Query for Teradata

  #11757 commented on Dec 10, 2024 • 0 new comments

• Pydantic error being raised on postgres view ingestion

  #11858 commented on Dec 9, 2024 • 0 new comments

• Empty roles list after fresh install

  #12029 commented on Dec 6, 2024 • 0 new comments