1 Release published by 1 person

• v0.15.0rc3

  published Dec 11, 2024

46 Pull requests merged by 22 people

• fix(ui) Add backwards compatibility to the UI for old policy filters

  #12017 merged Dec 11, 2024

• feat: Enrich superset ingestion

  #11688 merged Dec 11, 2024

• fix(ingest/tableau): project_path_pattern use in _is_denied_project

  #12010 merged Dec 11, 2024

• feat(structuredProperties) Add new settings aspect plus graphql changes for structured props

  #12052 merged Dec 11, 2024

• feat(ingest/kafka): Flag for optional schemas ingestion

  #12077 merged Dec 11, 2024

• fix(ingest/abs): detect jsonl schema

  #11775 merged Dec 11, 2024

• fix(ingest/gc): minor tweak gc source

  #12093 merged Dec 11, 2024

• docs(ingest/athena): update recipe with aws key pair example

  #12076 merged Dec 11, 2024

• fix(cli): don't use /api in gms url

  #12083 merged Dec 11, 2024

• feat(ingest/snowflake): allow option for incremental properties

  #12080 merged Dec 11, 2024

• fix(openapi): fix sort criteria parameter

  #12090 merged Dec 11, 2024

• feat(ingest): allow max_workers=1 with ASYNC_BATCH rest sink

  #12088 merged Dec 10, 2024

• docs(structured properties) add guide

  #12070 merged Dec 10, 2024

• feat(ui) Add alchemy component library to FE

  #12054 merged Dec 10, 2024

• fix(openapi): adds in previously ignored keep alive value

  #12068 merged Dec 10, 2024

• build(ci): codecov integration

  #12073 merged Dec 10, 2024

• build(datahub-frontend): enable code-coverage

  #12072 merged Dec 10, 2024

• fix(entity-service): prevent mutation of systemMetdata on prev

  #12081 merged Dec 10, 2024

• fix(ingest): replace sqllineage/sqlparse with our SQL parser

  #12020 merged Dec 10, 2024

• build(coverage): rename python coverage reports

  #12071 merged Dec 10, 2024

• fix(entity-service): handle no-op system-metadata batches

  #12055 merged Dec 10, 2024

• build(metadata-events): fix shell interpreter mismatch in build script

  #12066 merged Dec 10, 2024

• fix(plugin-logging): adjust error logging in plugin registry

  #12064 merged Dec 10, 2024

• fix(py-sdk): DataJobPatchBuilder handling timestamps, output edges

  #12067 merged Dec 10, 2024

• feat: Add parent container hierarchy label to the container

  #11705 merged Dec 9, 2024

• fix(web) disallow deselecting all degrees on impact analysis view

  #12063 merged Dec 9, 2024

• feat(airflow): drop Airflow < 2.3 support + make plugin v2 the default

  #12056 merged Dec 9, 2024

• feat(ingestion/tableau): hidden asset handling

  #11559 merged Dec 9, 2024

• feat(tableau): adds more reporting metrics to better understand lineage construction in tableau ingestion

  #12008 merged Dec 9, 2024

• fix(ingest/gc): Additional dataprocess cleanup fixes

  #12049 merged Dec 7, 2024

• fix(ingest/sagemaker): Adding option to control retry for any aws source

  #8727 merged Dec 7, 2024

• feat(ingest/superset): initial support for superset datasets

  #11972 merged Dec 6, 2024

• refactor(ingest/sql): add _get_view_definition helper method

  #12033 merged Dec 6, 2024

• fix(ingest/powerbi): reduce type cast usage

  #12004 merged Dec 6, 2024

• fix(ingest/snowflake): Add handling of Hybrid Table type for Snowflake ingestion

  #12039 merged Dec 6, 2024

• fix(logs): add actor urn on unauthorised

  #12030 merged Dec 6, 2024

• fix(ingest): avoid shell entities during view lineage generation

  #12044 merged Dec 6, 2024

• feat(snowflake): adding oauth token bypass to snowflake

  #12048 merged Dec 6, 2024

• docs(compliance-forms) update guide for creating form via UI

  #11936 merged Dec 5, 2024

• fix(entity-service): no-op batches

  #12047 merged Dec 5, 2024

• fix(datahub-client): prevent unneeded classes in datahub-client jar

  #12037 merged Dec 5, 2024

• chore(deps): bump cross-spawn from 7.0.3 to 7.0.6 in /datahub-web-react

  #11978 merged Dec 5, 2024

• feat(ingest): add urn validation test files

  #12036 merged Dec 5, 2024

• fix(graph-edge): fix graph edge delete exception

  #12025 merged Dec 5, 2024

• fix(ingest/gc): Adding test and more checks to gc source

  #12027 merged Dec 5, 2024

• feat(ingest/kafka): additional validation for oauth_db signature

  #11996 merged Dec 5, 2024

25 Pull requests opened by 16 people

• feat(spark):OpenLineage 1.25.0

  #12041 opened Dec 5, 2024

• feat(ingestion/tableau): verify role assignment to user in `test_connection`.

  #12042 opened Dec 5, 2024

• fix(ingest): always resolve platform for browse path v2

  #12045 opened Dec 5, 2024

• feat(ingest/lookml): Added ability to ingest view files shared between models, that has the same connection

  #12046 opened Dec 5, 2024

• feat(glossary): support multiple ownership types

  #12050 opened Dec 6, 2024

• config(docker-profiles): clean-up

  #12051 opened Dec 6, 2024

• feat(forms) Clean up form prompts on structured property deletion

  #12053 opened Dec 6, 2024

• feat(ui-plugin) - Allow custom userContext states to be added

  #12057 opened Dec 8, 2024

• fix: pulsar ingestion fails when Avro schema is missing namespace or name

  #12058 opened Dec 8, 2024

• fix(ingest/databricks): Fix profiling

  #12060 opened Dec 9, 2024

• feat(ingest/looker): Added `delta-lake` to platform naming convention involving 2 parts

  #12061 opened Dec 9, 2024

• feat(ingest): add looker meta extractor support in sql parsing

  #12062 opened Dec 9, 2024

• docs(ingest/snowflake): update permissions for dynamic tables

  #12074 opened Dec 10, 2024

• Add variable to show full title in lineage by default

  #12078 opened Dec 10, 2024

• test(ingest/tableau): add test for extract_project_hierarchy scenario

  #12079 opened Dec 10, 2024

• fix(ingest/kafka-connect): update connection test url

  #12082 opened Dec 10, 2024

• chore(deps): bump nanoid from 3.3.6 to 3.3.8 in /datahub-web-react

  #12086 opened Dec 10, 2024

• tests(datahub-client): new tests for the AvroSchemaConverter

  #12087 opened Dec 10, 2024

• docs(champions): Update directory of DH Champions

  #12089 opened Dec 10, 2024

• docs(release): v0.3.7.7

  #12091 opened Dec 10, 2024

• feat(ingest/snowflake): ingest secure, dynamic, hybrid table metadata

  #12094 opened Dec 11, 2024

• feat(openapi-v3): add minimal timeseries aspect support

  #12096 opened Dec 11, 2024

• feat(structuredProps) Add frontend for managing structured props and filtering by them

  #12097 opened Dec 11, 2024

• feat(ingest/airflow): Add way to disable Airflow plugin without a restart

  #12098 opened Dec 11, 2024

• feat(structuredProperties): add hide property and show as badge validators

  #12099 opened Dec 11, 2024

5 Issues closed by 4 people

• DBT initialization error in CLI ingestion

  #11931 closed Dec 11, 2024

• kafka ingestion source ingests schemas for all topics and ignores topic_patterns

  #11907 closed Dec 11, 2024

• Redshift Multi-AZ cannot use STL scan

  #11922 closed Dec 11, 2024

• Tableau ingestion didn't avoid unpublished sheets.

  #6421 closed Dec 9, 2024

• Okta oidc is failing post authentication

  #11886 closed Dec 6, 2024

6 Issues opened by 6 people

• Probably a good idea would be to verify the private key existence here. E.g. `listdescriptors(private=True)`

  #12092 opened Dec 11, 2024

• Dagster logo does not display in UI when using acryl_datahub_dagster_plugin

  #12084 opened Dec 10, 2024

• Groups are not persistent (disappears after creation) in the Frontend (UI).

  #12075 opened Dec 10, 2024

• Cannot connect to Self-Hosted Tableau Server via Proxy Server with HTTPS

  #12069 opened Dec 10, 2024

• It seems like there is a bug in PostgreSQL where passwords containing two or more consecutive $$ special characters are being converted into numbers when applied

  #12059 opened Dec 9, 2024

• LookML view file shared between multiple models, with same connection, gets ingested only once

  #12043 opened Dec 5, 2024

22 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• fix(ingestion/lookml): resolve CLL issue caused by column name casing.

  #11876 commented on Dec 11, 2024 • 16 new comments

• feat(UI): add user location to user profile page

  #12016 commented on Dec 11, 2024 • 8 new comments

• fix(ingestion/dremio): Ignore filtered containers in schema allowdeny pattern, implement platform_instance in browse path and add vertica as known dremio source

  #11959 commented on Dec 11, 2024 • 6 new comments

• fix(ingest/tableau): apply `page_size` regardless of object count

  #12026 commented on Dec 11, 2024 • 5 new comments

• Enhancements to the user pic list selection within entities

  #11803 commented on Dec 9, 2024 • 2 new comments

• fix(ingest/redshift): fix serverless redshift temp table lineage

  #11625 commented on Dec 5, 2024 • 1 new comment

• fix(ui): dereference errors

  #12034 commented on Dec 6, 2024 • 0 new comments

• chore(dep): exclude end of life dependency

  #12007 commented on Dec 6, 2024 • 0 new comments

• fix(spark): Fix Finegrained lineage and handle spark rdd map where input and output is the same

  #11956 commented on Dec 11, 2024 • 0 new comments

• fix(ingestion): fix stateful ingestion for GCS source

  #11879 commented on Dec 11, 2024 • 0 new comments

• fix(ingestion/oracle): Improved foreign key handling

  #11867 commented on Dec 10, 2024 • 0 new comments

• Add mirrors for building in enterprise environments

  #11854 commented on Dec 11, 2024 • 0 new comments

• feat(ingestion/hive): Add lineage functionality for hive tables from/to file storage

  #11841 commented on Dec 6, 2024 • 0 new comments

• fix(ingestion/oracle): display database name when using service name in recipe

  #11778 commented on Dec 5, 2024 • 0 new comments

• fix(pdl): Add Dataplatform Instance urn pdl file

  #11754 commented on Dec 9, 2024 • 0 new comments

• feat(ui): support all entities with display names in browse paths v2

  #11657 commented on Dec 11, 2024 • 0 new comments

• Feature/update logic mssql lineage

  #10959 commented on Dec 11, 2024 • 0 new comments

• feat(Dataquality aspect): Added Data Quality Metrics aspect to emit data quality metrics metadata into Datahub

  #9265 commented on Dec 6, 2024 • 0 new comments

• Feature Request: Custom Query for Teradata

  #11757 commented on Dec 10, 2024 • 0 new comments

• Pydantic error being raised on postgres view ingestion

  #11858 commented on Dec 9, 2024 • 0 new comments

• Empty roles list after fresh install

  #12029 commented on Dec 6, 2024 • 0 new comments

• spark lineage plugin - remove_partition_pattern config parameter has no effect

  #11942 commented on Dec 5, 2024 • 0 new comments