Skip to content

BigQuery issue: Tables with unapplied upsert data cannot be queried through prefix. #10465

Open
@lethanhduong

Description

Describe the bug
We're using Datastream to ingest the data to BigQuery. After that, we collect the BigQuery metadata to Datahub.
However, The ingestion job got a issue when it try to query partition information of Datasets using DataStream flow.

Error Log
400 Tables with unapplied upsert data cannot be queried through prefix. First table with upsert data

Script Called
The template query is executed in this case
https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/ingestion/source/bigquery_v2/queries.py#L72

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions