Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Support jsonExtension in LoadJobConfig #1751

Merged
merged 5 commits into from
Jan 12, 2024

Conversation

kiraksi
Copy link
Contributor

@kiraksi kiraksi commented Dec 14, 2023

This PR:

  • Adds jsonExtension as a parameter to LoadJobConfig when loading data from a specified file format
  • It enable users to directly specify the extension within the job configuration and store that information in metadata
  • It allows BQ to Interpret the source format correctly (?)

Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

  • Make sure to open an issue as a bug/issue before writing your code! That way we can discuss the change, evaluate designs, and agree on the general idea
  • Ensure the tests and linter pass
  • Code coverage does not decrease (if any source code was changed)
  • [] Appropriate docs were updated (if necessary) (should autogenerate?)

Fixes #1581 🦕

@product-auto-label product-auto-label bot added size: m Pull request size is medium. api: bigquery Issues related to the googleapis/python-bigquery API. labels Dec 14, 2023
@kiraksi
Copy link
Contributor Author

kiraksi commented Dec 19, 2023

We are unable to find jsonExtension explicitly in LoadJobConfig BigQuery documentation, only some mentions of it. This PR is on hold until we can get clarity on this.

Edit: Was able to find jsonExtension, however its documentation was being suppressed as the person working on it left Google and did not unsurppress it. This was fix and the documentation was updated

@product-auto-label product-auto-label bot added size: s Pull request size is small. and removed size: m Pull request size is medium. labels Jan 11, 2024
@kiraksi kiraksi marked this pull request as ready for review January 11, 2024 05:02
@kiraksi kiraksi requested review from a team as code owners January 11, 2024 05:02
@kiraksi kiraksi removed the request for review from alvarowolfx January 11, 2024 18:29
Copy link
Collaborator

@chalmerlowe chalmerlowe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@chalmerlowe chalmerlowe merged commit 0fd7347 into googleapis:main Jan 12, 2024
19 checks passed
@kiraksi kiraksi deleted the support-jsonextension branch January 17, 2024 14:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: bigquery Issues related to the googleapis/python-bigquery API. size: s Pull request size is small.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support jsonExtension in LoadJobConfig
2 participants