Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Normalisation simplification (#3672) + giving all tables a schema #3675

Merged
merged 3 commits into from
Sep 4, 2024

Conversation

jarohen
Copy link
Member

@jarohen jarohen commented Sep 4, 2024

(Yes, I know, two big changes in one PR... 🙊)

When we did #3407, we left the on-disk names for _id etc as xt$id, for ease of migration (it made it a non-breaking change) - but this caused a lot of mapping complexity in code.

This PR propagates that rename onto both the tx-log and obj-store - as such, it's a breaking change for both, so users will be required to start their XT2 nodes afresh (i.e. clear tx-log and object-store). We're currently assuming, given XT2 is still 'early access', that this is acceptable - if this causes a problem for you, please do get in touch and we'll arrange a migration path.

The secondary change is related to table schemas - currently, we store most tables without a schema (with the exception of information_schema, pg_catalog etc). While we have a breaking tx-log and obj-store change going through, I've additionally taken the opportunity to ensure that all table-names contain a schema name (defaulting to public, like Postgres). This is added as soon as possible (before it's written to the tx-log), which removes a fair bit of mapping/default handling within the rest of the codebase.

There'll likely be one more change as part of #3672 - removing any mention/hint of normalisation from the non-Clojure APIs.

@jarohen jarohen self-assigned this Sep 4, 2024
@jarohen jarohen added this to the 2.0.0-SNAPSHOT milestone Sep 4, 2024
@jarohen jarohen merged commit 9fd90cc into xtdb:main Sep 4, 2024
@jarohen jarohen linked an issue Sep 4, 2024 that may be closed by this pull request
3 tasks
jarohen added a commit to jarohen/xtdb that referenced this pull request Sep 6, 2024
jarohen added a commit to jarohen/xtdb that referenced this pull request Sep 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Simplify normalisation
1 participant