Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TBLPROPERTIES not updated on Spark Catalog #366

Closed
osopardo1 opened this issue Jul 26, 2024 · 0 comments · Fixed by #367
Closed

TBLPROPERTIES not updated on Spark Catalog #366

osopardo1 opened this issue Jul 26, 2024 · 0 comments · Fixed by #367
Assignees
Labels
type: bug Something isn't working

Comments

@osopardo1
Copy link
Member

Although the TBLPROPERTIES persisted on the _delta_log, the spark.sessionState.catalog and the SHOW TBLPROPERTIES commands do not load the changes properly.

We have to fix two main things:

  1. QbeastTableImpl load of properties. -> It should load the table properties from the underlying log.
  2. QbeastCatalog.alterTable should commit the changes also to the getSessionCatalog()

This is a patch before analysing and discussing #354

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: bug Something isn't working
Projects
None yet
2 participants