-
Notifications
You must be signed in to change notification settings - Fork 3k
Core: Allow reading metadata table when scanning table with dropped partition source field #14089
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Core: Allow reading metadata table when scanning table with dropped partition source field #14089
Conversation
| builder.add(newFieldId, newFieldId, field.name(), Transforms.identity()); | ||
| } | ||
| return builder.build(); | ||
| return builder.build(true); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please add a short comment to explain why we intentionally bypass the compatibility check here
Fokko
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I agree with @huaxingao that a comment would be nice there, apart from that, LGTM! 👍
261f814 to
2a0341d
Compare
|
@huaxingao @Fokko thanks for the review! Added a comment 👍🏼 |
singhpk234
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you for the fix @gabeiglio ! LGTM as well
|
Thank you for the fix @gabeiglio ! Thank you for the reviews @Fokko @huaxingao @bryanck ! |
…artition source field (apache#14089) (apache#841) Co-authored-by: Gabriel Igliozzi <[email protected]>
To replicate this issue run the following spark queries: