Skip to content

Feat/simplify upsert#1947

Closed
koenvo wants to merge 13 commits intoapache:mainfrom
koenvo:feat/simplify-upsert
Closed

Feat/simplify upsert#1947
koenvo wants to merge 13 commits intoapache:mainfrom
koenvo:feat/simplify-upsert

Conversation

@koenvo
Copy link
Contributor

@koenvo koenvo commented Apr 23, 2025

No description provided.

assert [snap.summary.operation for snap in tbl.snapshots() if snap.summary is not None] == expected_operations

# This should be a no-op
# This will update all 3 rows
Copy link
Contributor

@Fokko Fokko Apr 23, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think it is very nice to update rows that should not be updated 🤔 If nothing changes, we should just skip over it.

Comment on lines +488 to +489
# with pytest.raises(ValueError, match="Target table has duplicate rows, aborting upsert"):
# _ = tbl.upsert(df)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should be able to let this test pass pretty easily:

if has_duplicate_rows(target_table, join_cols):

@koenvo koenvo closed this Apr 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants