Skip to content

Comments

Optimize upsert performance for large datasets#2943

Open

EnyMan wants to merge 9 commits intoapache:main from

EnyMan:upsert-optimization

Open

Optimize upsert performance for large datasets #2943
EnyMan wants to merge 9 commits intoapache:main from
EnyMan:upsert-optimization

Commits

Commits on Jan 22, 2026

feat: Optimize upsert process with coarse match filter and vectorized comparisons
EnyMan EnyMan
committed
feat: Enhance vectorized comparison to handle struct-level nulls and empty structs
EnyMan EnyMan
committed
feat: Optimize insert filtering in upsert process using anti-join for matched keys
EnyMan EnyMan
committed
feat: Further optimize the filter for big datasets
EnyMan EnyMan
committed
refactor: Improve code readability with consistent formatting
EnyMan EnyMan
committed
test: Add type assertions for `Reference` in upsert filter tests
EnyMan EnyMan
committed
refactor: Remove redundant imports in upsert filter tests
EnyMan EnyMan
committed
refactor: reformated
EnyMan EnyMan
committed

Commits on Feb 20, 2026

Merge branch 'main' into upsert-optimization
Fokko Fokko
authored