[EPIC] Sort-merge join (SMJ) execution improvements #20910
Description
I have a number of things I'd like to keep improving for SMJ, particularly because DataFusion Comet still relies on it heavily for larger-than-memory joins.
- Specialized stream for semi/anti SMJ perf: specialized SemiAntiSortMergeJoinStream #20806
- Remove semi/anti logic from existing SMJ stream, and optimize simplified logic
- More use of Arrow-rs
DynComparatorwhere appropriate to reduce per-row type matching