Skip to content

branch-4.1: [opt](mtmv) Optimize mv rewrite performance when mv has many partition by reduce partition mapping num (#59972) - #66759

Open
seawinde wants to merge 1 commit into
apache:branch-4.1from
seawinde:pr_59972_to_branch-4.1
Open

branch-4.1: [opt](mtmv) Optimize mv rewrite performance when mv has many partition by reduce partition mapping num (#59972)#66759
seawinde wants to merge 1 commit into
apache:branch-4.1from
seawinde:pr_59972_to_branch-4.1

Conversation

@seawinde

Copy link
Copy Markdown
Member

pr: #59972
commitId: d398230

…on by reduce partition mapping num (apache#59972)

Summary

- Make MTMV partition descriptor generation honor queryUsedPartitions,
so only partitions referenced by the current query are carried through
the pipeline instead of all partitions.
- Applied the filter in
MTMVRelatedPartitionDescOnePartitionColGenerator, preserving ordering of
existing generators.
- Added unit tests for RANGE and LIST sources to assert the filter
reduces descriptors to the specified partitions.

Example
If a query only touches t1 partition p20210201,
generateRelatedPartitionDescs now emits a single descriptor for
p20210201 instead of all t1 partitions;
@seawinde
seawinde requested a review from yiguolei as a code owner August 14, 2026 05:01
@hello-stephen

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@seawinde

Copy link
Copy Markdown
Member Author

run buildall

@hello-stephen

Copy link
Copy Markdown
Contributor

FE UT Coverage Report

Increment line coverage 88.52% (108/122) 🎉
Increment coverage report
Complete coverage report

@hello-stephen

Copy link
Copy Markdown
Contributor

FE Regression Coverage Report

Increment line coverage 78.69% (96/122) 🎉
Increment coverage report
Complete coverage report

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants