Add Distribution::HashPartitioned to Distribution::KeyPartitioned API bridge

[gene-bordegaray]

Which issue does this PR close?

• Closes Replace / rename HashPartitioned distribution as KeyPartitioned #23236.

Rationale for this change

HashPartitioned is historical naming for a key-partitioning requirement. This keeps the old variant as a deprecated compatibility bridge while moving DataFusion internals to KeyPartitioned.

What changes are included in this PR?

Adds KeyPartitioned, deprecates HashPartitioned, and treats both equivalently during the transition to avoid breaking changes for downstream consumers. A blast radius report on this was done here #23241

Are these changes tested?

Yes.

Are there any user-facing changes?

Yes, Distribution::HashPartitioned is deprecated and trainsitioned to Distribution::KeyPartitioned.

[github-actions]

Thank you for opening this pull request!

Reviewer note: cargo-semver-checks reported the current version number is not SemVer-compatible with the changes in this pull request (compared against the base branch).

Details

     Cloning apache/main
    Building datafusion v54.0.0 (current)
       Built [ 101.728s] (current)
     Parsing datafusion v54.0.0 (current)
      Parsed [   0.034s] (current)
    Building datafusion v54.0.0 (baseline)
       Built [ 100.916s] (baseline)
     Parsing datafusion v54.0.0 (baseline)
      Parsed [   0.036s] (baseline)
    Checking datafusion v54.0.0 -> v54.0.0 (no change; assume patch)
     Checked [   0.586s] 223 checks: 223 pass, 30 skip
     Summary no semver update required
    Finished [ 205.055s] datafusion
    Building datafusion-physical-expr v54.0.0 (current)
       Built [  28.393s] (current)
     Parsing datafusion-physical-expr v54.0.0 (current)
      Parsed [   0.045s] (current)
    Building datafusion-physical-expr v54.0.0 (baseline)
       Built [  28.732s] (baseline)
     Parsing datafusion-physical-expr v54.0.0 (baseline)
      Parsed [   0.049s] (baseline)
    Checking datafusion-physical-expr v54.0.0 -> v54.0.0 (no change; assume patch)
     Checked [   0.384s] 223 checks: 221 pass, 2 fail, 0 warn, 30 skip

--- failure enum_variant_added: enum variant added on exhaustive enum ---

Description:
A publicly-visible enum without #[non_exhaustive] has a new variant.
        ref: https://doc.rust-lang.org/cargo/reference/semver.html#enum-variant-new
       impl: https://github.com/obi1kenobi/cargo-semver-checks/tree/v0.48.0/src/lints/enum_variant_added.ron

Failed in:
  variant Distribution:KeyPartitioned in /home/runner/work/datafusion/datafusion/datafusion/physical-expr/src/partitioning.rs:609

--- failure enum_variant_marked_deprecated: enum variant #[deprecated] added ---

Description:
An enum variant is now #[deprecated]. Downstream crates will get a compiler warning when using this variant.
        ref: https://doc.rust-lang.org/reference/attributes/diagnostics.html#the-deprecated-attribute
       impl: https://github.com/obi1kenobi/cargo-semver-checks/tree/v0.48.0/src/lints/enum_variant_marked_deprecated.ron

Failed in:
  variant datafusion_physical_expr::Distribution::HashPartitioned in /home/runner/work/datafusion/datafusion/datafusion/physical-expr/src/partitioning.rs:606

     Summary semver requires new major version: 1 major and 1 minor checks failed
    Finished [  59.090s] datafusion-physical-expr
    Building datafusion-physical-optimizer v54.0.0 (current)
       Built [  38.748s] (current)
     Parsing datafusion-physical-optimizer v54.0.0 (current)
      Parsed [   0.022s] (current)
    Building datafusion-physical-optimizer v54.0.0 (baseline)
       Built [  38.718s] (baseline)
     Parsing datafusion-physical-optimizer v54.0.0 (baseline)
      Parsed [   0.022s] (baseline)
    Checking datafusion-physical-optimizer v54.0.0 -> v54.0.0 (no change; assume patch)
     Checked [   0.128s] 223 checks: 223 pass, 30 skip
     Summary no semver update required
    Finished [  78.848s] datafusion-physical-optimizer
    Building datafusion-physical-plan v54.0.0 (current)
       Built [  36.607s] (current)
     Parsing datafusion-physical-plan v54.0.0 (current)
      Parsed [   0.132s] (current)
    Building datafusion-physical-plan v54.0.0 (baseline)
       Built [  36.406s] (baseline)
     Parsing datafusion-physical-plan v54.0.0 (baseline)
      Parsed [   0.131s] (baseline)
    Checking datafusion-physical-plan v54.0.0 -> v54.0.0 (no change; assume patch)
     Checked [   0.574s] 223 checks: 223 pass, 30 skip
     Summary no semver update required
    Finished [  75.144s] datafusion-physical-plan

[gabotechs]

👍 Nice!

[alamb]

Thanks @gabotechs and @gene-bordegaray