Skip to content

[Test] Allow execution of test dfsm at scale through the use of optional test dimension#7437

Open
gmarciani wants to merge 4 commits into
aws:developfrom
gmarciani:wip/mgiacomo/3160/test-update-at-scale-0910-1
Open

[Test] Allow execution of test dfsm at scale through the use of optional test dimension#7437
gmarciani wants to merge 4 commits into
aws:developfrom
gmarciani:wip/mgiacomo/3160/test-update-at-scale-0910-1

Conversation

@gmarciani

@gmarciani gmarciani commented Jun 10, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Description of changes

Allow execution of test dfsm at scale through the use of optional test dimension.
When executed at scale the test deploys a cluster with:

  • 10 login nodes pool, having 100 nodes each
  • 50 queues with 20 nodes each

With this PR we are introducing a new option al test config dimension flags that is meant to inject custom behaviors in tests. An example of usage is to execute a test at scale.

Tests

ONGOING

test-suites:
  update:
    test_update.py::test_dynamic_file_systems_update:
      dimensions:
        - instances:
            - t3.large
          oss:
            - alinux2023
          regions:
            - us-east-1
          schedulers:
            - slurm
          flags:
            - at_scale

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@gmarciani gmarciani requested review from a team as code owners June 10, 2026 13:57
@gmarciani gmarciani added skip-changelog-update Disables the check that enforces changelog updates in PRs Test labels Jun 10, 2026
@gmarciani gmarciani force-pushed the wip/mgiacomo/3160/test-update-at-scale-0910-1 branch 3 times, most recently from 8cf3896 to dda66b6 Compare June 10, 2026 19:01
gmarciani added 4 commits June 10, 2026 17:44
@gmarciani
[Test] Add possibility to specify optional test flags as test dimensi…
d6fbc61 
…on `flags`.

Such flags can be used to inject custom behaviors in tests and trigger such behaviors through the usual test config.

An example is to inject the behavior of executing the same test, but at scale.
@gmarciani
[Test] Add possibility to execute test_dynamic_file_systems_update at…
a75cb63 
… scale through the use of test flag dimension.
@gmarciani
[Test] Use flexible instance types in test_dynamic_file_systems_upda…
37ac2b6 
…te to reduce the risk of ICE.

 This is especially needed when the test is executed at scale.
@gmarciani
[Test] Use c5.4xlarge as head node instance type in test_dynamic_fil…
0fc0395 
…e_systems_update when the test is executed at scale.
@gmarciani gmarciani force-pushed the wip/mgiacomo/3160/test-update-at-scale-0910-1 branch from 2c1fe33 to 0fc0395 Compare June 10, 2026 21:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

skip-changelog-update Disables the check that enforces changelog updates in PRs Test

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@gmarciani