Setup e2e integration test for graph store homogeneous inference by kmontemayor2-sc · Pull Request #433 · Snapchat/GiGL

kmontemayor2-sc · 2026-01-13T18:03:56Z

Scope of work done

Please focus your reviews on the code under examples/link_prediction/graph_store. Everything else should be reviewed in other prs (mainly #432 )

Specifically, examples/link_prediction/graph_store/homogeneous_inference.py is the most important file here.

As a follow up to this I will make it so users can customize the server code.

The main differences between this code and the "colocated" mode (which should be documented in the docstring) are:

Calling init_compute_node to setup the entire heterogeneous training cluster
Using GraphStoreInfo to capture the cluster topology
Using RemoteDistDataset instead of DistDataset as a pointer to the DistDataset stored on the storage cluster.

Where is the documentation for this feature?: N/A

Did you add automated tests or write a test plan?

Updated Changelog.md? NO

Ready for code review?: NO

kmontemayor2-sc · 2026-01-13T18:04:04Z

/e2e_test

github-actions · 2026-01-13T18:04:16Z

GiGL Automation

@ 18:04:16UTC : 🔄 E2E Test started.

@ 18:24:09UTC : ❌ Workflow failed.
Please check the logs for more details.

kmontemayor2-sc · 2026-01-13T18:25:01Z

/e2e_test

github-actions · 2026-01-13T18:25:14Z

GiGL Automation

@ 18:25:14UTC : 🔄 E2E Test started.

kmontemayor2-sc · 2026-01-13T21:16:59Z

/e2e_test

github-actions · 2026-01-13T21:17:13Z

GiGL Automation

@ 21:17:12UTC : 🔄 E2E Test started.

kmontemayor2-sc · 2026-01-14T21:27:01Z

/e2e_test

github-actions · 2026-01-14T21:27:12Z

GiGL Automation

@ 21:27:12UTC : 🔄 E2E Test started.

@ 22:21:44UTC : ❌ Workflow failed.
Please check the logs for more details.

kmontemayor2-sc · 2026-01-14T23:47:45Z

/e2e_test

github-actions · 2026-01-14T23:48:00Z

GiGL Automation

@ 23:48:00UTC : 🔄 E2E Test started.

@ 24:51:24UTC : ✅ Workflow completed successfully.

python/gigl/distributed/distributed_neighborloader.py

python/gigl/distributed/graph_store/compute.py

python/gigl/distributed/graph_store/storage_main.py

python/gigl/distributed/utils/neighborloader.py

python/gigl/distributed/utils/networking.py

python/gigl/env/distributed.py

python/tests/integration/distributed/graph_store/graph_store_integration_test.py

kmontemayor2-sc · 2026-01-16T01:37:46Z

/e2e_test

github-actions · 2026-01-16T01:37:59Z

GiGL Automation

@ 01:37:59UTC : 🔄 E2E Test started.

@ 03:05:51UTC : ✅ Workflow completed successfully.

svij-sc

Amazing!
Really excited to see this go in 😄

examples/link_prediction/graph_store/configs/e2e_hom_cora_sup_gs_task_config.yaml

deployment/configs/e2e_glt_gs_resource_config.yaml

examples/link_prediction/graph_store/configs/e2e_hom_cora_sup_gs_task_config.yaml

examples/link_prediction/graph_store/configs/example_resource_config.yaml

examples/link_prediction/graph_store/homogeneous_inference.py

kmontemayor2-sc · 2026-01-20T18:09:39Z

/e2e_test

github-actions · 2026-01-20T18:09:54Z

GiGL Automation

@ 18:09:54UTC : 🔄 E2E Test started.

@ 19:30:12UTC : ❌ Workflow failed.
Please check the logs for more details.

kmontemayor2-sc · 2026-01-20T19:41:25Z

/e2e_test

github-actions · 2026-01-20T19:41:54Z

GiGL Automation

@ 19:41:53UTC : 🔄 E2E Test started.

@ 21:05:18UTC : ❌ Workflow failed.
Please check the logs for more details.

kmontemayor2-sc · 2026-01-20T21:14:11Z

/e2e_test

github-actions · 2026-01-20T21:14:24Z

GiGL Automation

@ 21:14:23UTC : 🔄 E2E Test started.

@ 22:40:21UTC : ❌ Workflow failed.
Please check the logs for more details.

mkolodner-sc

Thanks a lot Kyle!

examples/link_prediction/graph_store/homogeneous_inference.py

kmontemayor2-sc · 2026-01-20T22:50:53Z

/e2e_test

github-actions · 2026-01-20T22:51:06Z

GiGL Automation

@ 22:51:05UTC : 🔄 E2E Test started.

@ 24:15:14UTC : ❌ Workflow failed.
Please check the logs for more details.

kmontemayor2-sc · 2026-01-21T00:31:21Z

/e2e_test

github-actions · 2026-01-21T00:31:35Z

GiGL Automation

@ 24:31:34UTC : 🔄 E2E Test started.

@ 01:55:46UTC : ✅ Workflow completed successfully.

Co-authored-by: kmontemayor <kyle.e.montemayor@gmail.com>

kmonte added 4 commits January 10, 2026 00:07

Setup DistNeighborloader for graph store sampling

4233f92

cleanup

fa0bd9a

setup e2e gs hom inference

1853bc1

only gs test

1bccd1a

fix path

3678d70

kmonte added 2 commits January 13, 2026 21:14

logs

bcb93e6

other test

359398f

fixes

c804750

fix

ce30f6b

kmonte added 3 commits January 15, 2026 18:33

update comments

76c4865

Merge branch 'main' into kmonte/gs-homo-e2e-inf

3b39d36

fixes

fdd38a4

kmontemayor2-sc commented Jan 15, 2026

View reviewed changes

kmontemayor2-sc changed the title ~~Kmonte/gs homo e2e inf~~ Setup e2e integration test for graph store homogeneous inference Jan 15, 2026

svij-sc reviewed Jan 17, 2026

View reviewed changes

kmonte added 2 commits January 20, 2026 16:54

Merge branch 'main' into kmonte/gs-homo-e2e-inf

42554a4

address comments

d5edc61

use cluster info

e9f0cfa

more pg

db29e74

mkolodner-sc approved these changes Jan 20, 2026

View reviewed changes

svij-sc approved these changes Jan 20, 2026

View reviewed changes

comments

56d416f

don't need barrier

7173b47

Merge branch 'main' into kmonte/gs-homo-e2e-inf

6e3fa98

kmontemayor2-sc marked this pull request as ready for review January 21, 2026 16:57

kmontemayor2-sc requested review from nshah-sc, xgao4-sc, yliu2-sc and zfan3-sc as code owners January 21, 2026 16:57

kmontemayor2-sc enabled auto-merge January 21, 2026 16:57

kmontemayor2-sc added this pull request to the merge queue Jan 21, 2026

Merged via the queue into main with commit 33b109d Jan 21, 2026
6 checks passed

kmontemayor2-sc deleted the kmonte/gs-homo-e2e-inf branch January 21, 2026 18:24

zfan3-sc pushed a commit that referenced this pull request Jan 21, 2026

Setup e2e integration test for graph store homogeneous inference (#433)

ea16ba2

Co-authored-by: kmontemayor <kyle.e.montemayor@gmail.com>

zfan3-sc pushed a commit that referenced this pull request Jan 21, 2026

Setup e2e integration test for graph store homogeneous inference (#433)

b2734df

Co-authored-by: kmontemayor <kyle.e.montemayor@gmail.com>

Conversation

kmontemayor2-sc commented Jan 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

kmontemayor2-sc commented Jan 13, 2026

Uh oh!

github-actions bot commented Jan 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

GiGL Automation

Uh oh!

kmontemayor2-sc commented Jan 13, 2026

Uh oh!

github-actions bot commented Jan 13, 2026

GiGL Automation

Uh oh!

kmontemayor2-sc commented Jan 13, 2026

Uh oh!

github-actions bot commented Jan 13, 2026

GiGL Automation

Uh oh!

kmontemayor2-sc commented Jan 14, 2026

Uh oh!

github-actions bot commented Jan 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

GiGL Automation

Uh oh!

kmontemayor2-sc commented Jan 14, 2026

Uh oh!

github-actions bot commented Jan 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

GiGL Automation

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

kmontemayor2-sc commented Jan 16, 2026

Uh oh!

github-actions bot commented Jan 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

GiGL Automation

Uh oh!

svij-sc left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

kmontemayor2-sc commented Jan 20, 2026

Uh oh!

github-actions bot commented Jan 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

GiGL Automation

Uh oh!

kmontemayor2-sc commented Jan 20, 2026

Uh oh!

github-actions bot commented Jan 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

GiGL Automation

Uh oh!

kmontemayor2-sc commented Jan 20, 2026

Uh oh!

github-actions bot commented Jan 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

GiGL Automation

Uh oh!

mkolodner-sc left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

kmontemayor2-sc commented Jan 13, 2026 •

edited

Loading

github-actions bot commented Jan 13, 2026 •

edited

Loading

github-actions bot commented Jan 14, 2026 •

edited

Loading

github-actions bot commented Jan 14, 2026 •

edited

Loading

github-actions bot commented Jan 16, 2026 •

edited

Loading

github-actions bot commented Jan 20, 2026 •

edited

Loading

github-actions bot commented Jan 20, 2026 •

edited

Loading

github-actions bot commented Jan 20, 2026 •

edited

Loading

github-actions bot commented Jan 20, 2026 •

edited

Loading

github-actions bot commented Jan 21, 2026 •

edited

Loading