feat(feature-processor): Add Lake Formation credential vending and Spark 3.5/Python 3.12 support#5816

Open

BassemHalim wants to merge 27 commits intoaws:masterfrom

BassemHalim:feat/feature-store-fp-lf

Commits on Apr 30, 2026

Commits on May 1, 2026

fix(sagemaker-core): Update Spark image error message to include Python 3.12
BassemHalim
committed
chore(sagemaker-mlops): Add pyspark 3.5.1 to test and feature-processor deps
BassemHalim
committed
test(sagemaker-mlops): Skip Spark integ tests on unsupported Python versions
BassemHalim
committed
feat(sagemaker-mlops): Auto-install feature-store-pyspark in to_pipeline
BassemHalim
committed
feat(sagemaker-mlops): Add Python 3.12 Spark support and auto-install feature-store-pyspark
BassemHalim
committed
feat(feature-processor): Auto-install feature-store-pyspark for Spark remote jobs
BassemHalim
committed
test(feature-processor): Update test_to_pipeline to match injected pre_execution_commands
BassemHalim
committed
Merge branch 'master' into feat/feature-store-fp-lf
BassemHalim
authored

Commits on May 2, 2026

fix
BassemHalim
committed

Commits on May 4, 2026

Commits on May 6, 2026

fix(remote-function): Detect Spark version dynamically for JAR copy
BassemHalim
committed

Commits on May 7, 2026

Commits on May 8, 2026

trigger CI
BassemHalim
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(feature-processor): Add Lake Formation credential vending and Spark 3.5/Python 3.12 support#5816

feat(feature-processor): Add Lake Formation credential vending and Spark 3.5/Python 3.12 support#5816
BassemHalim wants to merge 27 commits intoaws:masterfrom
BassemHalim:feat/feature-store-fp-lf

Commits on Apr 28, 2026

feat(feature-processor): Add use_lake_formation_credentials parameter

feat(feature-processor): Add signing key for stored function integrity

feat(feature-processor): Add Spark image resolver for dynamic image URI

feat(feature-processor): Use image resolver and pass signing key in scheduler

fix(feature-processor): Dynamic Hadoop version and always-on Feature Store JARs

Commits on Apr 30, 2026

feat(remote-function): Support Python 3.12 and auto-detect Spark version

Add Integ test (WIP)

Merge branch 'master' into feat/feature-store-fp-lf

Commits on May 1, 2026

fix(sagemaker-core): Update Spark image error message to include Python 3.12

chore(sagemaker-mlops): Add pyspark 3.5.1 to test and feature-processor deps

test(sagemaker-mlops): Skip Spark integ tests on unsupported Python versions

feat(sagemaker-mlops): Auto-install feature-store-pyspark in to_pipeline

feat(sagemaker-mlops): Add Python 3.12 Spark support and auto-install feature-store-pyspark

feat(feature-processor): Auto-install feature-store-pyspark for Spark remote jobs

test(feature-processor): Update test_to_pipeline to match injected pre_execution_commands

Merge branch 'master' into feat/feature-store-fp-lf

Commits on May 2, 2026

fix

Commits on May 4, 2026

fix(feature-processor): Update JAR copy command to use glob pattern for Spark 3.5

test(feature-processor): Add unit tests for LF credentials, ECDSA key gen, and JAR install

test(remote-function): Add test for pyspark version auto-detection in Spark image

Merge branch 'master' into feat/feature-store-fp-lf

fix(test): Mock pyspark in unit test and remove debug print

fix(feature-processor): Move pyspark import to function scope in image resolver

Commits on May 6, 2026

fix(remote-function): Detect Spark version dynamically for JAR copy

Commits on May 7, 2026

fix(test): Update test_to_pipeline expected jar copy command

Merge branch 'master' into feat/feature-store-fp-lf

Commits on May 8, 2026

trigger CI