feature: add emr-serverless step for SageMaker Pipelines#5325

Open

wutimot wants to merge 161 commits intoaws:master-v2from

wutimot:feature/emr-serverless-step

Commits on Jan 29, 2025

change: update image_uri_configs 01-27-2025 06:18:13 PST

sagemaker-bot
authored and
root
committed
fix: skip TF tests for unsupported versions (#5007)

benieric
authored and
root
committed
change: update image_uri_configs 01-29-2025 06:18:08 PST

sagemaker-bot
authored and
root
committed
chore: add new images for HF TGI (#5005)

authored and
root
committed
feat: use jumpstart deployment config image as default optimization image (#4992)

authored and
root
committed

Commits on Feb 1, 2025

prepare release v2.238.0
ci
committed
update development version to v2.238.1.dev0
ci
committed
Fix ssh host policy (#4966)

authored and
root
committed
change: Allow telemetry only in supported regions (#5009)

authored and
root
committed
mpirun protocol - distributed training with @remote decorator (#4998)

authored and
root
committed
feat: Add support for deepseek recipes (#5011)

benieric
authored and
root
committed

Commits on Feb 14, 2025

prepare release v2.239.0
ci
committed
update development version to v2.239.1.dev0
ci
committed
change: update image_uri_configs 02-04-2025 06:18:00 PST

sagemaker-bot
authored and
root
committed
Create GitHub action to trigger canaries (#5008)

nileshvd
authored and
root
committed
Add docstring for image_uris.retrieve

pintaoz
authored and
root
committed
fix: fix ValueError when updating a data quality monitoring schedule (#5002)

authored and
root
committed
Fixed pagination failing while listing collections (#5020)

authored and
root
committed
Add cleanup logic to model builder integ tests for endpoints (#5022)

sage-maker
authored and
root
committed
fix: bug in get latest version was getting the max sorted alphabetically (#5014)

authored and
root
committed
Fix documentation for local mode (#5026)

authored and
root
committed
Fix sourcedir.tar.gz filenames in docstrings (#5019)

authored and
root
committed
Add type hint for ProcessingOutput (#5030)

authored and
root
committed
Fix FeatureGroup docstring (#5028)

authored and
root
committed
Fix Tensorflow doc link (#5029)

authored and
root
committed
Fix the workshop link for Step Functions (#5034)

authored and
root
committed
Fix all type hint and docstrings for callable (#5035)

authored and
root
committed
fix: keep sagemaker_session from being overridden to None (#5021)

authored and
root
committed

Commits on Feb 19, 2025

prepare release v2.239.1
ci
committed
update development version to v2.239.2.dev0
ci
committed
Move RecordSerializer and RecordDeserializer to sagemaker.serializers and sagemaker.deserialzers (#5037)

authored and
root
committed
Add framework_version to all TensorFlowModel examples (#5038)

authored and
root
committed
Fix hyperparameter strategy docs (#5045)

sage-maker
authored and
root
committed
fix: pass in inference_ami_version to model_based endpoint type (#5043)

authored and
root
committed
Add warning about not supporting torch.nn.SyncBatchNorm (#5046)

authored and
root
committed
prepare release v2.239.2
ci
committed
update development version to v2.239.3.dev0
ci
committed
change: update image_uri_configs 02-19-2025 06:18:15 PST

sagemaker-bot
authored and
root
committed
change: added ap-southeast-7 and mx-central-1 for Jumpstart (#5049)

authored and
root
committed

Commits on Feb 25, 2025

prepare release v2.239.3
ci
committed
update development version to v2.239.4.dev0
ci
committed
change: update image_uri_configs 02-20-2025 06:18:08 PST

sagemaker-bot
authored and
root
committed
feat: Add support for TGI Neuronx 0.0.27 and HF PT 2.3.0 image in PySDK (#5050)

authored and
root
committed
Add backward compatbility for RecordSerializer and RecordDeserializer (#5052)

authored and
root
committed
py_version doc fixes (#5048)

sage-maker
authored and
root
committed
change: update image_uri_configs 02-21-2025 06:18:10 PST

sagemaker-bot
authored and
root
committed
fix: altconfig hubcontent and reenable integ test (#5051)

authored and
root
committed
fix: forbid extras in Configs (#5042)

benieric
authored and
root
committed
Remove main function entrypoint in ModelBuilder dependency manager. (#5058)

authored and
root
committed
documentation: Removed a line about python version requirements of training script which can misguide users. (#5057)

authored and
root
committed

Commits on Mar 6, 2025

prepare release v2.240.0
ci
committed
update development version to v2.240.1.dev0
ci
committed
Fix key error in _send_metrics() (#5068)

authored and
root
committed
fix: Added check for the presence of model package group before creating one (#5063)

authored and
root
committed
Use sagemaker session's s3_resource in download_folder (#5064)

authored and
root
committed
Fix error when there is no session to call _create_model_request() (#5062)

authored and
root
committed
Ensure Model.is_repack() returns a boolean (#5060)

authored and
root
committed
feat: Allow ModelTrainer to accept hyperparameters file (#5059)

benieric
authored and
root
committed
feature: support training for JumpStart model references as part of Curated Hub Phase 2 (#5070)

authored and
root
committed
feat: Make DistributedConfig Extensible (#5039)

authored and
root
committed
Skip tests with deprecated instance type (#5077)

authored and
root
committed

Commits on Mar 24, 2025

Basic PoC
nargokul
committed

Commits on Apr 11, 2025

Add sagemaker_utils module (#1667)

authored

Commits on Apr 30, 2025

Cleanup V3 branch (#1674)
benieric
authored

Commits on May 1, 2025

Move SageMaker Core as a submodule in Python SDK (#1669)

pintaoz-aws
and
pintaoz
authored

Commits on May 5, 2025

Add inital HubContentDocument Utils, Model Classes, and ModelTrainer class method (#1675)
benieric
authored

Commits on May 6, 2025

Refractor ImageRetriever in v3 (#1673)

pintaoz-aws
and
pintaoz
authored

Commits on May 7, 2025

Sagemaker Train Module and changes to related utils (#1671)
nargokul
authored

Commits on May 8, 2025

Cleanup Train Module (#1678)
benieric
authored
Test intelligent defaults in sagemaker-core with utils module (#1676)

rsareddy0329
and
Roja Reddy Sareddy
authored

Commits on May 13, 2025

Baseline ModelTrainer from live (#1681)
benieric
committed

Commits on May 15, 2025

Add serializer and deserializer in Endpoint configuration (#1680)

rsareddy0329
and
Roja Reddy Sareddy
authored

Commits on May 19, 2025

Commits on May 21, 2025

Commits on May 27, 2025

Add submodule workflow (#1692)

rsareddy0329
and
Roja Reddy Sareddy
authored
Retrieve image uri from s3 (#1694)

pintaoz-aws
and
pintaoz
authored

Commits on Jun 3, 2025

Fix: next_token causing infinite loop in fetching Clusters (#1699)
zhaoqizqwang
authored

Commits on Jun 4, 2025

Add submodule workflow and Tox config update to test PR workflows (#1697)

rsareddy0329
and
Roja Reddy Sareddy
authored

Commits on Jun 9, 2025

feat: working sagemaker-serve with reliance on v2 lib (#1702)
sage-maker
authored

Commits on Jun 11, 2025

feature: working model.py and tests with reliance on v2 (#1704)
sage-maker
authored

Commits on Jun 12, 2025

Commits on Aug 5, 2025

change: task 3 remove dependency on predictor (#1725)
sage-maker
authored

Commits on Aug 12, 2025

feat: task 4 + 5 use sagemaker core session and change init/build (#1729)
sage-maker
authored

Commits on Nov 18, 2025

Update submodule-codebuild-ci.yml (#1846)
nargokul
authored

Commits on Nov 19, 2025

Update submodule-codebuild-ci.yml to support PR checks for V3 launch (#1851)
aviruthen
authored

Commits on Nov 20, 2025

Commits on Nov 22, 2025

Revert v3.0.2 Changelog and prepare SageMaker Core v2.0.1 release (#5334)
zhaoqizqwang
authored

Commits on Nov 23, 2025

Update GIthub workflows for V3 (#5335)
zhaoqizqwang
authored

Commits on Nov 24, 2025

Commits on Nov 26, 2025

Commits on Dec 1, 2025

Update imports in example notebook (#5347)
zhaoqizqwang
authored

Commits on Dec 4, 2025

Update README for model customization launch (#5365)
papriwal
authored

Commits on Dec 5, 2025

Commits on Dec 6, 2025

Cleaned up Model Customization Notebooks (#5368)

nargokul
and
rsareddy0329
authored

Commits on Dec 7, 2025

fix: Address Hyperparameter issue , validate s3 output path, additional unit tests (#5376)

rsareddy0329
and
Roja Reddy Sareddy
authored

Commits on Dec 8, 2025

Updating benchmark evaluation for subtasks and datasets (#5378)
jam-jee
authored
Fix: Add validation to bedrock reward models - RLAIF Trainer (#5381)

rsareddy0329
and
Roja Reddy Sareddy
authored

Commits on Dec 9, 2025

Fix unit and integ tests (#5377)
aviruthen
authored

Commits on Dec 10, 2025

Update PR check workflow file (#5397)
zhaoqizqwang
authored
Separate PR check workflows (#5399)
zhaoqizqwang
authored
Wait timeout exception handling (#5400)
jam-jee
authored
Fix: Add allow list for bedrock eval models (#5394)

rsareddy0329
and
Roja Reddy Sareddy
authored
cleaning up ai registry notebook (#5403)
jam-jee
authored
ft: Remove insecure SSL context creation in Triton Python backend (#5372)

pravali96
and
Pravali Uppugunduri
authored
Fix: Bug fixes for s3 path validation, mlflow app creation (#5402)

rsareddy0329
and
Roja Reddy Sareddy
authored
Update CHANGELOG.md and versions (#5404)
rsareddy0329
authored

Commits on Dec 11, 2025

Fix: fix sagemaker-serve tests (#5407)

rsareddy0329
and
Roja Reddy Sareddy
authored
Update readme to remove readthedocs reference temporarily (#5408)
aviruthen
authored

Commits on Dec 12, 2025

add xgboost 3.0-5 to release (#5405)

Yadan-Wei
and
Yadan Wei
authored

Commits on Dec 15, 2025

Commits on Dec 16, 2025

Fix get_child_process_ids parsing issue (#5416)

pintaoz-aws
and
pintaoz
authored

Commits on Dec 17, 2025

feat: Evaluator handshake to trainer (#5420)

rsareddy0329
and
Roja Reddy Sareddy
authored
feat: Adding DataSets format validation (#5415)
jam-jee
authored
Fix _run_shell_cmd() to use list input (#5422)

pintaoz-aws
and
pintaoz
authored
Fix failing ai_registry unit tests (#5426)
aviruthen
authored

Commits on Dec 19, 2025

Commits on Dec 20, 2025

Add validation in conda env name (#5430)

pintaoz-aws
and
pintaoz
authored
Update files for release (#5434)
aviruthen
authored

Commits on Dec 22, 2025

Add validation for traversal components in S3 path (#5436)

pintaoz-aws
and
pintaoz
authored

Commits on Dec 23, 2025

Update OutputDataConfig documentation to avoid customer confusion
mollyheamazon
committed

Commits on Jan 5, 2026

fix: Update telemetry constants to include MLOPS as well (#5438)

rsareddy0329
and
Roja Reddy Sareddy
authored

Commits on Jan 6, 2026

fix: Remove tags from ProcessingJob creation in Processor (#5459)
nargokul
authored

Commits on Jan 7, 2026

New PR check workflow (#5460)
aviruthen
authored

Commits on Jan 8, 2026