Merge latest changes from main to 'Documentation' branch by rsareddy0329 · Pull Request #192 · aws/sagemaker-hyperpod-cli

rsareddy0329 · 2025-08-05T23:05:11Z

PR Approval Steps

For Requester

Description
- Check the PR title and description for clarity. It should describe the changes made and the reason behind them.
- Ensure that the PR follows the contribution guidelines, if applicable.
Security requirements
- Ensure that a Pull Request (PR) does not expose passwords and other sensitive information by using git-secrets and upload relevant evidence: https://github.com/awslabs/git-secrets
- Ensure commit has GitHub Commit Signature
Manual review
1. Click on the Files changed tab to see the code changes. Review the changes thoroughly:
  - Code Quality: Check for coding standards, naming conventions, and readability.
  - Functionality: Ensure that the changes meet the requirements and that all necessary code paths are tested.
  - Security: Check for any security issues or vulnerabilities.
  - Documentation: Confirm that any necessary documentation (code comments, README updates, etc.) has been updated.
Check for Merge Conflicts:
- Verify if there are any merge conflicts with the base branch. GitHub will usually highlight this. If there are conflicts, you should resolve them.

For Reviewer

Go through For Requester section to double check each item.
Request Changes or Approve the PR:
1. If the PR is ready to be merged, click Review changes and select Approve.
2. If changes are required, select Request changes and provide feedback. Be constructive and clear in your feedback.
Merging the PR
1. Check the Merge Method:
  1. Decide on the appropriate merge method based on your repository's guidelines (e.g., Squash and merge, Rebase and merge, or Merge).
2. Merge the PR:
  1. Click the Merge pull request button.
  2. Confirm the merge by clicking Confirm merge.

Co-authored-by: adishaa <adishaa@amazon.com>

… with minor improvements and bug fixes (#137)

… with minor improvements and bug fixes. (#139)

…and ux (#136)

…ception count data (#140)

* manual release v3.0.1

…alarm fix (#147)

… regionalized HMA URI (#141)

* Add unique time string to integ test * Update syntax

* Training CLI & SDK: example notebook and README update * Update training cli example notebook --------- Co-authored-by: Roja Reddy Sareddy <rsareddy@amazon.com>

* Update inferenece SDK examples * Update readme

* Enable Hyperpod telemetry * Enable Hyperpod telemetry * Enable Hyperpod telemetry * Enable Hyperpod telemetry * Enable Hyperpod telemetry * Enable Hyperpod telemetry * CLI: Enable Telemetry * CLI: Enable Telemetry --------- Co-authored-by: Roja Reddy Sareddy <rsareddy@amazon.com>

…102)

* update help text to avoid truncation * update volume flag to support hostPath and pvc, before e2e testing * clean up and e2e working * Minor updates after PR * update * Added unit tests for volume, all cli unit tests passed

Co-authored-by: pintaoz <pintaoz@amazon.com>

* Update inference config and integ tests * Update integ tests for new canaries

* Manual release v3.0.2 * Update changelog --------- Co-authored-by: pintaoz <pintaoz@amazon.com>

* Update readme for volume flag * Add schema pattern check to pytorch-job template, unit test added, all test passed locally

…8s (#138) * Add k8s version validation check between server and client version according to the supported versioning constraints by k8s * Fix unit test cases * Move regex to a constant. **Description** - Removed an integration test case that was being mocked. - Moved a regex to a constant. **Testing Done** Unit test cases pass no changes made to integration test cases and they should not be affected. * Add k8s version validation check between server and client version according to the supported versioning constraints by k8s * Add ref link for version comptability contraints **Description** Added a link to k8s documentation mentioning the constraints that rule the version compatibility of client and server. **Testing Done** No breaking changes.

* Fix SDK training test: Add wait time before refresh * Fix training tests in canaries

…189) Co-authored-by: pintaoz <pintaoz@amazon.com>

* Update documentation-with-new-changes branch with latest changes from main (#190) * Fix training test (#184) * Fix SDK training test: Add wait time before refresh * Fix training tests in canaries * Update logging information for submitting and deleting training job (#189) Co-authored-by: pintaoz <pintaoz@amazon.com> --------- Co-authored-by: Zhaoqi <zhaoqiwang.baruch@gmail.com> Co-authored-by: pintaoz-aws <167920275+pintaoz-aws@users.noreply.github.com> Co-authored-by: pintaoz <pintaoz@amazon.com> * Documentation Fixes (#191) Co-authored-by: Roja Reddy Sareddy <rsareddy@amazon.com> * update documentation with new changes branch with latest changes (#194) * Fix training test (#184) * Fix SDK training test: Add wait time before refresh * Fix training tests in canaries * Update logging information for submitting and deleting training job (#189) Co-authored-by: pintaoz <pintaoz@amazon.com> --------- Co-authored-by: Zhaoqi <zhaoqiwang.baruch@gmail.com> Co-authored-by: pintaoz-aws <167920275+pintaoz-aws@users.noreply.github.com> Co-authored-by: pintaoz <pintaoz@amazon.com> * Documentation Fixes (#195) * Documentation Fixes * Documentation Fixes --------- Co-authored-by: Roja Reddy Sareddy <rsareddy@amazon.com> * Documentation Fixes (#197) * Documentation Fixes * Documentation Fixes * Documentation Fixes * Documentation Fixes --------- Co-authored-by: Roja Reddy Sareddy <rsareddy@amazon.com> * Documentation Fixes (#198) * Documentation Fixes * Documentation Fixes * Documentation Fixes * Documentation Fixes * Documentation Fixes --------- Co-authored-by: Roja Reddy Sareddy <rsareddy@amazon.com> * Documentation fixes (#199) * Documentation Fixes * Documentation Fixes * Documentation Fixes * Documentation Fixes * Documentation Fixes * Documentation Fixes --------- Co-authored-by: Roja Reddy Sareddy <rsareddy@amazon.com> --------- Co-authored-by: Zhaoqi <zhaoqiwang.baruch@gmail.com> Co-authored-by: pintaoz-aws <167920275+pintaoz-aws@users.noreply.github.com> Co-authored-by: pintaoz <pintaoz@amazon.com> Co-authored-by: Roja Reddy Sareddy <rsareddy@amazon.com>

…s to view SDK config code (#188) Co-authored-by: Mohamed Zeidan <zeidmo@amazon.com>

* Add instance type support for ml.p6e-gb200.36xlarge Updated support for ml.p6-b200.48xlarge as well * Add ml.p6e-gb200.36xlarge to efa plugin

…holder value (#206) Co-authored-by: Mohamed Zeidan <zeidmo@amazon.com>

* inferenceendpointconfigs remove tab to fix syntax * comment * Add addOn nodeAffinity CRD and helm version update * Add Migration README * Seperate migration into follow up PR --------- Co-authored-by: Xuan Lu <xua@amazon.com>

* inferenceendpointconfigs remove tab to fix syntax * comment * Add addOn nodeAffinity CRD and helm version update * Add Migration README * Seperate migration into follow up PR * Add Migration README --------- Co-authored-by: Xuan Lu <xua@amazon.com>

…rPodHelmChart (#375) * inferenceendpointconfigs remove tab to fix syntax * comment * Add addOn nodeAffinity CRD and helm version update * Add Migration README * Seperate migration into follow up PR * Add Migration README * Update hyperpod-inference-operator to 2.0.0 in HyperPodHelmChart --------- Co-authored-by: Xuan Lu <xua@amazon.com>

Co-authored-by: Chad Chiang <chadchc@amazon.com>

* feat: Implement elastic training cli arguments (#273) * feat: Implement elastic training cli arguments * Add elastic training unified config and unit test * Add graceful shutdown and scaling timeout to cli args * Revert "feat: Implement elastic training cli arguments (#273)" This reverts commit 18428ef. * Remove space CLI error traceback --------- Co-authored-by: Sophia <yungwenh@amazon.com> Co-authored-by: Molly He <mollyhe@amazon.com> --- Implement port forwarding for space (#312) --- Implement MIG profile validation for spaces (#315)

* Update CHANGELOG for version 3.7.0 Added new features, enhancements, and bug fixes for v3.7.0. * chore: bump version for release --------- Co-authored-by: Syed Jafri <syedjfr@amazon.com>

Co-authored-by: Farhan Tejani <8650465+FarhanTejani@users.noreply.github.com>

…with feature improvements and bug fixes. (#388) Features * Enhanced EFA monitoring with error counter tracking for improved network health visibility Bug Fixes * Marked Xid 163 as warning-only error instead of requiring immediate reboot * Added handling for Nvidia GPU Xid 94 errors (ROBUST_CHANNEL_CONTAINED_ERROR) as a new fault category with no action triggering on Kubernetes platforms Co-authored-by: Amanuel Taddesse <amantad@amazon.com>

Co-authored-by: Ubuntu <ubuntu@ip-172-31-5-101.us-west-2.compute.internal>

Add g7e instance types to values.yaml: - nvidia-device-plugin nodeAffinity: all 6 g7e sizes - aws-efa-k8s-device-plugin supportedInstanceLabels: 4 EFA-capable g7e sizes (8xlarge, 12xlarge, 24xlarge, 48xlarge)

Add MIG configuration profiles for RTX PRO 6000 Blackwell (g7e): - all-1g.24gb: 4x 1g.24gb instances - all-2g.48gb: 2x 2g.48gb instances - all-4g.96gb: 1x 4g.96gb instance (full GPU) - mixed-2-1g.24gb-1-2g.48gb: 2x 1g.24gb + 1x 2g.48gb Ref: https://docs.nvidia.com/datacenter/tesla/mig-user-guide/supported-mig-profiles.html

- INSTANCE_RESOURCES: add all 6 g7e sizes with cpu/gpu/memory/efa specs - INSTANCE_TYPE_MIG_PROFILES: add g7e MIG profiles (1g.24gb, 2g.48gb, 4g.96gb) - HyperpodInstanceType enum: add 6 g7e entries

Add ml.g7e.{2,4,8,12,24,48}xlarge to the health-monitoring-agent DaemonSet node affinity allowlist so the agent runs on g7e instances. Part of g7e instance type onboarding for HyperPod.

Aditi2424 and others added 25 commits July 18, 2025 12:24

Update telemetry status to be Integer for parity (#130)

223af40

Co-authored-by: adishaa <adishaa@amazon.com>

Release new version for Health Monitoring Agent (1.0.643.0_1.0.192.0)…

cf77296

… with minor improvements and bug fixes (#137)

Release new version for Health Monitoring Agent (1.0.674.0_1.0.199.0)…

0342f60

… with minor improvements and bug fixes. (#139)

update inference CLI describe command print for better visualization …

631ddf9

…and ux (#136)

Update inference integ test to add dependency to improve telemetry ex…

dc440c3

…ception count data (#140)

Manual release v3.0.1 (#143)

cc08405

* manual release v3.0.1

change security-monitoring metrics data destination to us-east-2 for …

079fafd

…alarm fix (#147)

feat: Add region detection to install Health Monitoring Agent and use…

29a16c5

… regionalized HMA URI (#141)

Add unique time string to integ test (#150)

66232ed

* Add unique time string to integ test * Update syntax

update example notebook for inference CLI (#151)

9fbec4a

Training: Main documentation update (#153)

8034a24

* Training CLI & SDK: example notebook and README update * Update training cli example notebook --------- Co-authored-by: Roja Reddy Sareddy <rsareddy@amazon.com>

Update inferenece SDK examples (#155)

0bcee6d

* Update inferenece SDK examples * Update readme

update help text to avoid truncation (#158)

d2130e9

Add an option to disable the deployment of KubeFlow TrainingOperator (#…

293f9b9

…102)

Remove unused param from documentation (#170)

9f534b4

Update volume flag to support hostPath and pvc (#171)

ec8800d

* update help text to avoid truncation * update volume flag to support hostPath and pvc, before e2e testing * clean up and e2e working * Minor updates after PR * update * Added unit tests for volume, all cli unit tests passed

Restructure list-cluster output (#173)

95e073e

Co-authored-by: pintaoz <pintaoz@amazon.com>

Update inference config and integ tests (#167)

a8a2baf

* Update inference config and integ tests * Update integ tests for new canaries

Update readme for volume flag (#176)

2908a62

Manual release v3.0.2 (#177)

9b7220c

* Manual release v3.0.2 * Update changelog --------- Co-authored-by: pintaoz <pintaoz@amazon.com>

Add schema pattern check to pytorch-job template (#178)

36fac66

* Update readme for volume flag * Add schema pattern check to pytorch-job template, unit test added, all test passed locally

Fix training test (#184)

dcbc8fb

* Fix SDK training test: Add wait time before refresh * Fix training tests in canaries

Update logging information for submitting and deleting training job (#…

28424e4

…189) Co-authored-by: pintaoz <pintaoz@amazon.com>

rsareddy0329 requested a review from a team as a code owner August 5, 2025 23:05

rsareddy0329 and others added 4 commits August 6, 2025 13:51

Added new column 'deploymeny configs' to the itable that allows user'…

6553766

…s to view SDK config code (#188) Co-authored-by: Mohamed Zeidan <zeidmo@amazon.com>

Add instance type support for ml.p6e-gb200.36xlarge (#204)

63ff3b4

* Add instance type support for ml.p6e-gb200.36xlarge Updated support for ml.p6-b200.48xlarge as well * Add ml.p6e-gb200.36xlarge to efa plugin

changed endpoint name from value user has to manually insert to place…

e3f697a

…holder value (#206) Co-authored-by: Mohamed Zeidan <zeidmo@amazon.com>

nargokul had a problem deploying to manual-approval February 16, 2026 21:46 — with GitHub Actions Error

nargokul had a problem deploying to manual-approval February 17, 2026 21:17 — with GitHub Actions Error

zhaoqizqwang had a problem deploying to manual-approval February 23, 2026 23:59 — with GitHub Actions Error

add unit tests for inference crds (#373)

5c117f1

Co-authored-by: Chad Chiang <chadchc@amazon.com>

mollyheamazon had a problem deploying to manual-approval February 24, 2026 23:38 — with GitHub Actions Error

mollyheamazon had a problem deploying to manual-approval February 25, 2026 00:37 — with GitHub Actions Error

Emit metrics for CLI commands (#376)

4740ab8

mollyheamazon had a problem deploying to manual-approval February 26, 2026 17:19 — with GitHub Actions Error

Space CLI list all and doc update (#318) (#377)

ef82f7e

mollyheamazon had a problem deploying to manual-approval February 26, 2026 21:43 — with GitHub Actions Error

Release version 3.7.0 (#378)

49baa69

* Update CHANGELOG for version 3.7.0 Added new features, enhancements, and bug fixes for v3.7.0. * chore: bump version for release --------- Co-authored-by: Syed Jafri <syedjfr@amazon.com>

mujtaba1747 temporarily deployed to manual-approval March 2, 2026 20:44 — with GitHub Actions Inactive

Add missing instance types and fix EFA/memory values (#385)

b54e8c4

Co-authored-by: Farhan Tejani <8650465+FarhanTejani@users.noreply.github.com>

mollyheamazon had a problem deploying to manual-approval March 16, 2026 18:11 — with GitHub Actions Error

Fix incorrect nodeSelector label for deep health check (#382) (#386)

b018e2d

Co-authored-by: Farhan Tejani <8650465+FarhanTejani@users.noreply.github.com>

mollyheamazon had a problem deploying to manual-approval March 17, 2026 18:16 — with GitHub Actions Error

mollyheamazon had a problem deploying to manual-approval March 17, 2026 18:21 — with GitHub Actions Error

remove non-EFA instance types from EFA device plugin nodeAffinity (#389)

4406d08

Co-authored-by: Ubuntu <ubuntu@ip-172-31-5-101.us-west-2.compute.internal>

mollyheamazon had a problem deploying to manual-approval March 18, 2026 17:27 — with GitHub Actions Error

PremiumSpider added 3 commits March 19, 2026 14:00

feat: Add g7e instance types to HyperPod helm chart

fc3f6cf

Add g7e instance types to values.yaml: - nvidia-device-plugin nodeAffinity: all 6 g7e sizes - aws-efa-k8s-device-plugin supportedInstanceLabels: 4 EFA-capable g7e sizes (8xlarge, 12xlarge, 24xlarge, 48xlarge)

feat: Add g7e instance types to Python constants

902e88f

- INSTANCE_RESOURCES: add all 6 g7e sizes with cpu/gpu/memory/efa specs - INSTANCE_TYPE_MIG_PROFILES: add g7e MIG profiles (1g.24gb, 2g.48gb, 4g.96gb) - HyperpodInstanceType enum: add 6 g7e entries

rsareddy0329 had a problem deploying to manual-approval March 19, 2026 21:04 — with GitHub Actions Error

feat: Add g7e instance types to health-monitoring-agent node affinity

62f58db

Add ml.g7e.{2,4,8,12,24,48}xlarge to the health-monitoring-agent DaemonSet node affinity allowlist so the agent runs on g7e instances. Part of g7e instance type onboarding for HyperPod.

rsareddy0329 requested a deployment to manual-approval March 19, 2026 21:18 — with GitHub Actions Waiting

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Merge latest changes from main to 'Documentation' branch #192

Merge latest changes from main to 'Documentation' branch #192
rsareddy0329 wants to merge 190 commits intodocumentationfrom
main

rsareddy0329 commented Aug 5, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

Conversation

rsareddy0329 commented Aug 5, 2025

PR Approval Steps

For Requester

For Reviewer

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants