Add HF SGLang 0.5.12

[ehcalabres]

Purpose

This PR upgrades the HF SGLang DLC from version 0.5.8 to 0.5.12.

Test Plan

Test Result

---

Toggle if you are merging into master Branch

By default, docker image builds and tests are disabled. Two ways to run builds and tests:

1. Using dlc_developer_config.toml
2. Using this PR description (currently only supported for PyTorch, TensorFlow, vllm, and base images)

How to use the helper utility for updating dlc_developer_config.toml

Assuming your remote is called origin (you can find out more with git remote -v)...

• Run default builds and tests for a particular buildspec - also commits and pushes changes to remote; Example:

python src/prepare_dlc_dev_environment.py -b </path/to/buildspec.yml> -cp origin

• Enable specific tests for a buildspec or set of buildspecs - also commits and pushes changes to remote; Example:

python src/prepare_dlc_dev_environment.py -b </path/to/buildspec.yml> -t sanity_tests -cp origin

• Restore TOML file when ready to merge

python src/prepare_dlc_dev_environment.py -rcp origin

NOTE: If you are creating a PR for a new framework version, please ensure success of the local, standard, rc, and efa sagemaker tests by updating the dlc_developer_config.toml file:

• sagemaker_remote_tests = true
• sagemaker_efa_tests = true
• sagemaker_rc_tests = true
• sagemaker_local_tests = true

How to use PR description

Use the code block below to uncomment commands and run the PR CodeBuild jobs. There are two commands available:

• # /buildspec <buildspec_path>
  • e.g.: # /buildspec pytorch/training/buildspec.yml
  • If this line is commented out, dlc_developer_config.toml will be used.
• # /tests <test_list>
  • e.g.: # /tests sanity security ec2
  • If this line is commented out, it will run the default set of tests (same as the defaults in dlc_developer_config.toml): sanity, security, ec2, ecs, eks, sagemaker, sagemaker-local.

# /buildspec <buildspec_path>
# /tests <test_list>

Toggle if you are merging into main Branch

PR Checklist

• [] I ran pre-commit run --all-files locally before creating this PR. (Read DEVELOPMENT.md for details).

[Yadan-Wei]

The short version here should be 0.5.8 since you rename the Dockerfile folder name, otherwise it cannot find the file.

[ehcalabres]

Oh thanks! I'll change it

[Yadan-Wei]

Are you planning to add telemetry for HuggingFace image? This script is used for dlc telemetry data tracking. I believe HuggingFace has different contract for revenue tracking, so this may be not necessary.
And some information just FYI, if we need to make it work, we need to copy it to the Dockerfile and invoke in the entrypoint
https://github.com/aws/deep-learning-containers/blob/master/sglang/x86_64/gpu/Dockerfile#L29-L36
https://github.com/aws/deep-learning-containers/blob/master/sglang/build_artifacts/sagemaker_entrypoint.sh#L4
And this is the framework it accepts https://github.com/aws/deep-learning-containers/blob/master/src/deep_learning_container.py#L242

[ehcalabres]

Hmmm honestly I think we're not using it, but that file gets generated when building the image and sometimes it get's added to the tracking (by mistake). I think I can just remove it