Skip to content

Optimize prewarming for container-style slimmable models#267

Merged
sdatkinson merged 1 commit into
mainfrom
266-prewarm
May 15, 2026
Merged

Optimize prewarming for container-style slimmable models#267
sdatkinson merged 1 commit into
mainfrom
266-prewarm

Conversation

@sdatkinson
Copy link
Copy Markdown
Owner

Summary

  • Update SlimmableContainer so Reset() and prewarm() only operate on the currently active submodel.
  • Reset a newly selected submodel before publishing it as the live model.
  • Add focused tests covering active-only reset/prewarm behavior and switch ordering.

Testing

  • cmake --build build_inline --target run_tests -j 8
  • ./build_inline/tools/run_tests

@sdatkinson sdatkinson merged commit d65cf21 into main May 15, 2026
4 checks passed
@sdatkinson sdatkinson deleted the 266-prewarm branch May 15, 2026 20:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant