Skip to content

perf(pm): cap install tarball downloads#2987

Draft
elrrrrrrr wants to merge 1 commit into
exp/pm-install-clone-extracted-indexfrom
exp/pm-install-tarball-download-limit-128
Draft

perf(pm): cap install tarball downloads#2987
elrrrrrrr wants to merge 1 commit into
exp/pm-install-clone-extracted-indexfrom
exp/pm-install-tarball-download-limit-128

Conversation

@elrrrrrrr
Copy link
Copy Markdown
Contributor

Summary

Stacked on #2986. This AB experiment caps install tarball download concurrency independently from manifest concurrency.

  • keep the resolver/manifest concurrency setting unchanged
  • cap install tarball downloads at 128
  • leave extract and clone worker limits unchanged

Hypothesis

The install scheduler currently reuses manifest concurrency for tarball downloads. In p3, tarball downloads are followed by extract-to-cache and clone/materialize work, so excessive download fan-out can increase IO pressure and scheduler churn without improving end-to-end wall time. A lower tarball cap may keep the pipeline saturated while reducing contention.

Validation

  • cargo fmt
  • CARGO_NET_OFFLINE=true cargo clippy -p utoo-pm --all-targets -- -D warnings --no-deps
  • CARGO_NET_OFFLINE=true cargo test -p utoo-pm service::install_scheduler -- --nocapture

@elrrrrrrr elrrrrrrr added A-Pkg Manager Area: Package Manager benchmark Run pm-bench on PR labels May 18, 2026
Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces a dedicated download_concurrency_limit function in install_scheduler.rs to manage download limits, replacing an inline calculation. The new function ensures the limit is clamped between 1 and 128. I have no feedback to provide as there were no review comments.

@github-actions
Copy link
Copy Markdown

📊 pm-bench-phases · f74d4eb · linux (ubuntu-latest)

Workflow run — ant-design

PMs: utoo (this branch) · utoo-npm (latest published) · bun (latest)

npmjs.org

npmmirror.com: no output captured.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-Pkg Manager Area: Package Manager benchmark Run pm-bench on PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant