feat: add EOL package archival and pruning tooling#191
Open
abtreece wants to merge 2 commits intofullstaq-ruby:mainfrom
Open
feat: add EOL package archival and pruning tooling#191abtreece wants to merge 2 commits intofullstaq-ruby:mainfrom
abtreece wants to merge 2 commits intofullstaq-ruby:mainfrom
Conversation
4 tasks
abtreece
force-pushed
the
feat/eol-archive-repos
branch
from
dbb17ef to
7786b8f
Compare
Add incremental APT/YUM archive migration scripts that move EOL distro packages to archive buckets, and pruning scripts that remove EOL Ruby version packages from still-supported distro repos. Scripts auto-detect EOL content by comparing repo state against config.yml and support --dry-run. Migration scripts are incremental — safe to re-run when future distros reach EOL. Includes dev-handbook runbook and updated architecture docs.
abtreece
force-pushed
the
feat/eol-archive-repos
branch
from
7786b8f to
e523f8a
Compare
- Wire up GCloudStorageLock in all four archive scripts so migrations and prunes mutually exclude with the publish workflow's pointer updates. The lock library was already imported but never used. - Wrap all four scripts in begin/ensure cleanup so a failure mid-run no longer leaves the imported GPG signing key on disk. - migrate-apt-to-archive: stop swallowing pool-merge errors via '|| true'. Real I/O/permission failures must surface; only no-clobber skips were ever benign. - migrate-apt-to-archive / migrate-yum-to-archive: comments claimed EOL detection compared against environments/, but the code compares against config.yml. Align the comments with the code. - archiving-eol-packages.md: APT explicit-distros example listed centos-8, which is RPM-only and would fail in the APT script. Replace with debian-10,ubuntu-20.04.
abtreece
force-pushed
the
feat/eol-archive-repos
branch
from
6c19add to
68b8e37
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Context
Addresses #190 — CI disk space exhaustion caused by the ever-growing Aptly
state.tar.zst.Two-axis cleanup:
Migration scripts are incremental — safe to re-run when future distros reach EOL. Each run fetches the existing archive state, merges new content, and uploads as version N+1.
Companion PR: fullstaq-ruby/infra#47 (GCS buckets, DNS, Caddy config)
Implementation plan:
context/plans/EOL-ARCHIVE-MIGRATION.md(Tasks 4-9)New scripts
archive/migrate-apt-to-archive.rbarchive/migrate-yum-to-archive.rbarchive/prune-apt-packages.rbarchive/prune-yum-packages.rbAll scripts support
--dry-runand auto-detect EOL content by comparing repo state againstconfig.yml.Test plan
eclint checkpasses--dry-runcorrectly identifies EOL distros/packagesfullstaq-ruby-X.Y*packages for non-active minor versions are removeddev-handbook/archiving-eol-packages.mdmatch actual script behavior