Skip to content

Conversation

@CodeReaper
Copy link
Collaborator

This pull request makes it so the configuration is split up into chunks and each chunk is processed in its own job. The potential purposes are:

  • avoiding disk filling up
  • faster runs

The downsides are:

  • unable to reliably reset specific contents with a workflow dispatch
  • additional compute time is used

@CodeReaper
Copy link
Collaborator Author

This approach seems to have a fatal flaw. Some configurations will produce files with the same names. This seems to happen (currently) for the files in the groups gateway.networking.k8s.io and mysql.presslabs.org. Looks like we need to stick to the current one-by-one approach.

@CodeReaper CodeReaper closed this Jan 18, 2026
@CodeReaper CodeReaper deleted the chunked-processing branch January 18, 2026 15:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants