Skip to content

Add local H5 worker bootstrap artifacts#928

Merged
anth-volk merged 5 commits intomainfrom
codex/h5-migration-pr4-worker-bootstrap
May 8, 2026
Merged

Add local H5 worker bootstrap artifacts#928
anth-volk merged 5 commits intomainfrom
codex/h5-migration-pr4-worker-bootstrap

Conversation

@anth-volk
Copy link
Copy Markdown
Collaborator

@anth-volk anth-volk commented May 8, 2026

Fixes #927

Summary

  • Add run-scoped worker bootstrap bundle/schema support for local H5 publication.
  • Persist regional and national bootstrap manifests plus entity graph NPZ artifacts on the pipeline volume.
  • Keep current worker runtime paths unchanged until the worker-session follow-up.

Tests

  • make lint
  • uv run --no-sync pytest tests/unit/build_outputs/test_bootstrap.py -q
  • uv run --no-sync pytest tests/unit/test_modal_local_area.py -q
  • uv run --no-sync pytest tests/unit/build_outputs/test_source_dataset.py tests/unit/build_outputs/test_weights.py tests/unit/build_outputs/test_fingerprinting.py tests/unit/build_outputs/test_geography_loader.py -q
  • uv run --no-sync ruff check policyengine_us_data/build_outputs/bootstrap.py tests/unit/build_outputs/test_bootstrap.py tests/support/build_outputs/bootstrap.py modal_app/local_area.py tests/unit/test_modal_local_area.py tests/support/modal_local_area.py
  • uv run --no-sync ruff format --check policyengine_us_data/build_outputs/bootstrap.py tests/unit/build_outputs/test_bootstrap.py tests/support/build_outputs/bootstrap.py modal_app/local_area.py tests/unit/test_modal_local_area.py tests/support/modal_local_area.py
  • uv run --no-sync --with pyyaml python scripts/run_quality_guards.py
  • uv run --no-sync --with pyyaml --with pytest pytest tests/unit/test_pipeline_docs_extractor.py tests/unit/test_pipeline_doc_guards.py -q

@anth-volk anth-volk force-pushed the codex/h5-migration-pr4-worker-bootstrap branch from 1ef196e to 9d123d5 Compare May 8, 2026 14:37
@anth-volk anth-volk marked this pull request as ready for review May 8, 2026 18:14
@anth-volk anth-volk merged commit 14c1b37 into main May 8, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add local H5 worker bootstrap artifacts

1 participant