start fails with Failed to pre-seal sectors for miner #43
Description
macOS 15.5
On commit 4b61cbee9df192dea9c00806c7c55fe696018367
$ cargo run -- start --parallel
warning: foc-devnet@1.0.0-rc.1: Created MockUSDFC.tar.gz archive
Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.21s
Running `target/debug/foc-devnet start --parallel`
INFO src/poison.rs:80: Poison file created at: /Users/will/.foc-devnet/state/.poison
INFO src/commands/start/mod.rs:44: Ensuring clean state by stopping any existing cluster...
INFO src/commands/stop.rs:28: Stopping local cluster...
WARN src/commands/stop.rs:37: Warning: No active run ID found.
INFO src/commands/stop.rs:38: Attempting to stop all foc-* containers...
INFO src/commands/stop.rs:88: Stopping Curio...
INFO src/commands/stop.rs:93: ℹ Container 'foc-c-curio' does not exist
INFO src/commands/stop.rs:88: Stopping YugabyteDB...
INFO src/commands/stop.rs:93: ℹ Container 'foc-c-yugabyte' does not exist
INFO src/commands/stop.rs:88: Stopping Lotus-Miner...
INFO src/commands/stop.rs:93: ℹ Container 'foc-c-lotus-miner' does not exist
INFO src/commands/stop.rs:88: Stopping Lotus...
INFO src/commands/stop.rs:93: ℹ Container 'foc-c-lotus' does not exist
INFO src/commands/stop.rs:60: ℹ Portainer will remain running for persistent access
INFO src/commands/stop.rs:160: Force killing any remaining foc* containers...
INFO src/commands/stop.rs:171: No remaining foc* containers found
INFO src/commands/stop.rs:192: Force removing any remaining foc* networks...
INFO src/commands/stop.rs:211: No remaining foc-* networks found
INFO src/commands/stop.rs:79: Local cluster stopped successfully!
INFO src/commands/start/mod.rs:90: Stopping any running containers from previous runs...
INFO src/commands/start/mod.rs:106: All running containers stopped.
INFO src/commands/start/mod.rs:422: Starting local cluster...
INFO src/commands/start/mod.rs:423: Run ID: 26jan21-1600_IckyMimi
INFO src/commands/start/mod.rs:424: Volumes directory: /Users/will/.foc-devnet/docker/volumes/run-specific/26jan21-1600_IckyMimi
INFO src/commands/start/mod.rs:425: Run directory: /Users/will/.foc-devnet/run/26jan21-1600_IckyMimi
INFO src/utils/system_info.rs:10: === System Information ===
INFO src/utils/system_info.rs:14: CPU: Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz
INFO src/utils/system_info.rs:19: Physical CPU cores: 8
INFO src/utils/system_info.rs:23: Logical CPU threads: 16
INFO src/utils/system_info.rs:27: Total RAM: 64.00 GB
INFO src/utils/system_info.rs:30: Available RAM: 5.31 GB
INFO src/utils/system_info.rs:34: ==========================
INFO src/commands/start/mod.rs:197: PDP Service Provider Configuration:
INFO src/commands/start/mod.rs:198: • Active PDP SPs: 1
INFO src/commands/start/mod.rs:199: • Approved PDP SPs: 1
INFO src/docker/portainer.rs:57: Starting Portainer...
INFO src/docker/portainer.rs:58: Container: foc-26jan21-1600_IckyMimi-portainer
INFO src/docker/portainer.rs:83: Pulling Portainer image...
INFO src/docker/portainer.rs:87: Starting container...
INFO src/docker/portainer.rs:106: ℹ Portainer started
INFO src/docker/portainer.rs:107: Access at: http://localhost:5700
INFO src/docker/network.rs:105: Creating Docker networks...
INFO src/docker/network.rs:57: Creating network 'foc_26jan21-1600_IckyMimi_lot-net'...
INFO src/docker/network.rs:65: Network created
INFO src/docker/network.rs:57: Creating network 'foc_26jan21-1600_IckyMimi_lot-m-net'...
INFO src/docker/network.rs:65: Network created
INFO src/docker/network.rs:57: Creating network 'foc_26jan21-1600_IckyMimi_cur-m-net-1'...
INFO src/docker/network.rs:65: Network created
INFO src/docker/network.rs:118: All networks created successfully
INFO src/commands/start/genesis/mod.rs:34: Checking genesis prerequisites...
INFO src/commands/start/genesis/proof_parameters.rs:39: Proof parameters directory does not exist: /Users/will/.foc-devnet/docker/volumes/cache/filecoin-proof-parameters
INFO src/commands/start/genesis/proof_parameters.rs:44: ⬇ Downloading proof parameters (this may take a while)...
WARN src/utils/retry.rs:92: Proof parameters download failed (attempt 1/6), retrying in 4 seconds...
WARN src/utils/retry.rs:92: Proof parameters download failed (attempt 2/6), retrying in 4 seconds...
WARN src/utils/retry.rs:92: Proof parameters download failed (attempt 3/6), retrying in 4 seconds...
WARN src/utils/retry.rs:92: Proof parameters download failed (attempt 4/6), retrying in 4 seconds...
WARN src/utils/retry.rs:92: Proof parameters download failed (attempt 5/6), retrying in 4 seconds...
WARN src/commands/start/genesis/proof_parameters.rs:55: Primary download method (lotus fetch-params) failed: Failed to download proof parameters:
WARN src/commands/start/genesis/proof_parameters.rs:56: Falling back to S3 tarball download...
INFO src/commands/start/genesis/proof_parameters.rs:212: Downloading proof parameters tarball from S3...
INFO src/commands/start/genesis/proof_parameters.rs:254: Extracting proof parameters tarball...
INFO src/commands/start/genesis/proof_parameters.rs:287: Proof parameters extracted successfully
INFO src/commands/start/genesis/proof_parameters.rs:63: ✓ Proof parameters downloaded successfully via S3 fallback
INFO src/commands/start/genesis/keys.rs:106: BLS BLS_SIGNER key 1 created successfully
INFO src/commands/start/genesis/keys.rs:106: BLS BLS_SIGNER key 2 created successfully
INFO src/commands/start/genesis/keys.rs:106: BLS GLOBAL_FIL_FAUCET key 1 created successfully
INFO src/commands/start/genesis/sectors.rs:60: ⚙ Pre-sealing 2 sectors (size: 2KiB) for 2 miners...
INFO src/commands/start/genesis/sectors.rs:104: ⚙ Pre-sealing sectors for miner t01000...
INFO src/commands/start/mod.rs:474: ═══════════════════════════════════════════════════════════
INFO src/commands/start/mod.rs:475: Running post-start teardown for run ID: 26jan21-1600_IckyMimi
INFO src/commands/start/mod.rs:476: ═══════════════════════════════════════════════════════════
INFO src/commands/start/mod.rs:479: [1/3] Persisting logs for all foc* image containers...
INFO src/docker/logs.rs:55: Persisting logs for 7 foc* containers to /Users/will/.foc-devnet/run/26jan21-1600_IckyMimi/logs
INFO src/docker/logs.rs:66: ✓ Captured logs for container 'foc-26jan21-1600_IckyMimi-genesis-preseal-t01000'
INFO src/docker/logs.rs:66: ✓ Captured logs for container 'foc-proof-params-fetch-1769032853'
INFO src/docker/logs.rs:66: ✓ Captured logs for container 'foc-proof-params-fetch-1769032849'
INFO src/docker/logs.rs:66: ✓ Captured logs for container 'foc-proof-params-fetch-1769032845'
INFO src/docker/logs.rs:66: ✓ Captured logs for container 'foc-proof-params-fetch-1769032840'
INFO src/docker/logs.rs:66: ✓ Captured logs for container 'foc-proof-params-fetch-1769032836'
INFO src/docker/logs.rs:66: ✓ Captured logs for container 'foc-proof-params-fetch-1769032832'
INFO src/docker/logs.rs:76: ✓ All container logs persisted
INFO src/commands/start/mod.rs:483: [2/3] Removing dead foc* containers...
INFO src/docker/logs.rs:97: ✓ Removed dead container: foc-26jan21-1600_IckyMimi-genesis-preseal-t01000 (status: Exited (127) Less than a second ago)
INFO src/docker/logs.rs:97: ✓ Removed dead container: foc-proof-params-fetch-1769032853 (status: Exited (127) About a minute ago)
INFO src/docker/logs.rs:97: ✓ Removed dead container: foc-proof-params-fetch-1769032849 (status: Exited (127) About a minute ago)
INFO src/docker/logs.rs:97: ✓ Removed dead container: foc-proof-params-fetch-1769032845 (status: Exited (127) About a minute ago)
INFO src/docker/logs.rs:97: ✓ Removed dead container: foc-proof-params-fetch-1769032840 (status: Exited (127) About a minute ago)
INFO src/docker/logs.rs:97: ✓ Removed dead container: foc-proof-params-fetch-1769032836 (status: Exited (127) About a minute ago)
INFO src/docker/logs.rs:97: ✓ Removed dead container: foc-proof-params-fetch-1769032832 (status: Exited (127) About a minute ago)
INFO src/docker/logs.rs:109: ✓ Removed 7 dead foc* containers
INFO src/commands/start/mod.rs:487: [3/3] Writing post-start status snapshot...
INFO src/docker/logs.rs:119: Writing post-start status to: /Users/will/.foc-devnet/run/26jan21-1600_IckyMimi/post_start_status.log
INFO src/docker/logs.rs:132: ✓ Post-start status logged
INFO src/commands/start/mod.rs:490: ═══════════════════════════════════════════════════════════
INFO src/commands/start/mod.rs:491: Post-start teardown completed successfully
INFO src/commands/start/mod.rs:492: ═══════════════════════════════════════════════════════════
Error: "Failed to pre-seal sectors for miner t01000: /bin/bash: line 1: /opt/bin/lotus-seed: No such file or directory\n"