Assert ledger chunking

[cjen1-msft]

We currently are somewhat lax about two of the claims we make, that chunking is deterministic, which is often unchecked and unchecked in LTS; and that a chunk's end has the relevant tx flag set such that it is recreated on followers correctly.

This PR adds those checks, in draft mode for now until everything is fixed.

[Copilot]

Pull request overview

This pull request adds assertions to verify ledger chunking determinism and ensures that chunk end transactions have the correct flags set. The PR introduces a new skip_verify_chunking parameter to allow selective bypassing of these checks in tests where ledger files are intentionally modified or when working with older CCF versions that may not have complete chunking flags.

Changes:

• Added check_ledger_files_chunk_flags method to verify chunking flags in ledger files
• Introduced skip_verify_chunking parameter throughout the network infrastructure
• Added CCFVersion class for more robust version comparisons
• Updated compatibility tests to skip chunk verification for pre-7.0.0 versions

Reviewed changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 6 comments.

Show a summary per file

File	Description
tests/infra/network.py	Added chunking verification logic and skip_verify_chunking parameter support
tests/infra/node.py	Added CCFVersion class for version comparisons and updated version_after logic
tests/infra/remote.py	Updated ledger_paths to filter out non-existent paths
tests/lts_compatibility.py	Added version-specific logic to skip chunk verification for older versions
tests/recovery.py	Enabled skip_verify_chunking for recovery tests using pre-existing ledger files
tests/e2e_operations.py	Enabled skip_verify_chunking for tests that intentionally modify ledger files

[Copilot]

Pull request overview

Copilot reviewed 6 out of 6 changed files in this pull request and generated 4 comments.