(WIP) feat(synapse-core): add sp-fetch module for SP-to-SP piece transfers #544
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Deploying with
|
| Status | Name | Latest Commit | Updated (UTC) |
|---|---|---|---|
| ❌ Deployment failed View logs |
synapse-dev | 3c5cdb9 | Jan 20 2026, 09:09 AM |
- Added `datasets-create` command for creating datasets. - Introduced `datasets-terminate` command for terminating datasets. - Implemented `pieces-upload` command for uploading files to datasets. - Updated `datasets` command to include block number information. - Added `debug` flag to global flags for enabling debug mode. - Introduced utility functions for handling cancellation and generating hash links. - Removed deprecated `dataset-terminate` command. - Updated package dependencies to include new libraries.
- Added `asChain` function to convert viem chains to Filecoin chains. - Introduced `DownloadPieceError` for improved error handling during piece downloads. - Updated `createDataSetAndAddPieces` to streamline dataset creation and piece addition. - Refactored `signAddPieces` and `signCreateDataSet` to support optional metadata. - Added utility functions for handling streams and async iterables. - Updated package dependencies, including adding `chai` and `@types/chai` for testing. - Introduced new tests for piece utilities and random functions to ensure reliability.
- Updated `pollForDataSetCreationStatus` to `waitForDataSetCreationStatus` for better readability. - Changed `pollForAddPiecesStatus` to `waitForAddPiecesStatus` to maintain consistency in naming conventions.
- Replaced `Piece.MAX_UPLOAD_SIZE` with `SIZE_CONSTANTS.MAX_UPLOAD_SIZE` for consistency. - Updated function calls from `pollForAddPiecesStatus` to `waitForAddPiecesStatus` in `StorageContext`. - Changed `pollForDataSetCreationStatus` to `waitForDataSetCreationStatus` for clarity. - Removed outdated test files for `piece` and `rand` utilities to streamline the codebase.
- Added `AtLeastOnePieceRequiredError` for better error management when no pieces are provided. - Updated `CreateDataSetOptions` and `AddPiecesOptions` to include new optional fields: `clientDataSetId` and `recordKeeper`. - Refactored `createDataSet` and `addPieces` functions to utilize the new options and improve signature handling. - Renamed `pollForDeletePieceStatus` to `waitForDeletePieceStatus` for consistency with naming conventions. - Enhanced tests for typed data to cover new functionalities and ensure robustness.
- Removed the `PDPAuthHelper` class to simplify authentication processes. - Updated `PDPServer` to directly utilize the `Client` from `viem` for improved integration. - Refactored `StorageContext` to eliminate dependencies on the removed `PDPAuthHelper`, enhancing clarity and maintainability. - Adjusted metadata handling to use `MetadataObject` for consistency across the codebase. - Removed outdated tests related to `PDPAuthHelper` and updated existing tests to reflect the new structure.
- Updated `pollForDeletePieceStatus` to `waitForDeletePieceStatus` to align with naming conventions established in previous commits.
rvagg
force-pushed
the
rvagg/sp-sp-fetch
branch
from
c2011f6 to
7af205b
Compare
Collaborator
Author
|
Added a temporary utils/example-sp-fetch-e2e.js testing file to test the sp-sp fetch flow. It stores pieces with one SP, confirms they are parked, then asks the second SP to fetch from the first and confirms they are parked. It's working currently on devnet using FilOzone/foc-devnet#34 👌. |
rvagg
force-pushed
the
rvagg/sp-sp-fetch
branch
from
ac3552a to
3c5cdb9
Compare
|
Review the following changes in direct dependencies. Learn more about Socket for GitHub.
|
hugomrdias
force-pushed
the
hugomrdias/move-tests
branch
2 times, most recently
from
0a20df0 to
a231d32
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Ref: filecoin-project/curio#864
Part of #494