Skip to content

[client] Refactor RemoteLogDownloader to use chunked file append instead of downloading whole log file#3263

Open
swuferhong wants to merge 1 commit intoapache:mainfrom
swuferhong:remote-log-download-slice
Open

[client] Refactor RemoteLogDownloader to use chunked file append instead of downloading whole log file#3263
swuferhong wants to merge 1 commit intoapache:mainfrom
swuferhong:remote-log-download-slice

Conversation

@swuferhong
Copy link
Copy Markdown
Contributor

Purpose

Linked issue: close #3262

Refactor RemoteLogDownloader from whole-file download to chunked streaming I/O. This significantly reduces time-to-first-byte latency, saves bandwidth when consumers stop mid-segment, and adds fine-grained flow control at the chunk level.

Brief change log

Tests

API and Format

Documentation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[client] Refactor RemoteLogDownloader to use chunked streaming instead of downloading whole segment file

1 participant