WIP: perf(waterdata): Optional parallel chunk processing in multi_value_chunked (draft)#278

Closed

thodson-usgs wants to merge 21 commits into

DOI-USGS:mainfrom

thodson-usgs:chunker-async-experiment

Commits on May 14, 2026

Use GET with comma-separated values for multi-value waterdata queries

thodson-usgs
and
claude
committed
Polish PR 233: module-level constant, fix misleading comment, add 3 unit tests
thodson-usgs
committed

Commits on May 15, 2026

Add multi-value GET-parameter chunker for waterdata OGC API

thodson-usgs
and
claude
committed
Probe with longest OR-clause, not shortest

thodson-usgs
and
claude
committed
Document the chained-query use case in chunker, get_daily, NEWS

thodson-usgs
and
claude
committed
Tidy chunking.py: extract _chunk_bytes, name quota sentinel, use math.prod

thodson-usgs
and
claude
committed
Merge remote-tracking branch 'upstream/main' into multivalue-chunker
thodson-usgs
committed
Probe URL + body bytes (not just URL) to chunk POST-routed services

thodson-usgs
and
claude
committed
Tighten _request_bytes: type the param and drop redundant str() wrap

thodson-usgs
and
claude
committed
Return latest paginated/chunked response so QuotaExhausted floor sees current quota

thodson-usgs
and
claude
committed
Probe filter URL with encoding-ratio-weighted size, not just raw length

thodson-usgs
and
claude
committed
Address PR review: lazy max_chunks default, early-exit cap check, doc fixes

thodson-usgs
and
claude
committed
Address PR review round 2: URL-encoded chunk sizing, doc fixes

thodson-usgs
and
claude
committed
Preserve original-query URL in md.url; carry latest headers + cumulative elapsed

thodson-usgs
and
claude
committed

Commits on May 16, 2026

Commits on May 17, 2026

Merge branch 'main' into chunker-async-experiment
thodson-usgs
authored