Skip to content

Add dataflow pubsub template docs#6295

Open
BentsiLeviav wants to merge 2 commits into
mainfrom
add-dataflow-pubsub-template-docs
Open

Add dataflow pubsub template docs#6295
BentsiLeviav wants to merge 2 commits into
mainfrom
add-dataflow-pubsub-template-docs

Conversation

@BentsiLeviav
Copy link
Copy Markdown
Contributor

@BentsiLeviav BentsiLeviav commented May 27, 2026

Summary

Add documentation to our new Dataflow template from PubSub to ClickHouse


Note

Low Risk
Documentation-only changes with no runtime or security impact.

Overview
Documents the Pub/Sub to ClickHouse Google Dataflow streaming template and wires it into the docs site navigation.

Adds a new guide (pubsub-to-clickhouse.md) covering JSON subscription ingestion, case-sensitive column mapping, batching/windowing (windowSeconds / batchRowCount), required dead-letter destinations (ClickHouse table and/or Pub/Sub topic), console setup, custom metrics, and troubleshooting. Updates the Dataflow overview and templates index to list Pub/Sub as a shipped template (replacing the prior “coming soon” entry) and expands the BigQuery template source code section to point at both Google’s upstream repo and ClickHouse’s fork.

Reviewed by Cursor Bugbot for commit 9aa5b51. Bugbot is set up for automated code reviews on this repo. Configure here.

BentsiLeviav and others added 2 commits May 27, 2026 11:40
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@BentsiLeviav BentsiLeviav requested review from a team as code owners May 27, 2026 18:43
@vercel
Copy link
Copy Markdown

vercel Bot commented May 27, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
clickhouse-docs Error Error Comment May 27, 2026 6:54pm
4 Skipped Deployments
Project Deployment Actions Updated (UTC)
clickhouse-docs-jp Ignored Ignored May 27, 2026 6:54pm
clickhouse-docs-ko Ignored Ignored May 27, 2026 6:54pm
clickhouse-docs-ru Ignored Ignored May 27, 2026 6:54pm
clickhouse-docs-zh Ignored Ignored May 27, 2026 6:54pm

Request Review

@mintlify
Copy link
Copy Markdown

mintlify Bot commented May 27, 2026

Docs PR opened: ClickHouse/mintlify-docs-dev#87

Added documentation for the new Pub/Sub to ClickHouse Google Dataflow template and linked it from related pages.

Once this PR is merged, we'll do a second pass to capture any additional changes and update the docs PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants