Skip to content

[FAQ] Flink tumbling window job runs but the PostgreSQL table is empty #246

@AsherJD-io

Description

@AsherJD-io

Course

data-engineering-zoomcamp

Question

Why does the tumbling window job run successfully but the PostgreSQL sink table returns no rows when queried?

Answer

Flink streaming jobs emit results only after the window closes. With event-time processing and watermarks, the window will not close until the watermark passes the window end. If you query the PostgreSQL table too early, it may still be empty even though the job is running correctly. Let the job run for a short time so the watermark advances and the window results are written to the sink table.

Checklist

  • I have searched existing FAQs and this question is not already answered
  • The answer provides accurate, helpful information
  • I have included any relevant code examples or links

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions