designed_to_flowwindows-and-late-data.mdx
● 28 lessons · freealexkazos.com ↗

Windows & late data

How do you count a stream that never ends, when some events show up late?

⏱ 10 min☰ 10 steps▶ playground
scene.svg
Event queuevehicle-eventsStream jobreads eventsCountsone row per windowevent time · sensor S-12arrived08:0008:0508:1008:15when it happened ≠ when it arrived
Event queueStream jobevent time · sensor S-12arrived08:0008:0508:1008:15happened ≠ arrived
  • counted
  • late
  • dropped
  • window
  • watermark