Question 80
A fraud pipeline processes device events whose arrival times differ from their event timestamps. An auditor must prove the outcome of Inspect streaming progress and state operator late-event metrics alongside watermark settings for this requirement: Operators need to diagnose why late events were discarded from a windowed query. Which test result is best?
Explanation
Correct Answer
The acceptance criterion for “Operators need to diagnose why late events were discarded from a windowed query” is The observed drop metrics correlate with event timestamps older than the watermark; this is the expected evidence after Inspect streaming progress and state operator late-event metrics alongside watermark settings.
Incorrect Answers
This signal belongs to the adjacent case “A batch query has no streaming state and the engineer mistakenly adds a watermark for performance,” whose remedy is Use ordinary batch aggregation instead of relying on streaming watermark state pruning. The observed result for the present requirement is The observed drop metrics correlate with event timestamps older than the watermark.
An event arriving within the watermark horizon updates the appropriate open window would demonstrate the separate action Define a two-hour event-time watermark before stateful window aggregation, which addresses “Late events within a two-hour tolerance must update event-time window aggregates.” It does not verify the requirement “Operators need to diagnose why late events were discarded from a windowed query” following Inspect streaming progress and state operator late-event metrics alongside watermark settings.
Late-data behavior and join state size match the bounded join window would demonstrate the separate action Use a supported stream-stream join with event-time conditions and watermarks, which addresses “A stateful stream joins two event streams on matching keys and bounded time difference.” It does not verify the requirement “Operators need to diagnose why late events were discarded from a windowed query” following Inspect streaming progress and state operator late-event metrics alongside watermark settings.