Question 200
An event processing service breaches its microbatch processing SLA during peaks. Following Inspect Structured Streaming query progress and state-operator metrics, the incident team needs evidence that Operators need per-microbatch rates and state details during latency incidents. Which observation supports closure?
Explanation
Correct Answer
The acceptance criterion for “Operators need per-microbatch rates and state details during latency incidents” is Progress records show duration, input rate and state size changes for the affected batches; this is the expected evidence after Inspect Structured Streaming query progress and state-operator metrics.
Incorrect Answers
State operator metrics show obsolete keys are eventually removed would demonstrate the separate action Apply event-time watermark and bounded state conditions appropriate to the query, which addresses “A stateful query's memory grows with historic keys that never expire.” It does not verify the requirement “Operators need per-microbatch rates and state details during latency incidents” following Inspect Structured Streaming query progress and state-operator metrics.
That observation is a valid indicator for “A streaming sink fails intermittently but source processing retries cause duplicates” when using Implement idempotent sink writes with a durable batch identifier. The scenario instead tests “Operators need per-microbatch rates and state details during latency incidents”; the relevant result is Progress records show duration, input rate and state size changes for the affected batches.
This signal belongs to the adjacent case “Batches take longer than the trigger interval and the stream accumulates a backlog,” whose remedy is Increase effective processing throughput or reduce per-batch work instead of assuming a faster trigger fixes it. The observed result for the present requirement is Progress records show duration, input rate and state size changes for the affected batches.