Question 680
A near-real-time event pipeline accumulates backlog when the source gets busy. A production deployment uses Examine source arrival timestamps and downstream processing or serving delays to address: Streaming progress indicates no input backlog but high end-to-end event latency. Which signal should QA check?
Explanation
Correct Answer
Latency budget attributes the delay to the correct segment directly measures whether Examine source arrival timestamps and downstream processing or serving delays achieved the requirement “Streaming progress indicates no input backlog but high end-to-end event latency.” It checks the operating result rather than just a configured resource name.
Incorrect Answers
Retries do not duplicate outputs and batch duration meets the SLA would demonstrate the separate action Make `foreachBatch` sink operations idempotent and right-size write throughput, which addresses “A streaming sink repeatedly retries due to expensive non-idempotent external writes.” It does not verify the requirement “Streaming progress indicates no input backlog but high end-to-end event latency” following Examine source arrival timestamps and downstream processing or serving delays.
State rows stabilize while expected within-window matches remain would demonstrate the separate action Add appropriate watermarks and bounded join time ranges, which addresses “Stateful joins consume excessive memory because event histories never expire.” It does not verify the requirement “Streaming progress indicates no input backlog but high end-to-end event latency” following Examine source arrival timestamps and downstream processing or serving delays.
Processed rows per second eventually exceed incoming rate pertains to a different control (Reduce per-batch work or add supported compute capacity rather than merely shorten triggers) and a different need (Microbatch duration exceeds configured trigger interval for several minutes). It cannot establish that Examine source arrival timestamps and downstream processing or serving delays met the stated goal.