Question 610
A team runs thousands of adversarial evaluation prompts daily. The customer-facing assistant shares a tight tokens-per-minute quota with its existing deployment. What deployment setup reduces production interference?
Explanation
Correct Answer
Isolating evaluation traffic avoids competing for the same deployment quota used by customers.
Incorrect Answers
The evaluation load would continue to consume capacity needed for interactive requests.
Request labels do not isolate token throughput or protect customer latency.
Eliminating evaluation undermines the stated testing need instead of separating its workload.