Question 230
A service processes thousands of independent invoices. A developer suggests placing several customers’ full invoices inside one shared conversation to save overhead. What is the main design concern?
Explanation
Correct Answer
Batching need not imply a shared reasoning context. Isolation prevents customer data from influencing unrelated outputs.
Incorrect Answers
Context is cumulative and can contaminate later responses. Independence must be maintained explicitly.
Without IDs, results can be misattributed. Per-request reconciliation is essential.
Completeness needs explicit per-item status. Silent omission is not an optimization.