Question 1
A support app runs on constrained handheld devices and performs short, routine classification requests. The quality benchmark is met by a small model, and the product owner prioritizes latency and low inference cost. Which model-selection decision best fits?
Explanation
Correct Answer
A small model is the defensible cost/latency choice when representative task evaluation shows adequate accuracy.
Incorrect Answers
A large reasoning model can add latency and spend where the tested small model already meets the task acceptance threshold.
Embeddings represent content numerically for similarity; they are not a substitute for the classification response.
Image generation serves visual creation workloads, not a text categorization endpoint with a low-latency goal.