Question 520
The reliability team at Stonewell Payments is closing a corrective-action ticket for this ML failure: A private fraud model endpoint is accidentally reachable from the public internet even though all consumers are within a controlled network. What measured outcome provides the strongest check that this problem is resolved?
Explanation
Correct Answer
An external network probe fails while an authorized internal client can still invoke predictions. This controlled observation specifically validates the proposed remedy: Use a private serving access path and tighten network exposure to only approved client connectivity. It addresses the documented failure at Stonewell Payments: A private fraud model endpoint is accidentally reachable from the public internet even though all consumers are within a controlled network.
Incorrect Answers
The versioned artifact loads in a clean serving image and matches reference outputs on test inputs. This is evidence for a different corrective change: Export a supported portable model artifact and record framework, dependency, and serialization compatibility. That other change addresses: A PyTorch model package is saved with environment-dependent code objects and fails to load in the production runtime. It does not validate the specific Stonewell Payments remediation for: A private fraud model endpoint is accidentally reachable from the public internet even though all consumers are within a controlled network. The necessary check instead is: An external network probe fails while an authorized internal client can still invoke predictions.
A deliberately incomplete request raises the expected validation error and valid inputs remain unaffected. This is evidence for a different corrective change: Validate inference request schema and reject or explicitly handle missing critical features instead of silently defaulting. That other change addresses: An online API silently fills missing required feature fields with zero and returns confident but invalid predictions. It does not validate the specific Stonewell Payments remediation for: A private fraud model endpoint is accidentally reachable from the public internet even though all consumers are within a controlled network. The necessary check instead is: An external network probe fails while an authorized internal client can still invoke predictions.
The batch manifest reconciles input and output row counts, and authorized reviewers can retrieve the results after worker termination. This is evidence for a different corrective change: Persist batch inference results and provenance to a governed durable storage sink with an output manifest. That other change addresses: A batch-scored insurance dataset writes results to ephemeral worker storage, so outputs disappear before the compliance team can audit them. It does not validate the specific Stonewell Payments remediation for: A private fraud model endpoint is accidentally reachable from the public internet even though all consumers are within a controlled network. The necessary check instead is: An external network probe fails while an authorized internal client can still invoke predictions.