Question 270
An analytics platform ingests operational records with mixed nested and tabular schemas. After configuring Use a supported binaryFile ingestion format with content metadata, the engineer must validate: A dataset contains binary attachments that should be tracked as files, not decoded as lines of text. What evidence is decisive?
Explanation
Correct Answer
The acceptance criterion for “A dataset contains binary attachments that should be tracked as files, not decoded as lines of text” is Each attachment is represented as a binary record with path and length fields; this is the expected evidence after Use a supported binaryFile ingestion format with content metadata.
Incorrect Answers
The parsed DataFrame contains correct columns despite embedded commas would demonstrate the separate action Set supported CSV parser header, quote and escape options, which addresses “A CSV feed includes quoted delimiters and a header line.” It does not verify the requirement “A dataset contains binary attachments that should be tracked as files, not decoded as lines of text” following Use a supported binaryFile ingestion format with content metadata.
The physical scan reads only selected required columns where possible would demonstrate the separate action Read it as Parquet or another supported columnar format, which addresses “A large columnar export should support efficient Spark column pruning.” It does not verify the requirement “A dataset contains binary attachments that should be tracked as files, not decoded as lines of text” following Use a supported binaryFile ingestion format with content metadata.
That observation is a valid indicator for “Semi-structured events include variable nested objects and unknown fields” when using Read JSON with schema evolution or rescued data handling. The scenario instead tests “A dataset contains binary attachments that should be tracked as files, not decoded as lines of text”; the relevant result is Each attachment is represented as a binary record with path and length fields.