Exam SnowPro Core topic 1 question 173 discussion

D https://docs.snowflake.com/en/user-guide/semistructured-considerations#data-size-limitations Semi-structured Data Size Limitations A VARIANT can have a maximum size of up to 16 MB of uncompressed data. However, in practice, the maximum size is usually smaller due to internal overhead. The maximum size is also dependent on the object being stored. For more information, see VARIANT. In general, JSON data sets are a simple concatenation of multiple documents. The JSON output from some software is composed of a single huge array containing multiple records. There is no need to separate the documents with line breaks or commas, though both are supported. If the data exceeds 16 MB, enable the STRIP_OUTER_ARRAY file format option for the COPY INTO <table> command to remove the outer array structure and load the records into separate table rows

https://snowflake.discourse.group/t/what-json-format-does-strip_outer_array-support/7771

The reason D. Set STRIP_OUTER_ARRAY=TRUE in the COPY INTO command is not the correct answer is because this option is used to handle JSON data that is wrapped in an outer array. It does not address the issue of exceeding the maximum LOB size. The error you encountered, “Max LOB size (16777216) exceeded,” indicates that the size of a single JSON document within your file exceeds the maximum allowed size for a large object (LOB) in Snowflake So it's B

Removing brackets turns the JSON into an NDJSON, since every entry is valid json it can be parsed separately, the file won't be read in memory before being parsed

it should be B split the files. https://community.snowflake.com/s/article/Max-LOB-size-exceeded#:~:text=When%20ingesting%20XML%20or%20JSON,of%20parsed%20column%20is%2017894470.

Have you considered studying instead of guessing all the answers?

Correct Answer - B The error “Max LOB size (16777216) exceeded” indicates that the size of the parsed column exceeds the maximum size allowed for a single column value in Snowflake, which is 16 MB. To resolve this issue, the file should be split into multiple smaller files that are within the recommended size range of 100 MB to 250 MB. This will ensure that each JSON document within the files is smaller than the maximum LOB size allowed. Compressing the file, using a larger-sized warehouse, or setting STRIP_OUTER_ARRAY=TRUE will not resolve the issue of the column size exceeding the maximum allowed. References: COPY INTO Error during Structured Data Load: “Max LOB size (16777216) exceeded…”

Correct Answer: D

Ans A ...........

Correct Answer: D

D is correct

https://community.snowflake.com/s/article/Max-LOB-size-exceeded#:~:text=When%20ingesting%20XML%20or%20JSON,of%20parsed%20column%20is%2017894470. When ingesting XML or JSON documents, if the size of the compressed column data exceeds Snowflake’s limit of 16MB [1], an error may occur: Max LOB size (16777216) exceeded, actual size of parsed column is 17894470.

The message also says that the column size that was read is a bit over 17MB. It's not the entire 3GB file. Wouldn't this create a problem by separating parts of the JSON that should be together?

The correct answer is B. Split the file into multiple files in the recommended size range (100 MB - 250 MB). The error message indicates that the size of the JSON data exceeds the maximum LOB size of 16 MB. This can happen if the JSON data contains large nested arrays or objects.

https://community.snowflake.com/s/article/Max-LOB-size-exceeded#:~:text=When%20ingesting%20XML%20or%20JSON,of%20parsed%20column%20is%2017894470.

D is correct.

Failed on maximum column size