Exam Certified Data Engineer Professional topic 1 question 172 discussion

is MEMORY_ONLY

C is correct

It's simple, if MEMORY_ONLY is used, anything spilled to disk would indicate a problem.

C is correct here

Correct Answer: B Option B, is the most correct and relevant choice for an indicator that a cached table is not performing optimally in a MEMORY_ONLY scenario. If an RDD block includes a "?" annotation, it strongly suggests issues with caching, which would directly impact the performance and expected behavior of MEMORY_ONLY caching. This indication points to a failure to cache the data entirely in memory, which is what MEMORY_ONLY intends to do. Option C, could also be a relevant indicator in general caching scenarios (e.g., MEMORY_AND_DISK), but it contradicts the MEMORY_ONLY setting directly. Therefore, Option B is chosen based on the specific storage level described.

B. This annotation says that some partitions of the cached data have been spilled to disk because there wasn't enough memory to keep them.

I would say C