Exam Certified Data Engineer Associate topic 1 question 32 discussion

I am simply appalled by the number of wrong answers in this series of questions. The statement in the question already says "ON VIOLATE DROP ROW" which means if condition is violated, there will be nothing saved to quarantine table and a log of all invalid entries will be recoded. All invalid data that doesn't meet condition will be dropped. So C is the correct answer.

C is correct

In Delta Live Tables, expectations are used to enforce data quality rules. In this specific case, the expectation is that the timestamp column should be greater than '2020-01-01'. When a batch of data is processed, if a record violates this expectation, the following happens: Drop the violating rows: The rows that don't meet the expectation (timestamp > '2020-01-01') will be dropped from the dataset. Logging of the violation: The fact that these rows were dropped due to the violation will be recorded in the event log for audit and tracking purposes. This ensures that only valid data (according to the expectation) is loaded into the final dataset, while invalid data is tracked.

100% C

C is the correct answer.

C is the correct answer. The DROP ROW clause will cause them to NOT be added to the destination; only marked in the log.

C is correct

C is correct

C. Records that violate the expectation are dropped from the target dataset and recorded as invalid in the event log. Explanation: The defined expectation specifies that if the timestamp is not greater than '2020-01-01', the row will be considered in violation of the constraint. The ON VIOLATION DROP ROW clause states that rows that violate the constraint will be dropped from the target dataset. Additionally, the expectation clause will log these violations in the event log, indicating which records did not meet the specified constraint criteria. This behavior ensures that the rows failing the defined constraint are not included in the target dataset and are logged as invalid in the event log for reference or further investigation, maintaining data integrity within the dataset based on the specified constraints.

who choses these answers? The correct answer is C. The record is dropped. This is not about the default behavior. It is explicit.

Right answer: C Invalid rows will be dropped as requested by the constraint and flagged as such in log files. If you need a quarantine table, you'll have to write more code.

C. Records that violate the expectation are dropped from the target dataset and recorded as invalid in the event log. With the defined constraint and expectation clause, when a batch of data is processed, any records that violate the expectation (in this case, where the timestamp is not greater than '2020-01-01') will be dropped from the target dataset. These dropped records will also be recorded as invalid in the event log, allowing for auditing and tracking of the data quality issues without causing the entire job to fail.

https://docs.databricks.com/en/delta-live-tables/expectations.html

C When a batch of data is processed in Delta Live Tables and contains data that violates the defined expectations or constraints, the expected behavior is that the records violating the expectation are dropped from the target dataset. Additionally, these violated records are recorded as invalid in the event log.

C is correct

B is correct. This question is number 35 on the practice test on databricks patner academy. https://partner-academy.databricks.com/ correct answer is "Records that violate the expectation are added to the target dataset and recorded as invalid in the event log"

option C