Welcome to ExamTopics
ExamTopics Logo
- Expert Verified, Online, Free.
Mail Us[email protected]
Menu
Databricks Discussions
exam questions

Exam Certified Data Engineer Professional All Questions

View all questions & answers for the Certified Data Engineer Professional exam
Go to Exam

Exam Certified Data Engineer Professional topic 1 question 113 discussion

Actual exam question from Databricks's Certified Data Engineer Professional
Question #: 113
Topic #: 1
[All Certified Data Engineer Professional Questions]

A Delta Lake table in the Lakehouse named customer_churn_params is used in churn prediction by the machine learning team. The table contains information about customers derived from a number of upstream sources. Currently, the data engineering team populates this table nightly by overwriting the table with the current valid values derived from upstream data sources.

Immediately after each update succeeds, the data engineering team would like to determine the difference between the new version and the previous version of the table.

Given the current implementation, which method can be used?

  • A. Execute a query to calculate the difference between the new version and the previous version using Delta Lake’s built-in versioning and lime travel functionality.
  • B. Parse the Delta Lake transaction log to identify all newly written data files.
  • C. Parse the Spark event logs to identify those rows that were updated, inserted, or deleted.
  • D. Execute DESCRIBE HISTORY customer_churn_params to obtain the full operation metrics for the update, including a log of all records that have been added or modified.
  • E. Use Delta Lake’s change data feed to identify those records that have been updated, inserted, or deleted.
Show Suggested Answer Hide Answer
Suggested Answer: A 🗳️
by MDWPartners at May 29, 2024, 5:53 p.m.

Comments

Chosen Answer:
This is a voting comment (?) , you can switch to a simple comment.
Switch to a voting comment New
Submit Cancel
Jugiboss
1 month ago
Selected Answer: E
he best method to determine the difference between the new version and the previous version of the customer_churn_params table in Delta Lake is: E. Use Delta Lake’s change data feed to identify those records that have been updated, inserted, or deleted. This approach leverages Delta Lake's built-in functionality to track changes at the record level, providing a clear view of what has changed between versions.
upvoted 1 times
Jugiboss
1 month ago
Nevermind, it's A
upvoted 1 times
...
...
cales
1 month, 1 week ago
Selected Answer: E
Change data feed allows to check for changes between versions
upvoted 1 times
benni_ale
3 weeks, 5 days ago
There is no info about cdf being enabled on the table
upvoted 1 times
...
...
robodog
3 months ago
Selected Answer: A
Answer is A. The easy way to get the difference between those tables is by travel time by version
upvoted 2 times
...
HelixAbdu
4 months ago
Answer is A. There is no clue that CDF is enabled for the table
upvoted 2 times
...
c00ccb7
4 months, 2 weeks ago
Selected Answer: A
Answer A
upvoted 3 times
...
Deb9753
5 months, 3 weeks ago
Answer : E
upvoted 2 times
...

Get IT Certification

Unlock free, top-quality video courses on ExamTopics with a simple registration. Elevate your learning journey with our expertly curated content. Register now to access a diverse range of educational resources designed for your success. Start learning today with ExamTopics!

Start Learning for free
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel