Welcome to ExamTopics
ExamTopics Logo
- Expert Verified, Online, Free.
Mail Us[email protected]
Menu
Databricks Discussions
exam questions

Exam Certified Data Engineer Professional All Questions

View all questions & answers for the Certified Data Engineer Professional exam
Go to Exam

Exam Certified Data Engineer Professional topic 1 question 28 discussion

Actual exam question from Databricks's Certified Data Engineer Professional
Question #: 28
Topic #: 1
[All Certified Data Engineer Professional Questions]

A junior data engineer seeks to leverage Delta Lake's Change Data Feed functionality to create a Type 1 table representing all of the values that have ever been valid for all rows in a bronze table created with the property delta.enableChangeDataFeed = true. They plan to execute the following code as a daily job:

Which statement describes the execution and results of running the above query multiple times?

  • A. Each time the job is executed, newly updated records will be merged into the target table, overwriting previous values with the same primary keys.
  • B. Each time the job is executed, the entire available history of inserted or updated records will be appended to the target table, resulting in many duplicate entries.
  • C. Each time the job is executed, the target table will be overwritten using the entire history of inserted or updated records, giving the desired result.
  • D. Each time the job is executed, the differences between the original and current versions are calculated; this may result in duplicate entries for some records.
  • E. Each time the job is executed, only those records that have been inserted or updated since the last execution will be appended to the target table, giving the desired result.
Show Suggested Answer Hide Answer
Suggested Answer: B 🗳️
by asmayassineg at Aug. 2, 2023, 12:40 p.m.

Comments

Chosen Answer:
This is a voting comment (?) , you can switch to a simple comment.
Switch to a voting comment New
Submit Cancel
akashdesarda
3 weeks ago
Selected Answer: B
The starting version is 0, that means in every version entire data will be fetched. It is then append.
upvoted 1 times
...
faraaz132
3 months, 3 weeks ago
Correct Answer: B (not E) Although it was pretty obvious to me, I still wrote the code to check and yes, it will append the entire change during every write since starting version is mentioned as 0. If in doubt, code it yourselves
upvoted 2 times
...
imatheushenrique
5 months, 3 weeks ago
("startingVersion", 0) that means the entiry history of table will be read so B.
upvoted 3 times
...
PrashantTiwari
9 months, 2 weeks ago
B is correct
upvoted 2 times
...
kz_data
10 months, 2 weeks ago
Selected Answer: B
B is correct
upvoted 2 times
...
5ffcd04
10 months, 4 weeks ago
Selected Answer: B
Correct B
upvoted 1 times
...
azurelearn2020
11 months, 3 weeks ago
Selected Answer: B
correct answer is B.
upvoted 1 times
...
[Removed]
11 months, 3 weeks ago
Selected Answer: E
Considering that we are talking about Change Data Feed and the code is filtering by[ "update_postimage", "insert" ] the column "_change_type", I would go with the option E. Reference: https://docs.delta.io/latest/delta-change-data-feed.html#:~:text=_change_type,update_preimage%20%2C%20update_postimage
upvoted 1 times
5ffcd04
10 months, 4 weeks ago
Notice option ("startingVersion", 0), which will bring all changes from begining. Hence Answer is B.
upvoted 5 times
...
...
jyothsna12496
1 year, 1 month ago
why is it Not E. It gets newly inserted or updated records
upvoted 1 times
[Removed]
11 months, 3 weeks ago
I'm with you, follow the reference: https://docs.delta.io/latest/delta-change-data-feed.html#:~:text=_change_type,update_preimage%20%2C%20update_postimage
upvoted 1 times
...
5ffcd04
10 months, 4 weeks ago
Notice .option ("startingVersion", 0), which will bring all changes from begining. Hence Answer is B.
upvoted 1 times
...
...
sturcu
1 year, 1 month ago
Selected Answer: B
correct
upvoted 1 times
...
azurearch
1 year, 2 months ago
B is the right answer, sorry.
upvoted 2 times
...
azurearch
1 year, 2 months ago
answer is A, because there is a filter as asmayassineg said. Filter filters only existing records from change feed
upvoted 1 times
...
asmayassineg
1 year, 3 months ago
sorry, answer is correct B.
upvoted 2 times
...
asmayassineg
1 year, 3 months ago
Answer is A, since the df is filtering on updated records using update_postimage filter
upvoted 2 times
mht3336
10 months ago
there is also insert in the filter.
upvoted 1 times
...
taif12340
1 year, 3 months ago
it's B: Reading table’s changes, captured by CDF, using spark.read means that you are reading them as a static source. So, each time you run the query, all table’s changes (starting from the specified startingVersion) will be read.
upvoted 6 times
...
...

Get IT Certification

Unlock free, top-quality video courses on ExamTopics with a simple registration. Elevate your learning journey with our expertly curated content. Register now to access a diverse range of educational resources designed for your success. Start learning today with ExamTopics!

Start Learning for free
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel