Exam Certified Data Engineer Professional topic 1 question 189 discussion

Actual exam question from Databricks's Certified Data Engineer Professional

Question #: 189
Topic #: 1

[All Certified Data Engineer Professional Questions]

A Delta table of weather records is partitioned by date and has the below schema:

date DATE, device_id INT, temp FLOAT, latitude FLOAT, longitude FLOAT

To find all the records from within the Arctic Circle, you execute a query with the below filter:

latitude > 66.3

Which statement describes how the Delta engine identifies which files to load?

A. All records are cached to an operational database and then the filter is applied
B. The Parquet file footers are scanned for min and max statistics for the latitude column
C. The Hive metastore is scanned for min and max statistics for the latitude column
D. The Delta log is scanned for min and max statistics for the latitude column

Show Suggested Answer

Suggested Answer: D 🗳️

by temple1305 at Dec. 5, 2024, 9:54 p.m.

Comments

Submit Cancel

Thameur01

1 month, 4 weeks ago

Selected Answer: D

As per the documentation, I understand that the table statistics can be fetched through the delta log (eg min, max, count) in order to not read the underlying data of a delta table. This is the case for numerical types, and timestamp is supposed to be supported.

upvoted 2 times

...

temple1305

2 months ago

Selected Answer: D

Delta Table's log consist statistics for columns

upvoted 2 times

...

Exam Certified Data Engineer Professional All Questions

View all questions & answers for the Certified Data Engineer Professional exam

Exam Certified Data Engineer Professional topic 1 question 189 discussion

Comments

Thameur01

temple1305

SY0-701