Which statement describes the default execution mode for Databricks Auto Loader?
A.
Cloud vendor-specific queue storage and notification services are configured to track newly arriving files; new files are incrementally and idempotently loaded into the target Delta Lake table.
B.
New files are identified by listing the input directory; the target table is materialized by directly querying all valid files in the source directory.
C.
Webhooks trigger a Databricks job to run anytime new data arrives in a source directory; new data are automatically merged into target tables using rules inferred from the data.
D.
New files are identified by listing the input directory; new files are incrementally and idempotently loaded into the target Delta Lake table.
"Auto Loader uses directory listing mode by default. In directory listing mode, Auto Loader identifies new files by listing the input directory."
https://learn.microsoft.com/en-us/azure/databricks/ingestion/auto-loader/directory-listing-mode
Correct answer is B. However, listing the input directory is the default way of identifying new files for auto loader. Cloud Native Notification services can be used but this is not default setting for auto loader.
solution a is better approach a it is more efficient but both vendor-specific notification service and directory file listing are used for tracking the new files.
check out below link :- https://docs.databricks.com/en/ingestion/cloud-object-storage/auto-loader/file-detection-modes.html
The question is not "what is the better approach", but "what is the default approach", hence D.
upvoted 1 times
...
...
Log in to ExamTopics
Sign in:
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.
Upvoting a comment with a selected answer will also increase the vote count towards that answer by one.
So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
arekm
1 month agoOnlyPraveen
1 month, 1 week agocarlosmps
1 month, 4 weeks agotemple1305
2 months agodivyapsingh
2 months agoarekm
1 month ago