B is the right answer as Option B is more typical for stream-static joins, as it provides a consistent static DataFrame snapshot for the entire job's duration. Option A might be suitable in specialized cases where you need real-time updates of the static DataFrame for each microbatch.
The explanation suggests the author would like the stream-static join to work in this way. However, it works as it does - see the first sentence in here: https://learn.microsoft.com/en-us/azure/databricks/transform/join#stream-static
Answer is A, When Azure Databricks processes a micro-batch of data in a stream-static join, the latest valid version of data from the static Delta table joins with the records present in the current micro-batch
from https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/delta-lake
A stream-static join joins the latest valid version of a Delta table (the static data) to a data stream using a stateless join.
When Databricks processes a micro-batch of data in a stream-static join, the latest valid version of data from the static Delta table joins with the records present in the current micro-batch. Because the join is stateless, you do not need to configure watermarking and can process results with low latency. The data in the static Delta table used in the join should be slowly-changing.
This is straight from docs, "A stream-static join joins the latest valid version of a Delta table (the static data) to a data stream using a stateless join.
When Azure Databricks processes a micro-batch of data in a stream-static join, the latest valid version of data from the static Delta table joins with the records present in the current micro-batch. Because the join is stateless, you do not need to configure watermarking and can process results with low latency. The data in the static Delta table used in the join should be slowly-changing."
https://learn.microsoft.com/en-us/azure/databricks/transform/join#stream-static
Correct answer is A. https://docs.databricks.com/en/structured-streaming/delta-lake.html
upvoted 1 times
...
Log in to ExamTopics
Sign in:
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.
Upvoting a comment with a selected answer will also increase the vote count towards that answer by one.
So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
Eertyy
Highly Voted 1 year, 4 months agoarekm
1 month agohamzaKhribi
1 year, 2 months agoBrianNguyen95
Highly Voted 1 year, 5 months agoarekm
Most Recent 1 month agoSriramiyer92
1 month, 3 weeks agoSriramiyer92
1 month, 3 weeks agoakashdesarda
4 months, 1 week agokz_data
1 year agohamzaKhribi
1 year, 2 months agosturcu
1 year, 3 months agosagar21692
1 year, 4 months ago