Exam Certified Data Engineer Associate topic 1 question 128 discussion

Actual exam question from Databricks's Certified Data Engineer Associate

Question #: 128
Topic #: 1

[All Certified Data Engineer Associate Questions]

A data engineer has a single-task Job that runs each morning before they begin working. After identifying an upstream data issue, they need to set up another task to run a new notebook prior to the original task.

Which approach can the data engineer use to set up the new task?

A. They can clone the existing task in the existing Job and update it to run the new notebook.
B. They can create a new task in the existing Job and then add it as a dependency of the original task.
C. They can create a new task in the existing Job and then add the original task as a dependency of the new task.
D. They can create a new job from scratch and add both tasks to run concurrently.

Show Suggested Answer

Suggested Answer: B 🗳️

by Ivan_Petrov at May 10, 2024, 2:56 p.m.

Comments

Submit Cancel

Billybob0604

3 months, 1 week ago

Selected Answer: C

No, a new notebook needs to be run prior to the original task meaning the original task depends on the new notebook, hence C.

upvoted 1 times

...

CommanderBigMac

9 months, 3 weeks ago

Selected Answer: B

B is correct. the new task needs to be the dependancy.

upvoted 1 times

...

9d4d68a

10 months, 1 week ago

Correct Answer: B Explanation: To set up the new task to run a new notebook prior to the original task in a single-task Job, the data engineer can use the following approach: In the existing Job, create a new task that corresponds to the new notebook that needs to be run. Set up the new task with the appropriate configuration, specifying the notebook to be executed and any necessary parameters or dependencies. Once the new task is created, designate it as a dependency of the original task in the Job configuration. This ensures that the new task is executed before the original task.

upvoted 1 times

...