Welcome to ExamTopics
ExamTopics Logo
- Expert Verified, Online, Free.
Mail Us[email protected]
Menu
Databricks Discussions
exam questions

Exam Certified Data Engineer Professional All Questions

View all questions & answers for the Certified Data Engineer Professional exam
Go to Exam

Exam Certified Data Engineer Professional topic 1 question 94 discussion

Actual exam question from Databricks's Certified Data Engineer Professional
Question #: 94
Topic #: 1
[All Certified Data Engineer Professional Questions]

Spill occurs as a result of executing various wide transformations. However, diagnosing spill requires one to proactively look for key indicators.

Where in the Spark UI are two of the primary indicators that a partition is spilling to disk?

  • A. Query’s detail screen and Job’s detail screen
  • B. Stage’s detail screen and Executor’s log files
  • C. Driver’s and Executor’s log files
  • D. Executor’s detail screen and Executor’s log files
  • E. Stage’s detail screen and Query’s detail screen
Show Suggested Answer Hide Answer
Suggested Answer: B 🗳️
by 60ties at Nov. 15, 2023, 12:45 p.m.

Comments

Chosen Answer:
This is a voting comment (?) , you can switch to a simple comment.
Switch to a voting comment New
Submit Cancel
60ties
Highly Voted 1 year ago
Selected Answer: B
B is correct
upvoted 7 times
...
dd1192d
Most Recent 1 month, 2 weeks ago
Selected Answer: B
b
upvoted 1 times
...
vctrhugo
9 months, 3 weeks ago
Selected Answer: B
In the Spark UI, the Stage’s detail screen provides key metrics about each stage of a job, including the amount of data that has been spilled to disk. If you see a high number in the “Spill (Memory)” or “Spill (Disk)” columns, it’s an indication that a partition is spilling to disk. The Executor’s log files can also provide valuable information about spill. If a task is spilling a lot of data, you’ll see messages in the logs like “Spilling UnsafeExternalSorter to disk” or “Task memory spill”. These messages indicate that the task ran out of memory and had to spill data to disk.
upvoted 4 times
...
jin1991
11 months, 1 week ago
Selected Answer: E
E is correct
upvoted 1 times
jin1991
11 months, 1 week ago
My bad, looking again, B is correct.
upvoted 2 times
...
...

Get IT Certification

Unlock free, top-quality video courses on ExamTopics with a simple registration. Elevate your learning journey with our expertly curated content. Register now to access a diverse range of educational resources designed for your success. Start learning today with ExamTopics!

Start Learning for free
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel