Exam Certified Associate Developer for Apache Spark topic 1 question 174 discussion

Actual exam question from Databricks's Certified Associate Developer for Apache Spark

Question #: 174
Topic #: 1

[All Certified Associate Developer for Apache Spark Questions]

Which of the following operations will always return a new DataFrame with updated partitions from DataFrame storesDF by inducing a shuffle?

A. storesDF.coalesce()
B. storesDF.rdd.getNumPartitions()
C. storesDF.repartition()
D. storesDF.union()
E. storesDF.intersect()

Show Suggested Answer

Suggested Answer: C 🗳️

by Sowwy1 at April 10, 2024, 6:03 p.m.

Comments

Submit Cancel

Souvik_79

1 week, 4 days ago

The correct answer is: C. storesDF.repartition() Explanation: repartition(): This operation induces a shuffle and creates a new DataFrame with the specified number of partitions. It is used when you want to increase or decrease the number of partitions in a DataFrame, and it always triggers a shuffle to evenly distribute data across the partitions.

upvoted 1 times

...