exam questions

Exam Certified Data Engineer Professional All Questions

View all questions & answers for the Certified Data Engineer Professional exam

Exam Certified Data Engineer Professional topic 1 question 142 discussion

Actual exam question from Databricks's Certified Data Engineer Professional
Question #: 142
Topic #: 1
[All Certified Data Engineer Professional Questions]

Which configuration parameter directly affects the size of a spark-partition upon ingestion of data into Spark?

  • A. spark.sql.files.maxPartitionBytes
  • B. spark.sql.autoBroadcastJoinThreshold
  • C. spark.sql.adaptive.advisoryPartitionSizeInBytes
  • D. spark.sql.adaptive.coalescePartitions.minPartitionNum
Show Suggested Answer Hide Answer
Suggested Answer: A 🗳️

Comments

Chosen Answer:
This is a voting comment (?). It is better to Upvote an existing comment if you don't have anything to add.
Switch to a voting comment New
_lene_
3 weeks, 2 days ago
Selected Answer: A
Property Name Default Meaning spark.sql.files.maxPartitionBytes 134217728 (128 MB) The maximum number of bytes to pack into a single partition when reading files. This configuration is effective only when using file-based sources such as Parquet, JSON and ORC.
upvoted 1 times
...
vexor3
6 months, 2 weeks ago
Selected Answer: A
A is correct
upvoted 1 times
...
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel
Loading ...
exam
Someone Bought Contributor Access for:
SY0-701
London, 1 minute ago