A data ingestion task requires a one-TB JSON dataset to be written out to Parquet with a target part-file size of 512 MB. Because Parquet is being used instead of Delta Lake, built-in file-sizing features such as Auto-Optimize & Auto-Compaction cannot be used.
Which strategy will yield the best performance without shuffling data?
aragorn_brego
Highly Voted 1 year, 7 months agoDef21
Highly Voted 1 year, 5 months agoarekm
6 months agocarlosmps
6 months, 4 weeks agoazurefan777
8 months agoKadELbied
Most Recent 2 months, 1 week agoAlejandroU
6 months, 2 weeks agoAlejandroU
6 months, 2 weeks agotemple1305
7 months agonedlo
8 months, 1 week agosdas1
9 months, 3 weeks agosdas1
9 months, 3 weeks agosdas1
9 months, 3 weeks agosdas1
9 months, 3 weeks agovikram12apr
1 year, 3 months agohal2401me
1 year, 3 months agohal2401me
1 year, 4 months agoCurious76
1 year, 4 months agovctrhugo
1 year, 5 months agoadenis
1 year, 5 months agospaceexplorer
1 year, 5 months agodivingbell17
1 year, 6 months ago911land
1 year, 6 months agoalexvno
1 year, 6 months agopetrv
1 year, 7 months ago