Incorporating unit tests into a PySpark application requires upfront attention to the design of your jobs, or a potentially significant refactoring of existing code.
Which benefit offsets this additional effort?
A.
Improves the quality of your data
B.
Validates a complete use case of your application
C.
Troubleshooting is easier since all steps are isolated and tested individually
D.
Ensures that all steps interact correctly to achieve the desired end result
C is testing each unit of the solution separately. It doesn't necessarily validate the data quality as mentioned in A.
B is more for Business Case scenario testing like end-to-end testing for real life, real data execution.
D is more related to Integration testing.
C. Troubleshooting is easier since all steps are isolated and tested individually
The unit tests will ensuree that specific functions and transformations will work as intended.
upvoted 1 times
...
Log in to ExamTopics
Sign in:
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.
Upvoting a comment with a selected answer will also increase the vote count towards that answer by one.
So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
m79590530
1 month agoimatheushenrique
5 months, 3 weeks ago