HOTSPOT - For each of the following statements, select Yes if the statement is true. Otherwise, select No. NOTE: Each correct selection is worth one point. Hot Area:
Suggested Answer:
Box 1: No - The validation dataset is different from the test dataset that is held back from the training of the model.
Box 2: Yes - A validation dataset is a sample of data that is used to give an estimate of model skill while tuning model's hyperparameters.
Box 3: No - The Test Dataset, not the validation set, used for this. The Test Dataset is a sample of data used to provide an unbiased evaluation of a final model fit on the training dataset. Reference: https://machinelearningmastery.com/difference-test-validation-datasets/
Answers are :
1 = N (By essence validation set is different from test set. Not difficult : the answer is No).
2 = Y (This is the purpose of validation set : to validate (or not) the model).
3 = N (validation test doesn't test if all the train split of dataset has been used to train the model. That's out of the scope).
It's worth noting that the validation set should be different from the training set, so that the model doesn't memorize the validation set. Also, it's recommended to have the same distribution of the data in the validation set as in the test set.
I guess it is NNY.
https://docs.microsoft.com/en-us/azure/machine-learning/concept-automated-ml#training-validation-and-test-data mentioned:
With automated ML you provide the training data to train ML models, and you can specify what type of model validation to perform. Automated ML performs model validation as part of training. That is, automated ML uses validation data to tune model hyperparameters based on the applied algorithm to find the best combination that best fits the training data. However, the same validation data is used for each iteration of tuning, which introduces model evaluation bias since the model continues to improve and fit to the validation data.
To help confirm that such bias isn't applied to the final recommended model, automated ML supports the use of test data to evaluate the final model that automated ML recommends at the end of your experiment. When you provide test data as part of your AutoML experiment configuration, this recommended model is tested by default at the end of your experiment (preview).
Outside of Azure they both are different. Not sure about Azure!
upvoted 2 times
...
...
Log in to ExamTopics
Sign in:
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.
Upvoting a comment with a selected answer will also increase the vote count towards that answer by one.
So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
AdrienBnhm
Highly Voted 1 year, 8 months agordemontis
1 year, 5 months agoPanda_man
11 months, 2 weeks agoTJ001
Highly Voted 2 years, 10 months agommatchev
Most Recent 1 year, 10 months agodim97
2 years, 3 months agoidioteque
2 years, 3 months agoYankam
2 years, 11 months agosdokmak
2 years, 9 months agoMarski
3 years agopmblr2020
2 years, 11 months ago12oct
3 years, 2 months agopmblr2020
2 years, 11 months agoMirjalol
1 year, 10 months agobrollyy
3 years, 1 month ago