exam questions

Exam AI-900 All Questions

View all questions & answers for the AI-900 exam

Exam AI-900 topic 1 question 50 discussion

Actual exam question from Microsoft's AI-900
Question #: 50
Topic #: 1
[All AI-900 Questions]

HOTSPOT -
For each of the following statements, select Yes if the statement is true. Otherwise, select No.
NOTE: Each correct selection is worth one point.
Hot Area:

Show Suggested Answer Hide Answer
Suggested Answer:
Box 1: No -
The validation dataset is different from the test dataset that is held back from the training of the model.

Box 2: Yes -
A validation dataset is a sample of data that is used to give an estimate of model skill while tuning model's hyperparameters.

Box 3: No -
The Test Dataset, not the validation set, used for this. The Test Dataset is a sample of data used to provide an unbiased evaluation of a final model fit on the training dataset.
Reference:
https://machinelearningmastery.com/difference-test-validation-datasets/

Comments

Chosen Answer:
This is a voting comment (?). It is better to Upvote an existing comment if you don't have anything to add.
Switch to a voting comment New
AdrienBnhm
Highly Voted 1 year, 8 months ago
Answers are : 1 = N (By essence validation set is different from test set. Not difficult : the answer is No). 2 = Y (This is the purpose of validation set : to validate (or not) the model). 3 = N (validation test doesn't test if all the train split of dataset has been used to train the model. That's out of the scope).
upvoted 16 times
rdemontis
1 year, 5 months ago
agree with you
upvoted 2 times
...
Panda_man
11 months, 2 weeks ago
I agree to this
upvoted 1 times
...
...
TJ001
Highly Voted 2 years, 10 months ago
Answers looks correct If we assume validation set - means test data set
upvoted 10 times
...
mmatchev
Most Recent 1 year, 10 months ago
It's worth noting that the validation set should be different from the training set, so that the model doesn't memorize the validation set. Also, it's recommended to have the same distribution of the data in the validation set as in the test set.
upvoted 2 times
...
dim97
2 years, 3 months ago
I guess it is NNY. https://docs.microsoft.com/en-us/azure/machine-learning/concept-automated-ml#training-validation-and-test-data mentioned: With automated ML you provide the training data to train ML models, and you can specify what type of model validation to perform. Automated ML performs model validation as part of training. That is, automated ML uses validation data to tune model hyperparameters based on the applied algorithm to find the best combination that best fits the training data. However, the same validation data is used for each iteration of tuning, which introduces model evaluation bias since the model continues to improve and fit to the validation data. To help confirm that such bias isn't applied to the final recommended model, automated ML supports the use of test data to evaluate the final model that automated ML recommends at the end of your experiment. When you provide test data as part of your AutoML experiment configuration, this recommended model is tested by default at the end of your experiment (preview).
upvoted 1 times
...
idioteque
2 years, 3 months ago
For me to remember xD Validation set = predicts model = Yes (only yes)
upvoted 4 times
...
Yankam
2 years, 11 months ago
This question is not really clear to my understanding
upvoted 2 times
sdokmak
2 years, 9 months ago
the first and last statements are worded almost right, but actually make no sense
upvoted 1 times
...
...
Marski
3 years ago
Official Microsoft documentation is missing. Where? Link ?
upvoted 1 times
pmblr2020
2 years, 11 months ago
That is ground truth of ML.
upvoted 2 times
...
...
12oct
3 years, 2 months ago
Is Test set and Validation set different in Azure ?
upvoted 3 times
pmblr2020
2 years, 11 months ago
No, it's same.
upvoted 1 times
Mirjalol
1 year, 10 months ago
Can you explain and prove that it's the same? I believe they are not
upvoted 1 times
...
...
brollyy
3 years, 1 month ago
Outside of Azure they both are different. Not sure about Azure!
upvoted 2 times
...
...
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel
Loading ...