exam questions

Exam AWS Certified Machine Learning - Specialty All Questions

View all questions & answers for the AWS Certified Machine Learning - Specialty exam

Exam AWS Certified Machine Learning - Specialty topic 1 question 19 discussion

A Machine Learning Specialist is building a logistic regression model that will predict whether or not a person will order a pizza. The Specialist is trying to build the optimal model with an ideal classification threshold.
What model evaluation technique should the Specialist use to understand how different classification thresholds will impact the model's performance?

  • A. Receiver operating characteristic (ROC) curve
  • B. Misclassification rate
  • C. Root Mean Square Error (RMSE)
  • D. L1 norm
Show Suggested Answer Hide Answer
Suggested Answer: A 🗳️

Comments

Chosen Answer:
This is a voting comment (?). It is better to Upvote an existing comment if you don't have anything to add.
Switch to a voting comment New
rsimham
Highly Voted 3 years, 7 months ago
Ans. A is correct
upvoted 20 times
...
AKT
Highly Voted 3 years, 6 months ago
Answer is A. An ROC curve (receiver operating characteristic curve) is a graph showing the performance of a classification model at all classification thresholds
upvoted 9 times
...
JonSno
Most Recent 2 months, 1 week ago
Selected Answer: A
Explanation: The ROC curve is the best technique to evaluate how different classification thresholds impact the model's performance. It plots True Positive Rate (TPR) against False Positive Rate (FPR) at various threshold values. Why the ROC Curve? Logistic regression outputs probabilities, and we need to select a classification threshold to decide between "order pizza" (1) and "not order pizza" (0). Changing the threshold impacts the trade-off between sensitivity (recall) and specificity. The ROC curve helps visualize this trade-off and select the best threshold based on the business goal (e.g., maximizing recall vs. minimizing false positives). The Area Under the ROC Curve (AUC-ROC) is a useful metric to measure the model's discrimination ability.
upvoted 2 times
...
GeeBeeEl
7 months ago
A is indeed correct see https://developers.google.com/machine-learning/crash-course/classification/roc-and-auc An ROC curve (receiver operating characteristic curve) is a graph showing the performance of a classification model at all classification thresholds. This curve plots two parameters: • True Positive Rate • False Positive Rate True Positive Rate (TPR) is a synonym for recall and is therefore defined as follows: TPR = TP/TP+FN False Positive Rate (FPR) is defined as follows: FPR = FP/FP+TN
upvoted 4 times
...
Mickey321
7 months ago
Selected Answer: A
The reason for this choice is that a ROC curve is a graphical plot that illustrates the performance of a binary classifier across different values of the classification threshold1. A ROC curve plots the true positive rate (TPR) or sensitivity against the false positive rate (FPR) or 1-specificity for various threshold values2. The TPR is the proportion of positive instances that are correctly classified, while the FPR is the proportion of negative instances that are incorrectly classified.
upvoted 2 times
...
Valcilio
2 years, 1 month ago
Selected Answer: A
ROC curve is for defining the threshold.
upvoted 2 times
...
spamicho
3 years, 5 months ago
A surely
upvoted 1 times
...
syu31svc
3 years, 5 months ago
Question is about classification so confusion matrix would come into mind; A is the answer
upvoted 1 times
...
hans1234
3 years, 6 months ago
It is A.
upvoted 1 times
...
roytruong
3 years, 6 months ago
obviously A
upvoted 1 times
...
bitiyaha
3 years, 7 months ago
Root Mean Square Error (RMSE) Ans. c
upvoted 1 times
bzhao
3 years, 6 months ago
I think RMSE is for regression model
upvoted 5 times
...
...
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel
Loading ...
exam
Someone Bought Contributor Access for:
SY0-701
London, 1 minute ago