exam questions

Exam Professional Machine Learning Engineer All Questions

View all questions & answers for the Professional Machine Learning Engineer exam

Exam Professional Machine Learning Engineer topic 1 question 55 discussion

Actual exam question from Google's Professional Machine Learning Engineer
Question #: 55
Topic #: 1
[All Professional Machine Learning Engineer Questions]

You recently joined a machine learning team that will soon release a new project. As a lead on the project, you are asked to determine the production readiness of the ML components. The team has already tested features and data, model development, and infrastructure. Which additional readiness check should you recommend to the team?

  • A. Ensure that training is reproducible.
  • B. Ensure that all hyperparameters are tuned.
  • C. Ensure that model performance is monitored.
  • D. Ensure that feature expectations are captured in the schema.
Show Suggested Answer Hide Answer
Suggested Answer: C 🗳️

Comments

Chosen Answer:
This is a voting comment (?). It is better to Upvote an existing comment if you don't have anything to add.
Switch to a voting comment New
inder0007
Highly Voted 3 years, 3 months ago
I think it should be C
upvoted 21 times
simoncerda
2 years, 10 months ago
I also think is C: reference : https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/aad9f93b86b7addfea4c419b9100c6cdd26cacea.pdf
upvoted 1 times
...
omar_bh
3 years, 3 months ago
performance monitoring is a continuous effort that happens all time. but reproducibility makes more sense to be added to model QA
upvoted 4 times
sensev
3 years, 3 months ago
The question was not about model QA but production readiness, thus I think the answer is C because monitor model performance in production is important. As regard to A, I would I argue it could fall under "model development", since reproducible training is already important during model development.
upvoted 4 times
vivid_cucumber
2 years, 11 months ago
To my understanding, I think A might be correct since model performance monitoring is happens "in production". but the question said the project "will soon release" which means right now is before launching, so to me testing the reproducible would make more sense. (I was confused about A and C for a long time) reference: - Testing reproducibility: https://developers.google.com/machine-learning/testing-debugging/pipeline/deploying - Testing in Production: https://developers.google.com/machine-learning/testing-debugging/pipeline/production
upvoted 7 times
...
...
...
...
ralf_cc
Highly Voted 3 years, 3 months ago
A - important one before moving to the production
upvoted 9 times
salsabilsf
3 years, 3 months ago
Testing for Deploying Machine Learning Models: - Test Model Updates with Reproducible Training https://developers.google.com/machine-learning/testing-debugging/pipeline/deploying
upvoted 5 times
...
...
PhilipKoku
Most Recent 4 months, 3 weeks ago
Selected Answer: C
C) Model monitoring
upvoted 1 times
...
SahandJ
5 months, 3 weeks ago
C is not a readiness check. Monitoring is a continuous effort. IMO A is the correct answer. If the training is not reproducible it's not ready for production. If any error happens, data drifts / skews, then there is no way to recreate the model. This is a check BEFORE going to production. Once it's in production, then yes C is important.
upvoted 1 times
...
fragkris
10 months, 4 weeks ago
Selected Answer: C
Monitoring is crucial. So - C
upvoted 2 times
...
M25
1 year, 5 months ago
Selected Answer: C
Went with C
upvoted 1 times
...
e707
1 year, 6 months ago
Selected Answer: C
I'll go with C. Monitoring model performance is an important aspect of production readiness. It allows the team to detect and respond to changes in performance that may affect the quality of the model. The other options are also important, but they are more focused on the development phase of the project rather than the production phase.
upvoted 1 times
...
John_Pongthorn
1 year, 8 months ago
Selected Answer: C
Hey! all guys A+B+D=The team has already tested features and data, model development, and infrastructure. we are about to go live with production. Monitoring readiness is the last thing to account for. It will be very rediculous if you launch model as production regardless of how we will have about monitoring. you will lauch model as production for while and will make plan to model performance monitoring later ??? you are too reckless. Pls . Read it carefully https://developers.google.com/machine-learning/testing-debugging/pipeline/production https://developers.google.com/machine-learning/testing-debugging/pipeline/overview#what-is-an-ml-pipeline. You Most guys prefer A : https://developers.google.com/machine-learning/testing-debugging/pipeline/deploying I think that it is all about model development prior to deploying .
upvoted 4 times
...
enghabeth
1 year, 8 months ago
Selected Answer: C
I think that your team ensure that all hypermarameters were turned yet when tested features... i think that it's more important that they ensure that model performance is monitored than thaining is reproducible for best practices. https://cloud.google.com/architecture/ml-on-gcp-best-practices
upvoted 1 times
...
John_Pongthorn
1 year, 9 months ago
Selected Answer: C
Reproducible Training is more likely to be in the Deployment step in that it referred to the question "The team has already tested features and data, model development" but the question focuses on Production readiness https://developers.google.com/machine-learning/testing-debugging/pipeline/production Monitor section is part of this above link
upvoted 1 times
...
ares81
1 year, 9 months ago
Selected Answer: C
C, for me.
upvoted 1 times
...
vakati
1 year, 11 months ago
Selected Answer: C
It's mentioned that the team has already tested features and data, implying that data generation is reproducible. If you have to test features data has to be reproducible to compare model outputs. ( https://developers.google.com/machine-learning/data-prep/construct/sampling-splitting/randomization). Hence C makes more sense
upvoted 2 times
...
bL357A
2 years, 1 month ago
Selected Answer: C
https://cloud.google.com/ai-platform/docs/ml-solutions-overview
upvoted 1 times
...
u_phoria
2 years, 4 months ago
Selected Answer: C
With the specific focus on "production readiness" as stated, I'd pick C above the others.
upvoted 2 times
...
KD1988
2 years, 4 months ago
I think it's C. A is related to infrastructure, B is related to model development and D is related to Data and features. It clearly mentioned that team has already tested for model development, data and features and infrastructure.
upvoted 1 times
...
Mohamed_Mossad
2 years, 4 months ago
Selected Answer: A
"production readiness" means that we are still in dev-test phase , and "performance monitoring" happens in production , and what if monitoring is applied but the model re-train is difficult , so "A" is the best answer
upvoted 1 times
...
abc0000
2 years, 8 months ago
A makes more sense than C.
upvoted 2 times
...
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel
Loading ...
exam
Someone Bought Contributor Access for:
SY0-701
London, 1 minute ago