Exam Professional Machine Learning Engineer topic 1 question 170 discussion

B. Deploy an online Vertex AI prediction endpoint. Set the max replica count to 100: This option provides a higher number of replicas (100) to handle the expected high volume of requests during peak hours. While it might result in increased costs, it provides the necessary scalability to manage the incoming traffic efficiently. During non-peak hours, you can consider scaling down the replicas to reduce costs, as Vertex AI allows dynamic scaling based on demand.

Option A (Deploying an online Vertex AI prediction endpoint. Set the max replica count to 1) is still a good choice for minimizing costs. By setting the max replica count to 1, you are allowing Vertex AI to scale up or down based on load, which means that during off-peak hours, you won't be paying for unnecessary instances.

see pikachu007

B we don't need GPU for scikit-learn

scikit-learn doesn't support GPU https://scikit-learn.org/stable/faq.html#will-you-add-gpu-support

B. scikit-learn -> no need for GPU max number of replicas -> 1 is too little if we are serving online predictions at such a massive scale (millions per second)