Exam Certified Machine Learning Professional topic 1 question 40 discussion

In a batch serving deployment, predictions are computed offline, typically in bulk, using data that is available before the query time. These predictions are stored and can be quickly queried when needed, providing faster response times compared to computing predictions in real-time, especially when the feature values needed for computing predictions are available well in advance.

The correct answer is E. Querying stored predictions can be faster than computing predictions in real-time. In this scenario, since the feature values needed for computing the predictions are available one week before the query time, the predictions can be precomputed using a batch serving deployment. When the predictions are needed, they can be quickly retrieved from storage, which can be faster than computing the predictions in real-time. This approach also allows for the efficient use of resources, as the computational work can be done during off-peak times.