Exam Professional Machine Learning Engineer topic 1 question 211 discussion

My answer: D According to this documentation, it is very clear that using BigQuery is not a good approach for online prediction at the instance level. That's because we won't use the same code for both training and prediction serving. In the same documentation, the final table on the page recommends using Dataflow with TensorFlow Transform for instance-level data transformation. https://www.tensorflow.org/tfx/guide/tft_bestpractices

https://www.tensorflow.org/tfx/guide/tft_bestpractices#preprocessing_options_summary

D - Apache Beam + tf.transform or Dataflow. https://notebook.community/GoogleCloudPlatform/training-data-analyst/courses/machine_learning/deepdive/04_advanced_preprocessing/a_dataflow

the simplest way

D- Vertex AI isn't designed for instance-level data transformations

D- Vertex AI isn't designed for instance-level data transformations

Addressing limitations of other options: A. Data validation: While essential, it doesn't guarantee consistency if the preprocessing logic itself differs between pipeline and endpoint. C. Sharing code with end users: This shifts the preprocessing burden to end users, potentially leading to inconsistencies and errors, and isn't feasible for real-time inference. D. Batching real-time requests: This introduces latency and might not align with real-time requirements, as users expect immediate responses.