You have been tasked with deploying prototype code to production. The feature engineering code is in PySpark and runs on Dataproc Serverless. The model training is executed by using a Vertex AI custom training job. The two steps are not connected, and the model training must currently be run manually after the feature engineering step finishes. You need to create a scalable and maintainable production process that runs end-to-end and tracks the connections between steps. What should you do?
Akel123
5 months agofitri001
6 months, 1 week agofitri001
6 months, 1 week agoCHARLIE2108
8 months, 3 weeks agokalle_balle
9 months, 2 weeks ago36bdc1e
9 months, 2 weeks agopikachu007
9 months, 3 weeks agovale_76_na_xxx
9 months, 3 weeks ago