A Generative AI Engineer has a provisioned throughput model serving endpoint as part of a RAG application and would like to monitor the serving endpoint’s incoming requests and outgoing responses. The current approach is to include a micro-service in between the endpoint and the user interface to write logs to a remote server.
Which Databricks feature should they use instead which will perform the same task?
Arifai900
2 months, 2 weeks agotrendy01
3 months, 3 weeks agoawron_durat
3 months, 3 weeks ago