A Generative AI Engineer just deployed an LLM application at a digital marketing company that assists with answering customer service inquiries. Which metric should they monitor for their customer service LLM application in production?
A.
Number of customer inquiries processed per unit of time
B.
Energy usage per query
C.
Final perplexity scores for the training of the model
D.
HuggingFace Leaderboard values for the base LLM
A is the correct answer since evaluating customer service, perplexity score (option C) of the training model does not matter. B and C are irrelevant to the question.
I said A inquiries/time because B and C are more for optimization or training and D would be for the development phase when originally building the application, not production.
upvoted 1 times
...
Log in to ExamTopics
Sign in:
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.
Upvoting a comment with a selected answer will also increase the vote count towards that answer by one.
So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
tfaw
2 months, 1 week agoArifai900
2 months, 2 weeks agoawron_durat
3 months, 3 weeks ago