Welcome to ExamTopics
ExamTopics Logo
- Expert Verified, Online, Free.
Mail Us[email protected]
Menu
Databricks Discussions
exam questions

Exam Certified Generative AI Engineer Associate All Questions

View all questions & answers for the Certified Generative AI Engineer Associate exam
Go to Exam

Exam Certified Generative AI Engineer Associate topic 1 question 37 discussion

Actual exam question from Databricks's Certified Generative AI Engineer Associate
Question #: 37
Topic #: 1
[All Certified Generative AI Engineer Associate Questions]

A Generative AI Engineer developed an LLM application using the provisioned throughput Foundation Model API. Now that the application is ready to be deployed, they realize their volume of requests are not sufficiently high enough to create their own provisioned throughput endpoint. They want to choose a strategy that ensures the best cost-effectiveness for their application.
What strategy should the Generative AI Engineer use?

  • A. Switch to using External Models instead
  • B. Deploy the model using pay-per-token throughput as it comes with cost guarantees
  • C. Change to a model with a fewer number of parameters in order to reduce hardware constraint issues
  • D. Throttle the incoming batch of requests manually to avoid rate limiting issues
Show Suggested Answer Hide Answer
Suggested Answer: B 🗳️
by trendy01 at Oct. 26, 2024, 6:21 a.m.

Comments

Chosen Answer:
This is a voting comment (?) , you can switch to a simple comment.
Switch to a voting comment New
Submit Cancel
trendy01
4 weeks, 1 day ago
Selected Answer: B
B appears to be the most appropriate choice. A strategy that can maximize cost effectiveness in low request volume situations is to deploy in a usage-based token throughput manner.
upvoted 1 times
...

Get IT Certification

Unlock free, top-quality video courses on ExamTopics with a simple registration. Elevate your learning journey with our expertly curated content. Register now to access a diverse range of educational resources designed for your success. Start learning today with ExamTopics!

Start Learning for free
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel