Welcome to ExamTopics
ExamTopics Logo
- Expert Verified, Online, Free.
Mail Us[email protected]
Menu
Databricks Discussions
exam questions

Exam Certified Generative AI Engineer Associate All Questions

View all questions & answers for the Certified Generative AI Engineer Associate exam
Go to Exam

Exam Certified Generative AI Engineer Associate topic 1 question 31 discussion

Actual exam question from Databricks's Certified Generative AI Engineer Associate
Question #: 31
Topic #: 1
[All Certified Generative AI Engineer Associate Questions]

After changing the response generating LLM in a RAG pipeline from GPT-4 to a model with a shorter context length that the company self-hosts, the Generative AI Engineer is getting the following error:

What TWO solutions should the Generative AI Engineer implement without changing the response generating model? (Choose two.)

  • A. Use a smaller embedding model to generate embeddings
  • B. Reduce the maximum output tokens of the new model
  • C. Decrease the chunk size of embedded documents
  • D. Reduce the number of records retrieved from the vector database
  • E. Retrain the response generating model using ALiBi
Show Suggested Answer Hide Answer
Suggested Answer: CD 🗳️
by trendy01 at Oct. 26, 2024, 5:58 a.m.

Comments

Chosen Answer:
This is a voting comment (?) , you can switch to a simple comment.
Switch to a voting comment New
Submit Cancel
trendy01
4 weeks, 1 day ago
Selected Answer: CD
C: You can reduce the number of tokens included in the prompt by reducing the chunk size of the embedded document. D: Reducing the number of records retrieved from the vector database can solve the token overflow issue by reducing the size of the final prompt.
upvoted 1 times
...

Get IT Certification

Unlock free, top-quality video courses on ExamTopics with a simple registration. Elevate your learning journey with our expertly curated content. Register now to access a diverse range of educational resources designed for your success. Start learning today with ExamTopics!

Start Learning for free
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel