exam questions

Exam AI-102 All Questions

View all questions & answers for the AI-102 exam

Exam AI-102 topic 7 question 4 discussion

Actual exam question from Microsoft's AI-102
Question #: 4
Topic #: 7
[All AI-102 Questions]

You are building a chatbot for a travel agent. The chatbot will use the Azure OpenAI GPT 3.5 model and will be used to make travel reservations.

You need to maximize the accuracy of the responses from the chatbot.

What should you do?

  • A. Configure the model to include data from the travel agent's database.
  • B. Set the Top P parameter for the model to 0.
  • C. Set the Temperature parameter for the model to 0.
  • D. Modify the system message used by the model to specify that the answers must be accurate.
Show Suggested Answer Hide Answer
Suggested Answer: A 🗳️

Comments

Chosen Answer:
This is a voting comment (?). It is better to Upvote an existing comment if you don't have anything to add.
Switch to a voting comment New
GHill1982
Highly Voted 9 months ago
Selected Answer: A
Could this not be A? Configuring the model to include data from the travel agent’s database would allow the chatbot to access a source of relevant and specific information, which can significantly improve the accuracy of its responses. Fine-tuning the model with data specific to the travel agent’s services and customer interactions can lead to more precise and contextually appropriate answers.
upvoted 10 times
...
friendlyvlad
Most Recent 1 week ago
Selected Answer: C
Adding more data as in A will not necessarily improve the accuracy of the responses
upvoted 1 times
...
RajuTS
2 months, 2 weeks ago
Selected Answer: C
The question s about how to ensure the model responses are accurate and not randomly made up creatively Hence the answer is Option C to set the lower temperature that can ensure model is less creative and more factual
upvoted 2 times
...
JakeCallham
3 months, 2 weeks ago
Selected Answer: A
Im laughing out loud by the ones who say D. Seriously? Ever worked with openai?
upvoted 2 times
...
krzkrzkra
5 months ago
Selected Answer: A
Selected Answer: A
upvoted 1 times
...
nanaw770
6 months ago
Selected Answer: A
A is correct answer.
upvoted 1 times
...
etellez
6 months ago
GitHub Copilot has the answer Set Temperature to 0 To maximize the accuracy of the responses from the chatbot, you should: C. Set the Temperature parameter for the model to 0. The temperature parameter controls the randomness of the model's output. A lower temperature will cause the model to make the most likely prediction at each step, making the output more deterministic and focused, thus potentially increasing the accuracy of the responses.
upvoted 3 times
exnaniantwort
5 months, 3 weeks ago
Temperature: Range: Typically between 0 and 1 Implications: Lower values (close to 0): The model output is more deterministic, meaning it tends to produce more predictable and repetitive text. Useful for tasks requiring high precision. Higher precision doesn't mean higher accuracy
upvoted 2 times
...
...
anto69
6 months, 2 weeks ago
Selected Answer: D
Accuracy is granted by initial prompt. D
upvoted 1 times
JakeCallham
3 months, 2 weeks ago
No it isn't dude, lmao. GPT halucinate like crazy, only way to prevent this is present data that it can use to answer.
upvoted 1 times
famco
3 months, 1 week ago
RAG yes, but please not fine tuning. That cannot be the answer
upvoted 2 times
...
...
...
vovap0vovap
6 months, 3 weeks ago
It worse nothing, that even MS labs is used travel agency staff grounding information for a models.
upvoted 1 times
...
chandiochan
7 months, 3 weeks ago
Selected Answer: D
Must be D
upvoted 1 times
JakeCallham
3 months, 2 weeks ago
wrong, supplying data will make the answers more correct
upvoted 1 times
...
...
shorymor
7 months, 4 weeks ago
Selected Answer: A
Answer is A. Documentation is clear about providing with data to the model in order to avoid errors and therefore receive accurate answers. https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/advanced-prompt-engineering?pivots=programming-language-chat-completions#provide-grounding-context
upvoted 4 times
famco
3 months, 1 week ago
that you refer to is RAG, but the A option looks more like fine-tuning. But with Microsoft you never know.
upvoted 1 times
...
...
michaelmorar
7 months, 4 weeks ago
Selected Answer: A
A system message is designed to give the model instructions, perspective from which to answer, and other helpful information. It might include, Personality, Tone, Topics to exclude, and specifics such as formatting of answer. It does NOTHING for accuracy - that is purely incumbent on the training data.
upvoted 2 times
...
f2c587e
8 months, 2 weeks ago
Al especificarle al bot una fuente de datos que sirva como base de conocimiento sus respuestas seran mas precisas en cuanto a la base de conocimiento que se suministre.
upvoted 1 times
...
Murtuza
8 months, 3 weeks ago
To maximize the accuracy of responses from the chatbot, you should modify the system message used by the model to explicitly specify that the answers must be accurate. By providing clear instructions to the model about the desired accuracy, you can guide it to generate more precise and reliable responses. This approach ensures that the chatbot focuses on accuracy while interacting with users. Therefore, the correct answer is D: Modify the system message used by the model to specify that the answers must be accurate
upvoted 1 times
michaelmorar
7 months, 4 weeks ago
This is wrong.
upvoted 1 times
...
...
Mehe323
9 months ago
Selected Answer: D
I think it is D too. https://learn.microsoft.com/en-us/training/modules/apply-prompt-engineering-azure-openai/4-provide-context-to-improve-accuracy?pivots=python
upvoted 3 times
JakeCallham
3 months, 2 weeks ago
Yes you provide context in the system prompt, but first you need to get the context by quering a vector database.
upvoted 1 times
...
...
Murtuza
9 months, 1 week ago
While configuring the model with data from the travel agent’s database (option A) could be beneficial,
upvoted 3 times
...
7afddb1
9 months, 1 week ago
Selected Answer: D
D. Modify the system message used by the model to specify that the answers must be accurate. This option involves priming the model with a specific instruction or context that emphasizes the importance of accuracy in the responses. By doing so, you set a clear expectation for the model to prioritize accuracy when generating responses. This method can be particularly effective when dealing with domain-specific queries where accurate information is crucial, such as travel dates, destinations, and reservation details.
upvoted 2 times
...
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel
Loading ...
exam
Someone Bought Contributor Access for:
SY0-701
London, 1 minute ago