Exam AWS Certified AI Practitioner AIF-C01 topic 1 question 88 discussion

The correct answer is B. Automatic model evaluation requires minimal human intervention, making it operationally lighter than human-based approaches.

B. Automatic model evaluation Explanation: Using automatic model evaluation is the most efficient and low-overhead approach to evaluate the toxicity of the generated outputs from different LLMs. This strategy involves using automated tools or frameworks designed to assess the toxicity, bias, or other quality metrics of the model outputs, which minimizes operational overhead compared to manual methods.

automatic model evlauation Automatic model evaluation refers to the process of assessing the performance of a machine learning model using predefined metrics and techniques without manual intervention. This process is crucial for understanding how well a model performs and identifying areas for improvement. Here are some key components and methods used in automatic model evaluation: