Exam Professional Data Engineer topic 1 question 2 discussion

I think it should be B because we have to use a combination of old and new test data as well as training data

B, as we need to train the data with new data, so that it will keep learning, and as well as used for test

From my point of view, we should take both datasets.

Option A is not recommended because retraining the model on just new data will cause the model to lose the information it has learned from the historical data. Option C and D are not recommended because they are using the new data as test set and this approach will lead to a model that is overfitting and not generalize well to new users. So answer is B

Answer is C. It is time sensitive data so latest data should be used for testing. Reference: https://cloud.google.com/automl-tables/docs/prepare#ml-use

This approach allows the model to benefit from both the historical data (existing data) and the new data, ensuring that it adapts to changing preferences while retaining knowledge from the past. By combining both types of data, the model can learn to make recommendations that are up-to-date and relevant to users' evolving preferences.

train on old and new data

Option B is the right answer. Since the questions states the models needs to be updated since the clothing preference changes. Hence we need the new data to be utilized for training/ updating model.

Have verified this

there are two point first when retraining second what data. I think retraining should be occur when the model could not predict well in this case there is monitoring metric should be needed first but no one said, second what data? in this case I think the answer is A. because when the model could not predict well it means the data variance and bias are changed so, it's no make sense what is combination new data with old data because the data being not be changed is not necessary anymore..

The trend keep changing, so must mix new and old data...

B. Continuously retrain the model on a combination of existing data and the new data. This approach will help to ensure that the model remains up-to-date with the latest fashion preferences of the users, while also leveraging the historical data to provide context and improve the accuracy of the recommendations. Retraining the model on a combination of existing and new data will help to prevent the model from being overly influenced by the new data and losing its ability to generalize to users with different preferences. Option A is not recommended because retraining the model on just new data will cause the model to lose the information it has learned from the historical data. Option C and D are not recommended because they are using the new data as test set and this approach will lead to a model that is overfitting and not generalize well to new users.

The answer can be A, if we implement online learning! But for regular model which can't implement online learning (everything with no gradient descent) the answer should be B.

Correct answer is B

B is the correct answer

B is the correct answer. Model training using existing data + new data will allow model to learn new behaviour of users while retaining some of the older behaviour to make model.

B seems like the best option because we need to make the prediction based on the latest preferences by an individual also we need not forget how the user used to prefer before .It's highly unlikely that a person's fashion sense changes a lot.