Regressing machine learning model

Help AI Center
,
1

Hi all.

I have a machine learning model that is getting worse each day. How do I investigate the causes? Do I look at the classifications and validations that have been done before? Is there anything else I need to look at?

I would really appreciate the help.

Kind regards

2

@Loveness01

Are you retraining it?

If yes then is it retrained on the base model always?

Cheers

3

Hi @Loveness01

Here are steps to help you diagnose and address the issue:

  1. Check Data Quality and Distribution:

    • Ensure that the data your model is trained on hasn’t changed significantly. Data quality issues, such as missing values, outliers, or noisy data, can affect model performance.

  2. Data Drift Analysis:

    • Monitor for data drift, where the distribution of your input data (features) changes over time. This can impact the model’s performance. Use statistical tests and visualization techniques to detect drift.

Thanks!!

1 Like
4

Well there could be many possible reason behind
I will try to point out some of them that can be validated on priority

Let’s go one by one

Classifications and validations:
As you said it is important to track the model’s performance on both training and validation data over time. If the model’s performance on the validation data is decreasing, this is a sign that the model is overfitting to the training data.

New data:

It is equally important to know if your model is being exposed to new data that is different from the data that it was trained on, this could also lead to a decrease in performance.
This is something I have faced which ended in retraining the model. So better have a view on it

Changes to the model:

If you have made any changes to the model, such as changing the hyperparameters or the algorithm, this could also affect the model’s performance.

Changes to the environment and format:

If the environment in which the model is being used has changed, such as if the data format has changed or if the hardware has changed, this could also affect the model’s performance.

Hope this helps

Cheers @Loveness01

1 Like
5

This has given me a good starting point, thank you.

1 Like
6

Yes it is always trained on the base model.

7

Awesome

If clarified…. Yes
Then I would recommend to close this topic

Cheers @Loveness01