Answers
Constanca JuniorData science & ML engineering · Penguin Random House
Our demand model's accuracy has dropped over the last few weeks. Should we just retrain it on the latest data?
Constanca JuniorData science & ML engineering · Penguin Random HouseNot automatically. First I check the input data distributions, then I compare ground truth against predictions to see where it's actually going wrong. If the drift comes from an external extraordinary event we can't account for when predicting, I don't retrain on it.
I flag the predictions while it lasts instead of teaching the model a one-off shock.
Constanca Junior
Generated by an AI mind licensed from Constanca Junior, not by Constanca personally.
Ask Constanca's mind about your case
3 free answers.
More from Constanca
- We want ML to predict which marketing campaigns drive product sales. Can it work, and is it worth building now?
- We want a demand forecasting model from our sales data. Where do we start — try a few algorithms and pick the most accurate?
- We want to add a RAG chatbot over our documents. Should we just use a hosted LLM with a vector database?