I have a lot of labelled data for two different labels and trained a model for each one of those. I.e. I now have a model that can predict class A
and a model that can predict class B
. The training took a couple of hours for each class.
I'd like to combine the two models into a single model that predict. A few methods to proceed:
- I could of course combine my data and retrain on all of it but I prefer not two, since I'm going to repeat this exercise for multiple labels over time.
- Update model
A
to learn about classB
and making sure it won't do any catastrophic forgetting aboutA
. Is there a good recipe for this? - Other options?
I could imagine a lot of people have come across this task so maybe someone has a great approach. Thank you in advance!