Re-train on new data

How is this different from transfer learning?

Transfer learning: applied pre-trained model to a different dataset

Workflow:

1. Take layers from a previously trained model.

2. Freeze them, so as to avoid destroying any of the information they contain during future training rounds.

3. Add some new, trainable layers on top of the frozen layers. They will learn to turn the old features into predictions on a new dataset.

4. Train the new layers on your dataset.