Transfer learning is a machine learning technique that uses a previously trained model as the starting point for a new, yet related model. Reusing a model saves compute time and helps manage model accuracy.
The most common transfer learning techniques are feature extraction and fine-tuning. The techniques differ in how the base layer is treated. Feature extraction freezes the base layer; fine-tuning adjusts the base layer.
What Makes a Model Similar?
Often the best strategy for transfer learning is to start with a proven architecture for your network. When selecting a model, consider the following questions.
How similar is the dataset in terms of categories? (For example, dogs versus cats.) How similar is the type of model architecture? (For example, ResNet* and edges.) How similar is the type of task? (For example, image classification versus object detection.)
To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behaviour or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions.
Functional
Always active
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
Preferences
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
Statistics
The technical storage or access that is used exclusively for statistical purposes.The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
Marketing
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.