Transfer Learning for Images Using PyTorch: Essential Training

Transfer Learning for Images Using PyTorch: Essential Training

58mIntermediate2019-10-08

Authors

Jonathan Fernandes

Jonathan Fernandes

Consultant focusing on data science, AI, and big data

Course details

After its debut in 2017, PyTorch quickly became the tool of choice for many deep learning researchers. In this course, Jonathan Fernandes shows you how to leverage this popular machine learning framework for a similarly buzzworthy technique: transfer learning. Using a hands-on approach, Jonathan explains the basics of transfer learning, which enables you to leverage the pretrained parameters of an existing deep-learning model for other tasks. He then shows how to implement transfer learning for images using PyTorch, including how to create a fixed feature extractor and freeze neural network layers. Plus, find out about using learning rates and differential learning rates.

Learning objectives
What is transfer learning?
Using autograd
Creating a fixed feature extractor
Training an extractor
Fine-tuning the ConvNet
Learning rates and differential learning rates

Skills covered

PyTorchMachine LearningPythonEssential TrainingArtificial Intelligence (AI)Open Source

Concepts

Introduction

  • Welcome
  • What you should know before watching this course

What Is Transfer Learning

  • What is transfer learning
  • VGG16
  • CIFAR-10 dataset

Transfer Learning - Fixed Feature Extractor

  • Creating a fixed feature extractor
  • Understanding loss - CrossEntropyLoss() and NLLLoss()
  • Autograd
  • Using autograd
  • Training the fixed feature extractor
  • Optimizers
  • CPU to GPU
  • Train the extractor
  • Evaluate the network and viewing images
  • Viewing images and normalization
  • Accuracy of the model

Fine-Tuning the ConvNet

  • Fine-tuning
  • Using fine-tuning
  • Training from the fully connected network onwards
  • Unfreezing and training over the last CNN block onwards
  • Unfreezing and training over the last two CNN block onwards

Further Techniques

  • Learning rates
  • Differential learning rates

Conclusion

  • Next steps
40,000 Toman