Apache Spark Deep Learning Essential Training

Apache Spark Deep Learning Essential Training

42mIntermediate2019-07-01

Authors

Jonathan Fernandes

Jonathan Fernandes

Consultant focusing on data science, AI, and big data

Course details

Apache Spark is widely considered to be the top platform for professionals needing to glean more comprehensive insights from their data. In this course, explore one of the most exciting aspects of this big data platform—its ability to do deep learning with images. Before he fully delves into deep learning on Spark using Python, instructor Jonathan Fernandes goes over the different ways to do deep learning in Spark, as well as key libraries currently available. He then shows how to set up your Spark deep learning environment, work with images in Spark using the Databricks deep learning library, use a pre-trained model and transfer learning, and deploy models as SQL functions.

Learning objectives
Components in the Apache Spark ecosystem
What is deep learning?
Using deep learning in Spark
Working with images in Spark
Using pre-trained models
Testing your model
Deploying models as SQL functions

Skills covered

Spark DataFramesNeural Networks and Deep LearningData EngineeringEssential TrainingArtificial Intelligence (AI)Data Science

Concepts

Introduction

  • Apache Spark
  • What you should know before watching this course
  • Setting up a Databricks account

Introduction to Apache Spark

  • Apache Spark ecosystem
  • The origins of Spark and Databricks

Deep Learning

  • What is deep learning
  • Using deep learning in Spark
  • Deep learning libraries

Working with Images in Spark

  • Setting up a Databricks environment
  • Working with images

Pretrained Models and Transfer Learning

  • Using pretrained models
  • What is transfer learning
  • Transfer learning in action
  • Testing your new model

Using Models as SQL Functions

  • Deploying models as SQL functions

Conclusion

  • Future project ideas
40,000 Toman