Apache Spark Deep Learning Essential Training
42mIntermediate2019-07-01
Authors

Jonathan Fernandes
Consultant focusing on data science, AI, and big data
Course details
Apache Spark is widely considered to be the top platform for professionals needing to glean more comprehensive insights from their data. In this course, explore one of the most exciting aspects of this big data platform—its ability to do deep learning with images. Before he fully delves into deep learning on Spark using Python, instructor Jonathan Fernandes goes over the different ways to do deep learning in Spark, as well as key libraries currently available. He then shows how to set up your Spark deep learning environment, work with images in Spark using the Databricks deep learning library, use a pre-trained model and transfer learning, and deploy models as SQL functions.
Learning objectives
Components in the Apache Spark ecosystem
What is deep learning?
Using deep learning in Spark
Working with images in Spark
Using pre-trained models
Testing your model
Deploying models as SQL functions
Learning objectives
Components in the Apache Spark ecosystem
What is deep learning?
Using deep learning in Spark
Working with images in Spark
Using pre-trained models
Testing your model
Deploying models as SQL functions
Skills covered
Spark DataFramesNeural Networks and Deep LearningData EngineeringEssential TrainingArtificial Intelligence (AI)Data Science
Concepts
Introduction
- Apache Spark
- What you should know before watching this course
- Setting up a Databricks account
Introduction to Apache Spark
- Apache Spark ecosystem
- The origins of Spark and Databricks
Deep Learning
- What is deep learning
- Using deep learning in Spark
- Deep learning libraries
Working with Images in Spark
- Setting up a Databricks environment
- Working with images
Pretrained Models and Transfer Learning
- Using pretrained models
- What is transfer learning
- Transfer learning in action
- Testing your new model
Using Models as SQL Functions
- Deploying models as SQL functions
Conclusion
- Future project ideas