Databricks Certified Data Engineer Associate Cert Prep
2h 19mIntermediate2025-03-18
Authors
Noah Gift
MLOps Expert | Solopreneur | Author | Adjunct Professor | CTO
Course details
In this course, prepare for the Databricks Certified Data Engineer Associate exam. Instructor Noah Gift takes you through the topics you need to know, starting with an introduction to the Databricks Lakehouse platform. He then goes into data transformation with Apache Spark, data management with Delta Lake, data pipelines with Delta Live Tables, workloads with jobs, and wraps up the course with a look at data access with Unity Catalog.
Skills covered
Data EngineeringData AnalysisCert PrepData ScienceBusiness Analysis and StrategyBusiness Software and Tools
Concepts
0. Introduction
- 01 - Course overview
1. Databricks Lakehouse Platform
- 02 - Introduction to the Databricks Lakehouse platform
- 03 - Overview of the Databricks architecture
- 04 - Creating and managing clusters
- 05 - Configuring cluster runtimes
- 06 - Terminating clusters
- 07 - Restarting clusters
- 08 - Filtering the clusters list
- 09 - All-purpose vs. job clusters
2. Data Transformation with Apache Spark
- 10 - Set up IntelliJ for Databricks with Go
- 11 - Installing and using the Databricks CLI
- 12 - Installing and using Databricks for RStudio
- 13 - Introduction to notebooks
- 14 - Executing notebooks
- 15 - Sharing notebooks
- 16 - Multilanguage support
- 17 - Databricks Repos overview
3. Data Management with Delta Lake
- 18 - Efficient data transformation with Spark SQL
- 19 - Using Catalog Explorer
- 20 - Creating tables from files
- 21 - Querying external data sources
- 22 - Inspecting tables
- 23 - Reliable data pipelines with Delta Lake
- 24 - ACID transactions
- 25 - Z-ordering optimization
4. Data Pipelines with Delta Live Tables
- 26 - Vacuuming and garbage collection
- 27 - Table documentation
- 28 - Automated pipelines with Delta Live Tables
- 29 - Delta Live Tables components
- 30 - Continuous vs. triggered pipelines
- 31 - Configuring Auto Loader
- 32 - Querying pipeline events
- 33 - End-to-end example of Delta Live Tables
5. Workloads with Jobs
- 34 - Orchestrating workloads with jobs
- 35 - Databricks jobs demo
- 36 - Multitask workflows
- 37 - Task dependencies
- 38 - Viewing job history
- 39 - Using dashboards
- 40 - Handling failures
- 41 - Configuring retries
6. Data Access with Unity Catalog
- 42 - Unified data access with Unity Catalog
- 43 - Catalogs vs. metastores
- 44 - Unity Catalog quick start with Python
- 45 - Applying object security
- 46 - Best practices for catalogs
- 47 - Best practices for connections
- 48 - Best practices for business units