Advanced Data Engineering with Snowflake
2h 3mIntermediate2025-05-28
Authors

Snowflake, Inc
Course details
This is a technical, hands-on course that teaches you how to implement DevOps best practices to build data pipelines, and how to implement observability to maintain and monitor data pipeline health. Discover the most practical Snowflake concepts, features, and tools to help you get you up and running quickly on the platform. Get started by learning about DevOps, DevOps practices, and how DevOps fits into the context of data engineering. Find out how to incorporate source control, declarative management of database objects, continuous delivery, and use the command-line interface to implement DevOps best practices into a data pipeline. Throughout the course, you’ll follow along with the instructor using a combination of Snowflake, VS Code, GitHub, and the command line.
Learning objectives
Implement DevOps best practices for data pipelines with Snowflake.
Leverage Snowflake's Git integration to add source control to your data pipeline.
Use GitHub for team-wide collaboration on your data pipeline.
Apply CREATE OR ALTER to declaratively manage database objects.
Implement continuous delivery for your pipeline using GitHub Actions.
Deploy changes into dedicated data environments from the Snowflake command-line interface.
Implement observability to maintain and monitor the health and performance of your data pipeline.
Keep detailed records of events that occur within your pipeline using logs and traces.
Utilize alerts to monitor for specific conditions in your pipeline, and combine them with notifications to encourage action among team members if critical errors occur in the pipeline.
Learning objectives
Implement DevOps best practices for data pipelines with Snowflake.
Leverage Snowflake's Git integration to add source control to your data pipeline.
Use GitHub for team-wide collaboration on your data pipeline.
Apply CREATE OR ALTER to declaratively manage database objects.
Implement continuous delivery for your pipeline using GitHub Actions.
Deploy changes into dedicated data environments from the Snowflake command-line interface.
Implement observability to maintain and monitor the health and performance of your data pipeline.
Keep detailed records of events that occur within your pipeline using logs and traces.
Utilize alerts to monitor for specific conditions in your pipeline, and combine them with notifications to encourage action among team members if critical errors occur in the pipeline.
Skills covered
SnowflakeCloud StorageDevOps FoundationsData EngineeringDatabase DevelopmentDevOpsDatabase ManagementCloud ServicesCloud ComputingData ScienceSoftware DevelopmentOne-Off
Concepts
0. Introduction
- 01 - Scaling data pipelines to meet modern demands
- 02 - What this course will cover
1. DevOps with Snowflake
- 03 - DevOps in the world of data engineering
- 04 - DevOps with Snowflake
- 05 - What we'll build
- 06 - Source control in Snowflake with Git
- 07 - Set up the data pipeline using snowflake CLI
- 08 - Database change management (DCM)
- 09 - Declarative approach with CREATE OR ALTER
- 10 - Continuous integration and continuous delivery (CI CD) for data pipelines
- 11 - Implementing continuous delivery for our data pipeline
- 12 - Recap and best practices for DevOps with Snowflake
2. Observability with Snowflake
- 13 - Observability for data engineering
- 14 - Foundational concepts of observability
- 15 - Observability with Snowflake Trail
- 16 - Event Tables in Snowflake
- 17 - Logging in Snowflake
- 18 - Traces in Snowflake
- 19 - Alerts in Snowflake
- 20 - Notifications in Snowflake
- 21 - Observability with third-party tools
- 22 - Recap and best practices for observability with Snowflake
- 23 - Conclusion