Data Platforms: Spark to Snowflake
54mBeginner2024-09-17
Authors

Pragmatic AI Labs

Kennedy Behrman
Course details
Explore the expansive realm of big data in this course from industry leader Pragmatic AI Labs. Instructor Kennedy Behrman covers the essentials of big data processing on key platforms like Apache Hadoop, Apache Spark, and Snowflake. Throughout the course, learn how to work with resilient distributed datasets (RDDs) and leverage Spark SQL for managing dataframes. Delve into Snowflake to understand its unique architecture, navigate its web UI, and utilize its Python connector for data manipulation. Along the way, engaging demos provide opportunities for you to get hands-on experience with each platform, ensuring you not only grasp the theoretical concepts but also how to apply them in practical scenarios. Whether you're a data scientist, a data analyst, an IT professional, or simply eager to learn more about big data, this course offers valuable insights and skills on some of the most cutting-edge data management technologies available today.
Skills covered
SnowflakeApache SparkCloud StorageApacheData EngineeringDatabase DevelopmentDatabase ManagementCloud ServicesCloud ComputingData ScienceSoftware DevelopmentOne-Off
Concepts
Introduction and Big Data Platforms
- 01 - Introduction to your instructor, Kennedy Behrman
- 02 - Introduction to big data platforms
- 03 - Apache Hadoop
- 04 - Apache Spark
1. Hadoop and Spark
- 05 - Resilient distributed dataset (RDD)
- 06 - RDD demo
2. Spark SQL
- 07 - Spark SQL
- 08 - Dataframes demo, part 1
- 09 - Dataframes demo, part 2
3. Snowflake
- 10 - What is Snowflake
- 11 - Snowflake layers
- 12 - Snowflake web UI
- 13 - Navigating Snowflake
- 14 - Creating tables with Snowflake
- 15 - Snowflake warehouses
- 16 - Snowflake Python connector
- 17 - Reading from Snowflake with Python