Azure Data Engineer Associate (DP-203) Cert Prep: 1 Design and Implement Data Storage
55mIntermediate2022-01-06
Authors
Noah Gift
MLOps Expert | Solopreneur | Author | Adjunct Professor | CTO
Course details
Are you preparing for the Microsoft Azure Data Engineering (DP-203) exam, or just looking for a stronger understanding of how to design and implement data storage? Either way, this course, the first in a series, can help you. Noah Gift, founder of Pragmatic A.I. Labs and a Python Software Foundation Fellow, shows you how to design and implement data storage on Azure. Noah walks you through the full process of designing a data storage structure, from designing an Azure Data Lake solution to designing a data archiving solution. He explains horizontal, vertical, and functional data partitioning strategies and how to choose which strategy will work best for your data. Noah goes over designing both analytical stores and metastores, then dives into implementing table geometries, data storage structures, data architectures, and more.
Skills covered
Data EngineeringAzureNetwork AdministrationCloud PlatformsCert PrepNetwork and System AdministrationCloud ComputingData ScienceMicrosoft
Concepts
0. Introduction
- 01 - Design and implement data storage on Microsoft Azure
- 02 - Quick prerequisite technology overview
1. Design a Data Storage Structure
- 03 - Design an Azure Data Lake solution
- 04 - Recommend file types for storage
- 05 - Recommend file types for analytical queries
- 06 - Design for efficient querying
- 07 - Design for data pruning
- 08 - Design a folder structure
- 09 - Design a distribution strategy
- 10 - Design a data archiving solution
2. Design a Partition Strategy
- 11 - Overview of data partitioning
- 12 - Partition strategy
3. Design the Serving Layer
- 13 - Design analytical stores
- 14 - Design metastores
4. Implement Physical Data Storage Structures
- 15 - Implement different table geometries
- 16 - Implement data storage structures
5. Implement Data Architectures
- 17 - Implement data architectures, structures, and serving
Conclusion
- 18 - Summary and next steps