Advanced Data Lake Management and Governance with AWS Lake Formation
2h 46mAdvanced2025-06-25
Authors

Dipali Kulshrestha
AWS-Certified Software Programmer and Cloud Architect
Course details
In this advanced course on AWS Lake Formation, AWS-certified software programmer Dipali Kulshrestha equips you with the knowledge and skills to build, manage, and govern secure data lakes at scale. Learn how to set up a data lake from scratch, configure fine-grained permissions, and implement robust data governance controls using both IAM and Lake Formation permissions. Delve into cross-account data sharing so that you can ensure secure data collaboration across different AWS environments. Plus, explore advanced data processing techniques using AWS services like Athena, Glue, and EMR. When you complete this course, you’ll know how to optimize and secure data lakes for real-world enterprise use cases and how to address complex governance and access challenges.
Learning objectives
Set up and manage data lakes using AWS Lake Formation, implementing best practices for data ingestion, cataloging, and registration of data sources to ensure efficient and secure data storage.
Master the ability to enforce fine-grained permissions and access control for different data roles (data analysts, scientists, administrators), leveraging both IAM and Lake Formation permissions to securely govern data access.
Understand how to securely share data lake assets across AWS accounts using both IAM-based and Lake Formation-based permissions, ensuring compliance with enterprise data governance policies while facilitating collaboration.
Integrate AWS Lake Formation with services like AWS Athena, Glue, and EMR to query, transform, and process data, enabling efficient and scalable analysis workflows within the governed data lake.
Manage complex data access scenarios using Lake Formation's hybrid access models, ensuring that both IAM and Lake Formation permissions work harmoniously to address data access challenges.
Learning objectives
Set up and manage data lakes using AWS Lake Formation, implementing best practices for data ingestion, cataloging, and registration of data sources to ensure efficient and secure data storage.
Master the ability to enforce fine-grained permissions and access control for different data roles (data analysts, scientists, administrators), leveraging both IAM and Lake Formation permissions to securely govern data access.
Understand how to securely share data lake assets across AWS accounts using both IAM-based and Lake Formation-based permissions, ensuring compliance with enterprise data governance policies while facilitating collaboration.
Integrate AWS Lake Formation with services like AWS Athena, Glue, and EMR to query, transform, and process data, enabling efficient and scalable analysis workflows within the governed data lake.
Manage complex data access scenarios using Lake Formation's hybrid access models, ensuring that both IAM and Lake Formation permissions work harmoniously to address data access challenges.
Skills covered
Data EngineeringAmazon Web Services (AWS)AmazonData AnalysisData ScienceBusiness Analysis and StrategyBusiness Software and ToolsDeep Dive (X:Y)
Concepts
Introduction
- Advanced AWS Lake Formation for real-world governance
Introduction to Data Lakes and AWS Lake Formation
- Why data lakes
- Overview of AWS Lake Formation
- Lake Formation fine-grained permissions
- Lake Formation key terminologies
Build Your Data Lake - The Legacy Approach
- Set up a data lake
- Configure the data catalog
- Consumer setup
- Set up a data analyst as a data consumer, part 1
- Set up a data analyst as a data consumer, part 2
- Set up a data analyst as a data consumer in a cross account
- Challenges with the IAM approach
Set Up Your AWS Environment
- Overview of the AWS Lake Formation console
- Set up the AWS Lake Formation administrator
Build Your Data Lake for AWS Lake Formation
- Set up a data lake structure and ingest data
- Configure the data catalog
- Registering a bucket with AWS Lake Formation
Implement Data Governance with AWS Lake Formation Permissions
- AWS Lake Formation permissions management workflow
- Make a data scientist user a data consumer in the same account
- Share data lake assets with AWS Lake Formation permissions
- Accessing datasets as a data scientist
- Fine-grained access control for data scientists
Cross-account Data Sharing with AWS Lake Formation Permissions
- Set up cross-account data access using AWS Lake Formation
- Set up a consumer account as a cross-account administrator
- Share data lake resources with a cross-account administrator
- Accept AWS RAM shares in a consumer account
- Set up a data scientist user in a cross account
- Create a resource link for a shared data catalog asset
- Permissions from the consumer AWS Lake Formation admin
- Access data as a data scientist
Implement Data Governance with AWS Lake Formation Hybrid
- Challenges while using AWS Lake Formation permissions only
- Register a data lake with AWS Lake Formation hybrid mode
- AWS Lake Formation permissions management workflow
- Demo using AWS Lake Formation hybrid opt-in
Advanced Data Processing
- Use data with Amazon EMR Serverless
- Transform data with AWS Glue ETL
Conclusion
- Learn more about data lakes on AWS