Data Engineering on AWS: Data Cataloging, Processing, Analytics, and Visualization

Data Engineering on AWS: Data Cataloging, Processing, Analytics, and Visualization

2h 18mIntermediate2023-04-20

Authors

Dipali Kulshrestha

Dipali Kulshrestha

AWS-Certified Software Programmer and Cloud Architect

Course details

Businesses need data experts—now more than ever before. As data-driven decision-making has risen to boardroom prominence, the role of the data expert has become essential to understanding and scaling a business. In this second course of a two-part series, instructor Dipali Kulshrestha focuses on data catalog, processing, analytics, and visualization. Dipali provides useful hands-on exercises—along with some challenges and solutions— to help you master these AWS engineering skills, so join her in this course to level up your skills and give your data engineering career a boost.

Skills covered

Data EngineeringAmazon Web Services (AWS)AmazonCloud ServicesCloud PlatformsCloud ComputingData ScienceOne-Off

Concepts

Introduction

  • Data engineering with AWS

Data Engineering

  • Data engineering pipeline overview

Data Catalog

  • Glue overview
  • Glue crawler
  • Glue jobs
  • AWS Glue DataBrew
  • AWS Glue Elastic Views
  • Challenge - AWS Glue
  • Solution - AWS Glue

Processing

  • Serverless processing with Lambda - Demo
  • AWS Lake Formation
  • Elastic MapReduce and Hadoop overview
  • EMR in action - Lab

Analytics

  • Kinesis Analytics overview
  • Kinesis Analytics demo
  • Amazon Elasticsearch
  • Elasticsearch demo
  • Amazon Athena overview
  • Amazon Redshift introduction and architecture
  • Amazon Redshift Spectrum and performance tuning
  • Demo - Amazon Redshift
  • Challenge - Read catalog data using Athena
  • Solution - Read catalog data using Athena

Visualization

  • Visualization introduction
  • Amazon QuickSight overview
  • Visualization types with QuickSight
  • Amazon QuickSight demo

Conclusion

  • Next steps
80,000 Toman