Advanced Data Processing: Batch, Real-Time, and Cloud Architectures for AI
1h 31mIntermediate2025-05-12
Authors

Kumaran Ponnambalam
Working with data for 20+ years
Course details
As AI becomes more and more integrated into enterprise applications and workflows, architecting robust and scalable AI systems becomes even more important, particularly if you’re a data scientist or AI engineer. Beyond mastering machine learning techniques and technologies, an engineer working in AI needs to be able to leverage expertise in architecting AI and ML pipelines that achieve business outcomes at scale. In this course, instructor Kumaran Ponnambalam focuses on the big picture of bringing together models, data, applications, and infrastructure to create robust architectures. By the end of this course, you’ll be prepared to design, manage, and adhere to best practices for different architecture patterns—including batch, real-time, cloud, and hybrid.
Learning objectives
Understand the unique characteristics and design constraints for different types of AI architectures.
Define the key architecture elements of AI across batch, real-time, cloud, and hybrid.
Create an architecture for a given use case by analyzing requirements and choosing the right patterns and technologies.
Scale the architecture to increase concurrency, response times, and throughput.
Learning objectives
Understand the unique characteristics and design constraints for different types of AI architectures.
Define the key architecture elements of AI across batch, real-time, cloud, and hybrid.
Create an architecture for a given use case by analyzing requirements and choosing the right patterns and technologies.
Scale the architecture to increase concurrency, response times, and throughput.
Skills covered
Data CentersAI for Data Engineers and ScientistsReal-TimeRole-Based AI ApplicationsCloud DevelopmentData EngineeringDatabase ManagementVisualization and Real-TimeAECProduct and ManufacturingCloud ComputingData ScienceOne-Off
Concepts
Introduction
- Processing data for AI
AI Architectures
- The ML life cycle
- Feature engineering
- Model training
- ML inference
- Scale and performance
- Architectures for AI
Batch AI Architectures
- Characteristics of batch AI
- Batch feature engineering
- Batch model training
- Batch Inference
- Scaling batch AI
- Batch AI architecture example - Problem
- Batch AI architecture example - Solution
Real-Time AI Architectures
- Characteristics of real-time AI
- Real-time feature engineering
- Real-time model training
- Real-time inference architectures
- Scaling real-time AI
- Real-time AI architecture example - Problem
- Real-time AI architecture example - Solution
Cloud AI Architectures
- Cloud and serverless computing
- Architecting for the cloud
- AI in the cloud
- Cloud platforms for AI
- Cloud AI architecture example - Problem
- Cloud AI architecture example - Solution
Hybrid AI Architectures
- Hybrid computing
- AI using hybrid computing
- AI architectures for hybrid computing
- Hybrid AI architecture example - Problem
- Hybrid AI architecture example - Solution
Conclusion
- Continuing with AI data processing