Architecting Big Data Applications: Real-Time Application Engineering
1h 5mAdvanced2017-10-31
Authors

Kumaran Ponnambalam
Working with data for 20+ years
Course details
Real-time systems have guaranteed response times that can be sub-seconds from the trigger. Meaning that when a user clicks a button, your app better respond—and fast. Architecting applications under real-time constraints is an even bigger challenge when you're dealing with big data. Excessive latency can cost you money, in terms of system resources consumed and customers lost. Luckily, big data technology and efficient architecture can provide the real-time responsiveness your business needs. In this course, you can learn about use cases and best practices for architecting real-time applications with technologies such as Kafka, Hazelcast, and Apache Spark.
There is no coding involved. Instead you will see how big data tools can help solve some of the most complex challenges for businesses that generate, store, and analyze large amounts of data. The use cases are drawn from a variety of industries, including ecommerce and IT. Instructor Kumaran Ponnambalam shows how to analyze a problem, draw an architectural outline, choose the right technologies, and finalize the solution. After each use case, he reviews related best practices for real-time streaming, predictive analytics, parallel processing, and pipeline management. Each lesson is rich in practical techniques and insights from a developer who has experienced the benefits and shortcomings of these technologies firsthand.
Learning objectives
Components of a big data application
Big data app development strategies
Use cases: fraud detection and product recommendations
Technology options
Designing solutions
Best practices
There is no coding involved. Instead you will see how big data tools can help solve some of the most complex challenges for businesses that generate, store, and analyze large amounts of data. The use cases are drawn from a variety of industries, including ecommerce and IT. Instructor Kumaran Ponnambalam shows how to analyze a problem, draw an architectural outline, choose the right technologies, and finalize the solution. After each use case, he reviews related best practices for real-time streaming, predictive analytics, parallel processing, and pipeline management. Each lesson is rich in practical techniques and insights from a developer who has experienced the benefits and shortcomings of these technologies firsthand.
Learning objectives
Components of a big data application
Big data app development strategies
Use cases: fraud detection and product recommendations
Technology options
Designing solutions
Best practices
Skills covered
Mobile Device ManagementData EngineeringFull-Stack Web DevelopmentData AnalysisWeb DevelopmentNetwork and System AdministrationData ScienceBusiness Analysis and StrategyBusiness Software and ToolsDeep Dive (X:Y)
Concepts
0. Introduction
- 01 - Welcome
1. Real-Time Big Data
- 02 - What is real time
- 03 - Real-time challenges
- 04 - Strategies for real-time big data processing
2. Use Case 1 - Social Media Sentiment Analysis (SM)
- 05 - SM - Analyze the problem
- 06 - SM - Outline the solution
- 07 - SM - Consider technologies
- 08 - SM - Lay out the architecture
- 09 - SM - Design key elements
- 10 - Best practices - Real-time streaming
3. Use Case 2 - Real-Time Fraud Detection (FD)
- 11 - FD - Analyze the problem
- 12 - FD - Outline the solution
- 13 - FD - Consider technologies
- 14 - FD - Lay out the architecture
- 15 - FD - Design key elements
- 16 - Best practices - Predictive analytics
4. Use Case 3 - Website Production Recommendations (PR)
- 17 - PR - Analyze the problem
- 18 - PR - Outline the solution
- 19 - PR - Consider technologies
- 20 - PR - Lay out the architecture
- 21 - PR - Design key elements
- 22 - Best practices - Parallel processing
5. Use Case 4 - Mobile Couponing (MC)
- 23 - MC - Analyze the problem
- 24 - MC - Outline the solution
- 25 - MC - Consider technologies
- 26 - MC - Lay out the architecture
- 27 - MC - Design key elements
- 28 - Best practices - Pipeline management
Conclusion
- 29 - Next steps