Using Apache Spark with .NET
1h 20mIntermediate2021-01-20
Authors

Brigit Murtaugh
Program Manager at Microsoft

Microsoft .NET
.NET Developers and Program Managers at Microsoft
Course details
Kick-start your journey into big data analytics with this introductory course about .NET for Apache Spark. Instructor Brigit Murtaugh explains how .NET for Apache Spark will empower you to participate in the world of big data within the .NET ecosystem. She shows you how to create a simple .NET for Apache Spark word count application and run it on your local machine, then shows you how to write a batch processing app. Next, she steps you through a structured streaming app that processes words live as you type them into a terminal. Brigit covers how to leverage ML.NET in combination with .NET for Apache Spark to perform sentiment analysis on a set of online reviews. She teaches you how to deploy your .NET for Apache Spark app to Azure Databricks. Then she concludes by demonstrating how to deploy the .NET for Apache Spark app to Azure HDInsight.
Skills covered
Apache SparkApacheData EngineeringSoftware Development ToolsEssential TrainingData ScienceSoftware Development
Concepts
1. Using Apache Spark with .NET
- 01 - What is .NET for Apache Spark
- 02 - Run your first .NET for Apache Spark app
- 03 - Batch processing with .NET for Apache Spark
- 04 - Structured streaming with .NET for Apache Spark
- 05 - Sentiment analysis with .NET for Apache Spark and ML.NET, part 1
- 06 - Sentiment analysis with .NET for Apache Spark and ML.NET, part 2
- 07 - Deploy .NET for Apache Spark app to Azure Databricks
- 08 - Deploy .NET for Apache Spark app to Azure HDInsight