pandas Essential Training

3h 11mIntermediate2024-05-24

Authors

Jonathan Fernandes

Consultant focusing on data science, AI, and big data

Course details

pandas is an open-source data analysis library that provides high-performance, easy-to-use data structures, and data analysis tools for Python. In this intermediate-level, hands-on course, learn how to use the pandas library and tools for data analysis and data structuring with instructor Jonathan Fernandes. Take a deep dive into topics such as DataFrames, basic plotting, indexing, and groupby. To help you learn how to work with data more effectively, Jonathan guides you through a series of practical coding exercises that are based on the same large, public dataset.

Note: A basic working knowledge of Python is a prerequisite of this course.

Skills covered

pandasPythonData AnalysisEssential TrainingData ScienceBusiness Analysis and StrategyBusiness Software and ToolsOpen Source

Concepts

Introduction

Welcome to pandas

Technical Setup

Using Google Colab
What is pandas
Using pandas
Reading tabular data into pandas

Fundamentals of Working with pandas

Get an overview of the data and displaying it
Select a Series (column)
Challenge - Fundamentals
Solution - Fundamentals
Python lists and dictionaries
Rename a Series (or column)
Remove a Series (column) or row
Filtering rows for a single condition
Filter rows for multiple conditions
Using String methods
Sorting a DataFrame or Series

Intermediate pandas Techniques

Working with data types (dtype)
Memory usage of dtypes
Defining dtypes when you read in a file
Python functions
Working with indexes
Being productive in pandas - My best practices
Creating Series and DataFrames
Working with dates
Combining DataFrames
Combining datasets
Working with missing data
Removing missing data
Working with duplicates
Validating data
Updating the dtypes
Combine the datasets

Visualizations

Plotting data
Working with colormaps and seaborn
Working with groupby
Reshaping data - Stacking, unstacking, and MultiIndex
Challenge - Visualizations
Solution - Visualizations
Creating your own colormaps

Learning Recap

Final challenge - Recap
Solution - Recap

Conclusion

Your next steps in pandas