Intermediate · module I2 · Sublevel Beginner
Working with Data: NumPy, pandas, SQL and Visualisation
By the end: Clean and explore a real dataset with pandas and SQL, compute summaries with NumPy, and present findings with charts
- Covers
- Loading, cleaning, querying, exploring and charting real data with Python
- Contents
- 5 chapters, 22 topics
- Time
- About 4 hours
- Level
- Intermediate
- Your progress
- 0 / 22
This module builds on Python Programming for AI. We suggest looking at it first, but the choice is yours.
Chapter 1 NumPy
- 1.110 min Read Activity
Introduction to NumPy
Arrays, and why they are faster than lists
Code: create arrays and compare speed
- 1.212 min Read Activity
Array Shape, Indexing and Slicing
Dimensions, shapes, reshaping and selecting values
Code: work with a 2D table of marks
- 1.310 min Read Activity
- 1.410 min Read Activity
Statistics with NumPy
Mean, median, standard deviation, minimum, maximum and percentiles
Code: summarise sensor readings
Chapter 2 pandas
- 2.110 min Read Activity
- 2.28 min Read Activity
- 2.310 min Read Activity
- 2.412 min Read Activity
Selecting and Filtering Data
loc, iloc and boolean filters
Code: answer five questions about the data
- 2.512 min Read Activity
Sorting, Grouping and Aggregating
sort_values, groupby and pivot tables
Code: sales by city and month
- 2.610 min Read Activity
Chapter 3 Data Cleaning
- 3.110 min Read Activity
- 3.212 min Read Activity
Duplicates, Wrong Types and Outliers
Removing duplicates, fixing types and spotting extreme values
Code: clean a messy file
- 3.38 min Read Activity
- 3.425 min Read Activity
Validating a CSV Dataset
Schemas, headers and encoding, types, missing values, ranges, allowed values, keys, cross-field rules and error reports
Lab: validate four attendance exports with the same rules
validity = rows passing every rule ÷ rows checked
Chapter 4 Databases and SQL
- 4.18 min Read Activity
Introduction to Databases
Tables, rows, keys and why data lives in databases
Interactive: design a school database
- 4.215 min Read
SQL Essentials
SELECT, WHERE, ORDER BY, GROUP BY and JOIN
Code: query a database from Python with SQLite
Chapter 5 Visualisation
- 5.112 min Read Activity
Matplotlib Basics
Line, bar, scatter, histogram and pie charts, with labels
Code: chart a dataset five ways
- 5.212 min Read Activity
Seaborn for Statistical Charts
Distribution plots, box plots, heatmaps and pair plots
Code: explore relationships
- 5.320 min Read Activity
Exploratory Data Analysis Workflow
Univariate, bivariate and multivariate analysis
Project: a complete EDA notebook
- 5.412 min Read Activity
Data Storytelling with Charts
Choosing a message and designing charts that support it
Project: a one-page data story
- 5.515 min Read Activity
- 5.615 min Read Activity