Exploring relationships and time
Exploratory data analysis with profiles and histograms, relationships between variables and their traps, and time series basics.
About 6 hours of study
Learning objectives
- Profile a dataset and draw histograms
- Measure relationships and avoid false conclusions
- Analyse trends and anomalies over time
Lessons
- 1
Exploratory data analysis Intermediate
Getting to know a dataset before modelling it: profiling every column, counting missing values, drawing text histograms with bins, and writing down questions and surprises as you go.
- 2
Relationships between variables Intermediate
How two columns move together: scatter thinking, Pearson's correlation for every pair of columns, confounders, spurious correlations and Simpson's paradox, where a trend reverses when groups are combined.
- 3
Time series basics Intermediate
Data measured over time: sorting by date, totals per month, percentage change, moving averages that smooth out noise, seasonality, and flagging unusual days with a rolling mean and standard deviation.
Module practice
- Data science: A text histogramEasy
- Data science: A missing-values reportMedium
- Data science: Profile every columnHard
- Data science: Pearson's correlationEasy
- Data science: The strongest relationshipMedium
- Data science: Spot Simpson's paradoxHard
- Data science: A moving averageEasy
- Data science: Monthly totals and growthMedium
- Data science: Flag unusual daysHard