Prediction and practice

Training and test sets, baselines and simple models, evaluating classifiers, and running a reproducible, honest analysis.

About 5 hours of study

Learning objectives

Lessons

  1. 1

    Prediction basics Advanced

    The core ideas of predictive modelling in plain Python: features and targets, training and test sets, a baseline to beat, a least-squares line, nearest neighbours, and error measures such as MAE and RMSE.

  2. 2

    Evaluating classifiers Advanced

    Judging yes/no predictions properly: the confusion matrix, accuracy and why it misleads on rare classes, precision, recall, the F1 score, and choosing a decision threshold.

  3. 3

    The data science workflow Advanced

    Putting the steps together into a reproducible analysis: a pipeline from raw data to report, train and test discipline, data leakage, documenting cleaning decisions, ethics and privacy, and communicating results honestly.

Module practice

Module quiz

1. A model must be judged on…
2. Precision is…
3. Why keep raw data unchanged?
4. A model's MAE equals the baseline's MAE. The model…
5. A cancer screening test should favour…
6. Scaling all rows with their joint mean before the split causes…

‹ Exploring relationships and timeFinal assessment ›