Foundations

What machine learning is, how to look at and prepare data, and how to judge a model honestly.

About 4 hours of study

Learning objectives

Lessons

  1. 1

    What machine learning is

    The idea behind machine learning: instead of writing the rules, let the computer find them from examples. Training and prediction, features and labels, and the three kinds of learning.

  2. 2

    Data, statistics and features

    Look at the numbers before any model: mean, median and standard deviation, outliers, scaling features with min-max and z-scores, one-hot encoding and missing values.

  3. 3

    Training, testing and overfitting

    Why a model must be judged on data it never saw: train and test sets, overfitting and underfitting, bias and variance, validation sets and k-fold cross-validation.

Module practice

Module quiz

1. Predicting a house price from its size is...
2. Which statistic barely moves when one huge outlier is added?
3. Min-max scaling maps a column's largest value to...
4. Training accuracy 98%, test accuracy 61%. The model is most likely...
5. Why must scaling statistics come from the training data only?
6. In 4-fold cross-validation on 100 examples, each model is validated on...

Regression and optimization ›