Skip to main content

AI & Machine Learning Study Guide

The whole course, unit by unit

Five units from the ML workflow through data preparation and evaluation to unsupervised methods and responsible AI. Each unit explains what to know, how to apply it, what typically goes wrong, and one study move that makes the material stick.

Five units

Foundations and workflow, data preparation and features, supervised learning, model evaluation, then unsupervised methods and responsible AI.

Python-based

Assumes the Python course or equivalent comfort with functions, collections, and pandas.

No single exam

Assessed by projects, analysis write-ups, and practice sets.

Where it leads

University machine learning and data science coursework, and portfolio projects.

Units

The five units

Unit 1 is the largest by a wide margin. The rest move faster, and the last one is the bridge into calculus.

1

Unit 1 · Foundational

Foundations and the ML Workflow

What machine learning is, when it is the wrong tool, and the order the work happens in. Framing decisions made here determine whether anything downstream can be evaluated.

SupervisedUnsupervisedClassificationRegressionBaselineDrift
2

Unit 2 · Where the effort is

Data Preparation and Features

The unit that decides whether a project succeeds. A model can only learn what its data contains, including the data errors and the historical bias.

FeatureLabelLeakageOne-hot encodingScalingImputation
3

Unit 3 · Heavy

Supervised Learning

The algorithms themselves, treated as tools with known behavior rather than as the point of the course. What matters is knowing what each assumes and how each fails.

CoefficientRegularisationThresholdDecision treePruningk-NN
4

Unit 4 · Most assessed

Model Evaluation

Whether a result can be believed. This is the unit that separates a student who can run a model from one who can report an honest finding.

Train/validation/testCross-validationPrecisionRecallConfusion matrixOverfitting
5

Unit 5 · Assessed seriously

Unsupervised Learning and Responsible AI

Finding structure without labels, and the obligations that come with deploying any of this. The responsibility material is assessed with the same seriousness as the technical content.

Clusteringk-meansLocal optimumDimensionality reductionProxy variableFairness

Mathematical Practices

The habits that run through every unit

Four habits that separate a result you can believe from a number you cannot: frame first, inspect the data, beat a baseline, distrust one number.

1. Frame before you model

Say what is being predicted, from what, and what success would mean numerically. A project that skips this produces a model nobody can evaluate.

2. Look at the data first

Shape, types, missing values, and class balance, before any algorithm. Most project failures are visible in the first ten minutes of inspection.

3. Beat a baseline

Always know what a trivial rule scores. A model that cannot beat "predict the most common class" has not learned anything, whatever its accuracy looks like.

4. Distrust one number

A single accuracy figure hides class imbalance and uneven errors. Ask for the breakdown before believing any headline.

Assessment

How to answer, not only what to know

Two lists: one for selected-response work, one for anything you have to write out.

Multiple choice

  • Check whether a question is about training or about evaluation. The same word means different things on each side of the split.
  • On any accuracy question, ask what the majority-class baseline would score first.
  • For preprocessing order, remember the split comes before fitting any transformation.
  • Distinguish overfitting from underfitting by comparing training and test performance, not by looking at one alone.
  • When a feature seems too predictive, suspect leakage rather than success.

Written work

  • State the framing: what is the target, what are the features, and what does success mean.
  • Say what you did about missing values and why, rather than leaving it implicit.
  • Report per-class performance when classes are imbalanced.
  • Interpret a parameter in the language of the problem rather than the model.
  • Name a limitation of your result. Every model has one, and identifying it earns credit.

Study plan

Where the time is best spent

Four moves, in the order that pays off.

1

Learn the workflow as a sequence

Frame, prepare, train, evaluate, deploy, monitor. Being able to say where you are in that sequence prevents most confusion.

2

Practise spotting leakage

Leakage is the failure that produces spectacular results and useless models. Train yourself to ask whether each feature would exist at prediction time.

3

Internalise the split rule

Split first, fit transformations on training data only. Get this wrong and every score you report is inflated.

4

Read confusion matrices fluently

Precision, recall, and the cost of each error type are the vocabulary of every serious evaluation discussion.

5

Work with imbalanced data

Real problems are imbalanced. Practise on a dataset where accuracy is misleading until the trap is obvious.

6

Write the limitations section

For every project, write what the model cannot do and who it might fail. This is assessed and it is also the honest thing to produce.

Curriculum scope

What this sequence includes

Machine learning is taught here as a workflow rather than a catalogue of algorithms. The recurring question is not which model to use but whether the result can be believed, which is why evaluation and data preparation carry more weight than model internals.

Algebra and trigonometry core

Essential foundations

  • What machine learning is, when it is the wrong tool, and the end-to-end workflow
  • Framing a problem as classification, regression, or clustering
  • Data quality, missing values, encoding, scaling, and feature construction
  • Supervised algorithms: linear models, trees, and nearest neighbours
  • Evaluation: train/test splits, cross-validation, the confusion matrix, precision and recall
  • Overfitting, underfitting, and the bias-variance trade

Breadth beyond the assessed core

Included in this sequence

  • Clustering and dimensionality reduction
  • Bias, fairness, transparency, and accountable deployment
  • Communicating a result honestly to a non-technical audience

Varies by course

Compare with the school syllabus

  • Neural networks. Introduced conceptually in some sections; the framework here stops before deep learning.
  • Library depth. scikit-learn is standard; some sections add more.
  • Project scale. Some courses end with a full portfolio project and some with smaller analyses.

Glossary

Terms worth being precise about

Supervised learning

Training on labelled examples so a model can predict the label for new data.

Leakage

A feature that would not be available at prediction time, or that encodes the answer.

Baseline

The score a trivial rule achieves, against which any model must be compared.

Overfitting

Fitting noise in the training data, shown by a gap between training and test performance.

Underfitting

A model too simple to capture the pattern, shown by poor performance everywhere.

Precision

The proportion of predicted positives that are actually positive.

Recall

The proportion of actual positives that the model found.

Class imbalance

One class dominating the dataset, which makes accuracy misleading.

Proxy variable

A feature correlated with a protected attribute, carrying its information indirectly.

Drift

Change over time in the data a deployed model sees, degrading its accuracy.