ComputingMachine Learning

Machine Learning Cheat Sheet — 1-page PDF

Supervised/unsupervised learning, core models, optimization, regularization, evaluation. The whole course on one dense, printable page for your midterm or final, with every formula typeset and worked examples where they help.

The first part is free below. See pricing →

For a specific exam: Machine Learning Final exam study sheet.

  • 1 pageUS Letter
  • 10 sections10 topics
  • Free previewfull sheet with Unlimited
Preview of the one-page Machine Learning cheat sheet: Supervised/unsupervised learning, core models, optimization, regularization, evaluation Cheat sheet locked
the whole course, one page

On the sheet

What’s on it

The topics a typical Machine Learning exam tests, all on the one page.

  • Supervised vs unsupervised
  • Linear and logistic regression
  • Loss functions and gradient descent
  • Bias-variance tradeoff and regularization
  • Decision trees and ensembles
  • SVMs
  • K-means and PCA
  • Neural networks and backprop
  • Evaluation metrics
  • Cross-validation

Free preview

The free part, as text

The free part of the sheet, section by section. Unlock the full sheet to read the rest, edit any block, and print it or save it as a PDF.

01Learning Setup

Supervised learning
Learn mapping from labeled data ; tasks: regression (), classification ().
Unsupervised learning
Given only , find structure: clustering, dimensionality reduction, density estimation.

Common task types

TaskInputOutput
Regressionreal
Binary classification
Multiclass
Clusteringgroups
PCAlow-dim
Training / validation / test
Training fits parameters; validation tunes hyperparameters/model choice; test used once for final estimate.

Watch out:Data leakage: anything computed using test data (scaling, feature selection, PCA, CV folds) invalidates evaluation.

  1. 1. Split data or use CV.
  2. 2. Fit on training only.
  3. 3. Tune on validation.
  4. 4. Report final metric on untouched test set.

02Optimization

Mini-batch

Most common practice.

Watch out:Too large ⇒ divergence; too small ⇒ slow convergence.

  • For convex losses: GD can reach global optimum.
  • Feature scaling often speeds GD.
  • Local minima/saddles matter for neural nets, less for linear models.

03Bias-Variance

Decomp.

Squared loss; irreducible noise.

Bias
Error from overly simple assumptions; high bias ⇒ underfitting.
Variance
Sensitivity to training set; high variance ⇒ overfitting.

Model complexity effects

EffectBiasVarTrain errTest err
Simplerupdownupunderfit
More complexdownupdownoverfit

reg.

Ridge / weight decay.

04SVMs

Hard-margin

Linearly separable data; margin .

Soft-margin

Allows violations; trades margin vs errors.

Support vectors
Training points with nonzero dual coefficients; lie on or inside margin and determine boundary.
Kernel trick
Replace dot products by for nonlinear decision boundaries.
  • Common kernels: linear, polynomial, RBF .

05Clustering & PCA

k-means
Partition points into clusters by minimizing within-cluster SSE.

k-means objective

= centroid of cluster .

06Neural Nets

Universal approximation
A sufficiently wide hidden-layer network can approximate many functions arbitrarily well (given suitable activation).

Watch out:Vanishing gradients: sigmoid/tanh in deep nets can make tiny; ReLU mitigates.

07Evaluation

Accuracy
; best when classes balanced.

Precision

Of predicted positives, fraction correct.

Recall

Of actual positives, fraction found.

F1

Harmonic mean; balances P/R.

Specificity

True negative rate.

ROC / AUC
ROC plots vs over thresholds; AUC summarizes ranking quality.

MSE / RMSE

Regression metrics.

Cheat sheet locked

Also on the full Machine Learning sheet

8 more sections, with every definition, formula and worked example. Unlimited unlocks every full sheet in the library to edit, print or save as a PDF, and makes unlimited sheets from your own notes.

Linear Models

  • Linear reg
  • MSE
  • Normal eqn
  • Logistic
  • Log loss
  • Decision rule

Optimization

  • Gradient descent
  • Gradient
  • Batch GD
  • SGD

Bias-Variance

  • L1 reg

Trees & Ensembles

  • Decision tree
  • Gini
  • Entropy
  • Pruning
  • Random forest
  • Boosting

SVMs

  • Maximum-margin classifier
  • Hyperplane

Clustering & PCA

  • PCA
  • PCA optimization
  • Covariance

Neural Nets

  • Neuron
  • Forward pass
  • Common activations
  • Backprop
  • Weight gradient

Validation

  • k-fold CV
  • Stratified CV
  • Train/val split
  • Metric choice

Unlock the full sheet $4.99 a month or $19 a semester

FAQ

Questions

About the Machine Learning sheet and making your own.

What does this Machine Learning cheat sheet cover?
It has 10 sections: Learning Setup, Linear Models, Optimization, Bias-Variance, Trees & Ensembles, SVMs, Clustering & PCA, Neural Nets, Evaluation and Validation. Together they cover the topics a typical Machine Learning exam tests, including supervised vs unsupervised, linear and logistic regression, loss functions and gradient descent and bias-variance tradeoff and regularization.
Is the machine learning cheat sheet free?
The first part is free to read on this page, with no account needed. The full sheet opens in the app with Unlimited ($4.99 a month or $19 for a semester), where you can edit it, print it or save it as a PDF. It is one US Letter page and prints cleanly in black and white or colour.
Can I bring this Machine Learning cheat sheet to my exam?
Only if your course allows a note sheet, so check the syllabus. This one is a single US Letter page. If your exam allows a different size, such as a 3x5 or 4x6 index card or one page front and back, Cheat Sheet AI makes one at exactly that size from your own lecture notes.
How accurate is it?
The sheet was written by our engine from a standard course outline, then a second model fact-checked every formula and statement against it; it corrected 1 statement before publishing. Notation and emphasis vary between courses, so check it against your own lecture notes.
Can I make a Machine Learning sheet from my own notes?
Yes. Upload your lecture slides, notes or study guide and Cheat Sheet AI writes a sheet in your course's notation, sized to exactly the space your exam allows. Your first sheets are free.

Your course, your notes, one page.

Make this from your notes

Upload your own Machine Learning slides or notes and get a study sheet in your course’s notation. Your first sheet needs no account, and a free account adds one more. See pricing