Machine Learning Cheat Sheet — 1-page PDF
Supervised/unsupervised learning, core models, optimization, regularization, evaluation. The whole course on one dense, printable page for your midterm or final, with every formula typeset and worked examples where they help.
The first part is free below. See pricing →
For a specific exam: Machine Learning Final exam study sheet.
- 1 pageUS Letter
- 10 sections10 topics
- Free previewfull sheet with Unlimited
Cheat sheet locked
On the sheet
What’s on it
The topics a typical Machine Learning exam tests, all on the one page.
- Supervised vs unsupervised
- Linear and logistic regression
- Loss functions and gradient descent
- Bias-variance tradeoff and regularization
- Decision trees and ensembles
- SVMs
- K-means and PCA
- Neural networks and backprop
- Evaluation metrics
- Cross-validation
Free preview
The free part, as text
The free part of the sheet, section by section. Unlock the full sheet to read the rest, edit any block, and print it or save it as a PDF.
01Learning Setup
- Supervised learning
- Learn mapping from labeled data ; tasks: regression (), classification ().
- Unsupervised learning
- Given only , find structure: clustering, dimensionality reduction, density estimation.
Common task types
| Task | Input | Output |
|---|---|---|
| Regression | real | |
| Binary classification | ||
| Multiclass | ||
| Clustering | groups | |
| PCA | low-dim |
- Training / validation / test
- Training fits parameters; validation tunes hyperparameters/model choice; test used once for final estimate.
Watch out:Data leakage: anything computed using test data (scaling, feature selection, PCA, CV folds) invalidates evaluation.
- 1. Split data or use CV.
- 2. Fit on training only.
- 3. Tune on validation.
- 4. Report final metric on untouched test set.
02Optimization
Mini-batch
Most common practice.
Watch out:Too large ⇒ divergence; too small ⇒ slow convergence.
- For convex losses: GD can reach global optimum.
- Feature scaling often speeds GD.
- Local minima/saddles matter for neural nets, less for linear models.
03Bias-Variance
Decomp.
Squared loss; irreducible noise.
- Bias
- Error from overly simple assumptions; high bias ⇒ underfitting.
- Variance
- Sensitivity to training set; high variance ⇒ overfitting.
Model complexity effects
| Effect | Bias | Var | Train err | Test err |
|---|---|---|---|---|
| Simpler | up | down | up | underfit |
| More complex | down | up | down | overfit |
reg.
Ridge / weight decay.
04SVMs
Hard-margin
Linearly separable data; margin .
Soft-margin
Allows violations; trades margin vs errors.
- Support vectors
- Training points with nonzero dual coefficients; lie on or inside margin and determine boundary.
- Kernel trick
- Replace dot products by for nonlinear decision boundaries.
- Common kernels: linear, polynomial, RBF .
05Clustering & PCA
- k-means
- Partition points into clusters by minimizing within-cluster SSE.
k-means objective
= centroid of cluster .
06Neural Nets
- Universal approximation
- A sufficiently wide hidden-layer network can approximate many functions arbitrarily well (given suitable activation).
Watch out:Vanishing gradients: sigmoid/tanh in deep nets can make tiny; ReLU mitigates.
07Evaluation
- Accuracy
- ; best when classes balanced.
Precision
Of predicted positives, fraction correct.
Recall
Of actual positives, fraction found.
F1
Harmonic mean; balances P/R.
Specificity
True negative rate.
- ROC / AUC
- ROC plots vs over thresholds; AUC summarizes ranking quality.
MSE / RMSE
Regression metrics.
Cheat sheet locked
Also on the full Machine Learning sheet
8 more sections, with every definition, formula and worked example. Unlimited unlocks every full sheet in the library to edit, print or save as a PDF, and makes unlimited sheets from your own notes.
Linear Models
- Linear reg
- MSE
- Normal eqn
- Logistic
- Log loss
- Decision rule
Optimization
- Gradient descent
- Gradient
- Batch GD
- SGD
Bias-Variance
- L1 reg
Trees & Ensembles
- Decision tree
- Gini
- Entropy
- Pruning
- Random forest
- Boosting
SVMs
- Maximum-margin classifier
- Hyperplane
Clustering & PCA
- PCA
- PCA optimization
- Covariance
Neural Nets
- Neuron
- Forward pass
- Common activations
- Backprop
- Weight gradient
Validation
- k-fold CV
- Stratified CV
- Train/val split
- Metric choice
FAQ
Questions
About the Machine Learning sheet and making your own.
- What does this Machine Learning cheat sheet cover?
- It has 10 sections: Learning Setup, Linear Models, Optimization, Bias-Variance, Trees & Ensembles, SVMs, Clustering & PCA, Neural Nets, Evaluation and Validation. Together they cover the topics a typical Machine Learning exam tests, including supervised vs unsupervised, linear and logistic regression, loss functions and gradient descent and bias-variance tradeoff and regularization.
- Is the machine learning cheat sheet free?
- The first part is free to read on this page, with no account needed. The full sheet opens in the app with Unlimited ($4.99 a month or $19 for a semester), where you can edit it, print it or save it as a PDF. It is one US Letter page and prints cleanly in black and white or colour.
- Can I bring this Machine Learning cheat sheet to my exam?
- Only if your course allows a note sheet, so check the syllabus. This one is a single US Letter page. If your exam allows a different size, such as a 3x5 or 4x6 index card or one page front and back, Cheat Sheet AI makes one at exactly that size from your own lecture notes.
- How accurate is it?
- The sheet was written by our engine from a standard course outline, then a second model fact-checked every formula and statement against it; it corrected 1 statement before publishing. Notation and emphasis vary between courses, so check it against your own lecture notes.
- Can I make a Machine Learning sheet from my own notes?
- Yes. Upload your lecture slides, notes or study guide and Cheat Sheet AI writes a sheet in your course's notation, sized to exactly the space your exam allows. Your first sheets are free.
Keep going
More sheets
All 40 sheets are in the sheet library.
Your course, your notes, one page.
Upload your own Machine Learning slides or notes and get a study sheet in your course’s notation. Your first sheet needs no account, and a free account adds one more. See pricing