Published 2026-10-14
Overfitting
Overfitting is when a rule is tuned so closely to past data that it captures noise instead of signal — and therefore fails on data it has not seen.
On this page
What it is
Overfitting is when a rule is tuned so closely to past data that it captures noise instead of signal.
A rule with enough parameters can fit almost any history. The result looks excellent in backtest and fails out of sample — because it learned the specific past, not a repeatable pattern.
How to spot it
| Sign | Why it suggests overfitting |
|---|---|
| Many parameters, short history | Enough freedom to fit anything |
| Performance collapses on unseen data | It memorised, it did not generalise |
| Sensitive to small changes | Nudge a parameter, the result swings wildly |
| No out-of-sample test | Only evidence of fit, not of generalisation |
How to check
Ask whether the result was tested on data the rule was not tuned on. A backtest on the tuning data is not evidence — it is the thing being fitted.