Optimization Bias

Optimization bias occurs when a trader tests numerous variations of a strategy and selects the one that performed best historically. Because there are so many combinations, the selected version may have achieved its results through pure luck rather than a genuine edge.

This is essentially a form of data mining that creates a false sense of security. The results are statistically biased because the process favored the best performing outlier among many failures.

To avoid this, traders must account for the number of trials performed during the search. It is a subtle but pervasive issue in quantitative research.

Recognizing this bias is essential for maintaining a realistic view of strategy potential.

Look-Back Window Optimization
Backtest Overfitting
Merkle Patricia Tree Optimization
Participation Rate Optimization
Resampling Bias
Falsification Strategy
Loss Aversion Metrics
Collateral Haircut Optimization