Optimization Bias
Optimization bias occurs when a trader tests numerous variations of a strategy and selects the one that performed best historically. Because there are so many combinations, the selected version may have achieved its results through pure luck rather than a genuine edge.
This is essentially a form of data mining that creates a false sense of security. The results are statistically biased because the process favored the best performing outlier among many failures.
To avoid this, traders must account for the number of trials performed during the search. It is a subtle but pervasive issue in quantitative research.
Recognizing this bias is essential for maintaining a realistic view of strategy potential.