How do I know if my gold backtest is a false positive?

Run the five checks in sequence: split the sample into regime thirds, remove the three largest winning trades, re-apply time-varying spread and slippage, confirm the rules never changed mid-test, and sweep key parameters by ±10-20%. If the result survives all five, it is a reasonable candidate; if any check fails, treat the original result as unproven.

Is it wrong to rely on a strategy that only makes money around news events?

Not if it is explicitly built and tested as a news strategy across 30 or more releases with that concentration understood and planned for. It becomes a false positive specifically when a strategy is presented as a general, all-conditions setup while its profit is actually concentrated in a handful of unrepeatable event days.

How many rule tweaks during a test are too many?

There is no fixed number, but every tweak invalidates pooling the trades before and after it into one expectancy figure. Two or three tweaks inside a single test period usually means the underlying rule set was not clearly defined before testing began.

Why does my backtest look much better than my live or demo results?

Almost always unmodelled or under-modelled trading costs — a flat spread assumption that misses rollover widening, or a slippage-free fill assumption around CPI and NFP releases. Re-running the backtest with realistic, time-of-day-dependent costs usually closes most of the gap.

What does it mean if a stop distance of exactly $4.20 works but $4.00 does not?

It usually means the parameter has been fitted to the specific noise of the tested sample rather than to a genuine structural relationship in gold's price action. A real edge tends to survive a meaningful range of nearby parameter values with degraded but still positive results.

Can a strategy pass all five checks and still fail live?

Yes. These checks eliminate the most common ways a test misleads its own author, but they do not guarantee future performance, account for execution discipline, or replace an adequate sample size — they are a prerequisite for proceeding to further testing, not a substitute for it.

FALSE POSITIVES IN GOLD TESTING

A gold strategy test can look profitable without holding a real edge for five distinct reasons: the test window happened to fall inside one favourable volatility regime, a single outsized winning trade carried an otherwise flat sample, trading costs like rollover spread widening and news-driven slippage were left out of the model, the rules were quietly changed partway through the test, or key parameters were tuned precisely to the noise of one narrow volatility period rather than to a robust relationship.

Each false positive has a fast, mechanical check: splitting the sample into regime thirds exposes regime luck, removing the three largest winning trades exposes outlier dependence, re-applying time-varying spread and slippage exposes unmodelled costs, timestamping rule changes exposes mixed-rule pooling, and sweeping parameters by 10-20% exposes curve fitting.

A gold test that survives all five checks has cleared the most common ways a result misleads its own author, and modest, cost-adjusted expectancy that persists across trend, range and shock conditions is a far more trustworthy signal than a smooth, high-looking equity curve produced by an untested combination of regime luck, outlier dependence and an over-fitted parameter set.