Skip to content
BackGOD PLAYS DICE™Big questions, honest answers

THE QUESTION LIBRARY HOW WE KNOW

How do scientists tell a real signal or pattern from a lucky coincidence?

How scientists distinguish real signals from lucky fits: look-elsewhere effects, independent predictions, black-hole searches and data-window artefacts.

THE SHORT ANSWER

A pattern becomes convincing when it survives checks that could have exposed a mistake: a fair comparison with noise, allowance for all the searches performed, independent tests and scrutiny of the measuring equipment and analysis. A formula that fits familiar numbers is a starting point. It becomes stronger evidence when it predicts something it was not adjusted to fit, with clear uncertainty and plausible alternatives considered.

  • Count the search, not just its best-looking result.
  • Test whether the analysis can create the pattern it appears to find.

WHAT WE DON’T KNOW YET

No single significance threshold eliminates every error. A particular new claim needs its actual search history, data-quality evidence and noise assumptions examined.

WHAT WOULD CHANGE THIS ANSWER

An independently repeated result that survives broader search corrections and alternative noise models would strengthen a candidate claim.

A striking pattern asks for an explanation. Before treating it as a discovery, scientists also ask how easily the same search could have found something striking in data with no such signal.

THE LONG ANSWER

THE LONG ANSWER · ABOUT 3 MINUTES

You’ve read your 3 free long answers this month.

The short answer, how sure we are, what we don’t know, what would change our mind and every source stay free on every page, for everyone.

All Access members read the long answer: the evidence piece by piece, the strongest objections, and how to check it yourself.

Join All Access · $1 a week Or $6 a month

Billed $52 once a year. Cancel anytime in your account.

Until December 4, 11:59 pm Pacific: the Founding rate is $39 a year, and it stays $39 while you stay a member.

Create a free account: 6 long answers a month, email only.

Paying never buys a different answer. Our Paywall Promise

Words worth knowing (1)
Spectral leakage
Power spreading between frequencies because of how a data segment is bounded.

Sources & further reading

(3) · Checked Oct 5, 2026
  1. Trial factors for the look elsewhere effect in high energy physics ↗European Physical Journal CSearch-wide significance differs from fixed-location significance.
  2. Observation of Gravitational Waves from a Binary Black Hole Merger ↗Physical Review Letters / LIGO–Virgo CollaborationMultiple detectors, searches and noise checks supported GW150914.
  3. A guide to LIGO–Virgo detector noise and extraction of transient gravitational-wave signals ↗Classical and Quantum Gravity / LIGO–Virgo CollaborationUntapered segments can create spectral leakage and phase correlations.

See a mistake? Report a problem. Corrections are made openly.

The Architect AI companion · All Access

Your next question can go further.

Included with All Access →Up to 5 questions a day while available.

Put God Plays Dice on your Home Screen

On iPhone: tap Share (on iOS 26, tap ••• first), then Add to Home Screen, then Add.

On Android: In Chrome, you can also open the ⋮ menu and choose Add to Home screen or Install.

The Home Screen version keeps its own memory on iPhone, so your nights and saved answers start fresh there.

Search the Question Library

156 answers to read · 0 questions awaiting answers Your search runs on your device.

Answers about death, grief and crisis are always free, in full. If a question is personal right now →