Research notes · Probability & model evaluation

What does a 70% win probability really mean?

A probability is an estimate about uncertainty — not a promise about the next result. The useful question is whether that estimate remains defensible when new evidence arrives.

28 October 2026 · AIONORA — Play the Long Game · Free educational research

At AIONORA, we want to make the reasoning behind a sports forecast visible: what the model estimates, what the market implies, which assumptions matter, and when the evidence is not strong enough to publish a confident conclusion.

1. A probability describes a repeated situation, not a guaranteed outcome

Suppose an independently estimated model gives an event a 70% probability. That does not mean the event must occur. It means that, among many genuinely comparable events assigned probabilities near 70%, roughly seven in ten should occur if the probabilities are well calibrated.

The next event can still go either way. A correct individual outcome does not prove a model was right for the right reasons, and an incorrect outcome does not automatically show that the estimate was unreasonable.

Illustrative example only. If a model produced ten 70% forecasts and seven occurred, that would be consistent with calibration, but ten observations are far too few to establish reliability. We must not infer validated accuracy or profitability from a small anecdotal sample.

2. Keep model probabilities separate from market prices

Market prices express a different quantity: the probability implied by the offered odds, often including a bookmaker margin. With decimal odds, the simple implied probability is 1 ÷ odds. A quoted price of 2.00, for instance, corresponds to 50% before considering margin, market structure or execution costs.

AIONORA's intended method does not treat market-implied probabilities as its independent prediction. Instead, a sport-specific model should produce its own estimate, then compare that estimate with prices and uncertainty. Where a market has several outcomes, bookmaker margin needs attention before interpreting apparent differences as a genuine edge.

A mathematical gap between two numbers is not enough. If lineup information is incomplete, the quote is stale, or the forecast has not passed validation, the correct decision may be to pass.

3. Be precise about uncertainty

There is more than one reason a forecast may be uncertain. We distinguish uncertainty in the event itself from uncertainty about our estimate. Limited historical data, late injuries, uncertain minutes, source disagreement and untested model assumptions can all make a point estimate look more precise than it is.

A disciplined report should therefore communicate its assumptions, the freshness of its inputs, and whether its confidence is observed, projected or still unverified. This is especially important when changing conditions before an event could shift the estimate materially.

4. Evaluate forecasts over time, not one result at a time

Calibration asks whether events assigned similar probabilities occur at roughly the expected frequencies. It is only one part of evaluating a probability model. We also care about discrimination, proper scoring rules, stability across leagues and seasons, data leakage, and whether forecasts were recorded before the outcome was known.

The Brier score, for binary outcomes, averages the squared difference between predicted probability and observed result. It is useful, but it must be interpreted with the reference rate, sample composition and uncertainty of the estimate.

Brier score = mean of (predicted probability − observed outcome)². The outcome is 1 if it occurs and 0 otherwise.

A retrospective reconstruction is not equivalent to an immutable pre-event forecast. Historical scores are useful for learning about teams and constructing baselines; they do not, by themselves, validate a prediction record.

5. Study the decisions we reject

The absence of a published selection can be a meaningful research decision. If we reject an event because the evidence is weak or the price does not compensate for uncertainty, we should preserve the reason.

Reviewing rejected candidates can expose false negatives, unrealistic assumptions or overly rigid filters. But hindsight is a serious trap: an event that happened to win is not proof that rejecting it was a mistake. The evidence available at the time matters.

6. What AIONORA can — and cannot — claim today

AIONORA is an evolving, AI-assisted sports statistics and probability research project for football, basketball and tennis. Our aim is a transparent process: independent estimates, validation checks, clearly labelled research ideas, and a dated record of published decisions.

Our current public record does not yet establish a prospectively calibrated or profitable prediction model. Archived match results, experimental forecasts and daily editions must not be presented as a certified performance history. Where source verification, synchronization or prospective evaluation is incomplete, we disclose the gap instead of filling it with an invented score.

We may revise the methodology as stronger evidence becomes available. That is the goal of an honest research programme, not a claim that learning or model improvements have already been independently demonstrated.

How to read a Daily CORE edition

The objective is not certainty. It is a process clear enough to challenge, reproduce and improve.

Follow the research, not the noise.

Read the current Daily CORE research edition or subscribe to the free founding newsletter. No payment information is required; subscriptions are optional and can be cancelled.

Read Daily COREJoin the free newsletter