How we compile benchmarks
The rules behind every benchmark page: where the figures come from, how sources are graded, what we show from each publisher and how the pages stay current.
The rules
- Every figure comes from one named source, shown with its sample, data window and statistic.
- We never average figures from different sources into one number.
- Every figure is labelled with what it counts, and figures that count different things are shown in separate groups.
- Dates are data dates: we show the period the data describes, not only when a report was published.
- Older data stays visible but is marked. A figure whose data is more than 24 months old is labelled "older data" and is never used as the current reference.
How we grade sources
| Grade | What it means | How we use it |
|---|---|---|
| A | Large sample, method and data window stated by the publisher | Shown; can be the at-a-glance figure for its definition |
| B | Sample or method only partly stated | Shown, with the missing details noted |
| C | Compiled from other sources, or undocumented | Not shown as a figure; may be named as further reading |
What we record for every figure
What we show from each publisher
We follow each publisher's own terms for reusing its figures.
Segment tables are reproduced only where the publisher's terms allow it, for example an explicit free-use-with-credit licence.
Published factual figures reported in our own wording and presentation, each attributed and linked, where the publisher's terms do not specifically restrict citing the figures. We never copy a publisher's charts, tables or prose, and reporting a figure is not a claim that the publisher has granted a licence.
The report is named and linked, but none of its figures are shown, where the publisher's terms require permission to reproduce content.
Why sources disagree
Keeping pages current
- Every source is re-opened each quarter to confirm the link still works and to look for a new edition.
- A new edition adds new figures next to the old ones. We do not overwrite history.
- If a source goes offline, its figures stay on the page with a note and the date we last saw it.
- A benchmark page needs at least two current graded sources. If it drops below that, we withdraw it until it has two again.
Limitations
Corrections
Found an error, a newer edition or a source we should add? Tell us. We check every report and note corrections on the page.
