ISO 27566-3 Revision Checker
ISO/IEC DIS 27566-3stage 40.20ballot closes 4 December 2026planning date 14 September 2027

All 17 analysis units · Indicators of effectiveness

P3-06

Report continuous measures for an estimated age

For a system that returns an estimated age, report the error distribution, not only a mean. Show the signs of the errors, the spread, the bias by age band and the cases where the estimate is furthest from the truth.

Group Indicators of effectivenessPublic source WG 5 N3928, Annex AEvidence 3 items

What the unit asks

The draft's annex sets out the basic measures for a continuous output: the signed error, its absolute value, the mean and the spread, and the shape of the distribution. The reason is practical. Two systems with the same mean error can behave very differently near the threshold, and a histogram shows the failures a single number conceals.

What good practice looks like

Publish the signed error and the absolute error, a histogram or the quantiles, and a table by age band. Say whether the sample is balanced by age. Where a mean is reported, name the measure and its denominator.

Evidence an assessor asks for

ArtefactWhy it matters
The error table by age band and by demographic group.It shows where the estimate is weak.
The distribution chart or quantile table.It shows the shape and the tail.
The measurement definition and the sample size for each cell.A cell with ten people cannot support a claim.

What a good answer sounds like

A good answer to P3-06 names The error table by age band and by demographic group., dates it, and says what it does not cover. A policy or a promise is not an answer. If P3-06 has no artefact, the row is not met and the absence is the finding.

Where comparisons commonly fail

  • Only the mean error is published, with no spread and no direction.
  • The age bands are so wide that the near-threshold group disappears.
  • The chart is published without the underlying counts.

Questions to put to the supplier

  1. What does the tail of the error distribution look like?
  2. Which age band carries the largest absolute error?

How this is used in the kit

P3-06 becomes one row of the comparison register, with an owner, a status and the evidence named above. A status of met asks for the artefact and its date, and the free check uses the same row as an evidence question, so the page and the register share one vocabulary.

Source for this page

Retrieved 2026-10-21. P3-06 is our statement of WG 5 N3928, Annex A; the DIS body is not public, so no DIS clause number is claimed.