test crew

The definition, in our words

The group of people who provide test samples for a benchmarking exercise.

Why the distinction matters

The working draft says the crew should not be known to the developer beforehand, because familiarity changes behaviour and can change the result. The crew's composition is part of the sampling question.

How to use it in a comparison

Record how the crew was recruited, its age bands, its devices and its lighting conditions. A crew drawn from staff is not a sample of the public.

Where it changes the evidence

A definition is not decoration. It decides which test is meaningful and which result can be compared. Where a supplier's material uses the term differently, the comparison should quote the supplier's use and place it beside this one. A difference in definition is a finding about comparability, and it belongs in the report rather than in a footnote.

The analysis units on this site use the term as the framework defines it. Where a unit turns the term into a question, the question is written on the unit page and the evidence artefact is named. The kit repeats both, so a row in the register and a paragraph in the report use the same meaning.