What the unit asks
The draft distinguishes the functional test, where the detection mechanism must perform within a range, from the vulnerability assessment, where the analyst tries to build a presentation attack instrument that works. A system can pass the first and fail the second. The draft's rule is blunt: one successful attack within the stated potential fails the security benchmarking.
What good practice looks like
State the attack potential before the test. List the instruments: print, replay, mask, synthetic face, document alteration. Report the failure that matters, not only the average detection rate. Keep the artefacts so the finding can be reviewed.
Evidence an assessor asks for
| Artefact | Why it matters |
|---|---|
| The presentation attack test report with each instrument and its result. | It is the evidence behind the detection claim. |
| The attack potential statement, dated before the test. | A result means little without the level it was tested to. |
| The artefact log for each attack instrument. | It lets a reviewer see what was actually presented. |
What a good answer sounds like
A good answer to P3-11 names The presentation attack test report with each instrument and its result., dates it, and says what it does not cover. A policy or a promise is not an answer. If P3-11 has no artefact, the row is not met and the absence is the finding.
Where comparisons commonly fail
- Only a photograph and a video replay are tested, and the report calls the system attack resistant.
- The attack potential is chosen after a failure, to explain it away.
- The detection rate is averaged across instruments, hiding the one that works.
Questions to put to the supplier
- Which instrument defeated the system, and at what attack potential?
- Was the detection tested as a function, as a vulnerability, or both?
How this is used in the kit
P3-11 becomes one row of the comparison register, with an owner, a status and the evidence named above. A status of met asks for the artefact and its date, and the free check uses the same row as an evidence question, so the page and the register share one vocabulary.
Source for this page
- ISO/IEC JTC 1/SC 27/WG 5 N3928, AWI 27566-2 working draft. Public working draft of the benchmarking part, at the ETSI document box.
- Measurement of Age Assurance Technologies. The DRCF and ICO research report on measuring age assurance technologies.
Retrieved 2026-10-21. P3-11 is our statement of WG 5 N3928, clause 4.4.3; the DIS body is not public, so no DIS clause number is claimed.