NICE process and methods

Appendix B: Criteria to appraise the validity of indicators

Appendix B: Criteria to appraise the validity of indicators

The indicator advisory committee advises on the progression of indicators in development using the following criteria to assess validity:

Criteria to appraise the validity of indicators
Domain Criteria

Importance

The indicator reflects a specific priority area

identified by NHS England or Public Health England.

The indicator relates to an area where there is known variation in practice.

The indicator will lead to a meaningful improvement in outcomes.

The indicator addresses under or over-treatment.

Evidence base

The indicator is derived from a high-quality evidence base.

The indicator aligns with the evidence base.

Specification

The indicator has defined components necessary to construct the indicator, including numerator, denominator and exclusions.

The indicator has a defined system or provider level at which the indicator is intended to be used.

The indicator outlines an expected population size and if a minimum number of patients is required, related to its intended use.

Feasibility

The indicator is repeatable.

The indicator is measuring what it is designed to measure.

The indicator uses existing data fields or the burden of additional data collection is acceptable.

Acceptability

The indicator assesses performance that is

attributable to or within the control of the audience.

The results of the indicator can be used to improve practice.

Risk

The indicator has an acceptable risk of unintended consequences.

Modified from MacLean et al (2018) Time Out — Charting a Path for Improving Performance Measurement N Engl J Med 2018 378:1757-1761