Create a fit-for-purpose checklist
- Select an established appraisal tool or justify adapted criteria.
- Cover study aims, design, data, analysis, validity, and reporting.
- Define Yes, Partial, No, and Not Applicable scoring rules.
- Pilot the checklist and calibrate the reviewers.
- Assess studies independently where possible.
- Resolve disagreements and calculate the final score.
- Apply the predefined inclusion or weighting rule.
Important distinction
Reporting quality and methodological quality are related but not identical. Do not reward a well-written paper for an unsuitable design.
Quality check
- Questions match the included research designs.
- Scoring rules are explicit and reproducible.
- The threshold was set before final scoring.
- Sensitivity to lower-quality evidence is discussed.