Home/Critical Appraisal
Critical Appraisal

Systematic Review

EM FINAL EXAMS Critical Appraisal · Evidence synthesis Systematic Review A structured, reproducible review that answers one focused question using an explicit, pre-registered protocol. Definition A review that answers a focused question by following an explicit protocol: a comprehensive, reproducible search; pre-defined inclusion/exclusion criteria; risk-of-bias appraisal of every included study; and a transparent synthesis — […]

EM FINAL EXAMS Critical Appraisal · Evidence synthesis

Systematic Review

A structured, reproducible review that answers one focused question using an explicit, pre-registered protocol.

Definition

A review that answers a focused question by following an explicit protocol: a comprehensive, reproducible search; pre-defined inclusion/exclusion criteria; risk-of-bias appraisal of every included study; and a transparent synthesis — reported to the PRISMA standard. It may include a meta-analysis, but need not.

The picture
no effect (RR 1) Study A Study B Study C Study D Pooled 0.5 1 2 ← favours treatment favours control → square = one study (size = weight) line = 95% CI diamond = pooled (optional) I² = 62% (moderate)

The review finds & appraises the studies; the gold diamond is added only if a meta-analysis is done.

What it shows

A systematic review assembles every eligible study on a focused question and appraises each for bias. If the studies are similar enough, the review may go on to pool them statistically (the gold diamond) — but the search, selection and risk-of-bias appraisal are the review; the diamond is the optional extra.

How to read it

Check the protocol was pre-registered (e.g. PROSPERO); the search was comprehensive and included grey literature; selection was done in duplicate against pre-set criteria; and each study’s risk of bias was formally assessed. A slick forest plot built on biased primary studies is still biased.

Why it matters

A systematic review is far less prone to bias than a narrative review, where authors can cherry-pick supportive studies. Its reproducible method sits near the top of the evidence hierarchy — but only when the included evidence is sound.

Key
  • Focused question + explicit protocol (pre-registered)
  • Comprehensive search · duplicate selection · risk-of-bias appraisal
  • Reported to PRISMA; meta-analysis is optional
Pitfall
Pitfall Garbage in, garbage out — a flawless method applied to biased primary studies still yields biased conclusions. Publication bias (unpublished negative trials) can inflate the apparent effect no matter how rigorous the review.
emfinalexams.com · FRCEM / MRCEM revision
EM trial in the wild

A Cochrane systematic review is the archetype — e.g. Perel et al., “Colloids versus crystalloids for fluid resuscitation in critically ill people” (Cochrane Database Syst Rev). It states a focused question, registers a protocol, searches multiple databases and trial registers, screens in duplicate, appraises each trial’s risk of bias, and then synthesises — concluding that resuscitation with colloids rather than crystalloids does not reduce, and may increase, the risk of death. A systematic review is only as trustworthy as the trials it includes — Cochrane’s structure controls reviewer bias, not the bias baked into the primary studies.

Examiner traps
  • Conflating “systematic review” with “meta-analysis” — the pooling step is optional and need not be present.
  • Missing grey literature / publication bias — an incomplete search inflates the effect.
  • Ignoring heterogeneity — pooling clinically dissimilar studies produces a misleading summary.
Quick check

Is every systematic review a meta-analysis?
Answer: No — a meta-analysis is the optional statistical-pooling step performed within some systematic reviews. A review can be fully systematic with no pooled estimate at all.

Related cards

Ready to build your plan? EMF Premium gives you all 40,000+ questions, 20 mocks and 1,215 OSCE stations from £29/month — or a one-off 3- or 6-month pass.

Share
0
    0
    Your Cart
    Your cart is emptyReturn to Shop