Home/Critical Appraisal
Critical Appraisal

Real-World Evidence & Registry Data

EM FINAL EXAMS Critical Appraisal · Evidence sources Real-World Evidence & Registry Data Evidence from routinely-collected data that reflects actual, everyday practice — powerful, but observational. Definition Real-world evidence (RWE) is generated from routinely-collected real-world data — disease registries, electronic health records (EHRs), and administrative or insurance-claims databases — rather than from a controlled trial. […]

EM FINAL EXAMS Critical Appraisal · Evidence sources

Real-World Evidence & Registry Data

Evidence from routinely-collected data that reflects actual, everyday practice — powerful, but observational.

Definition

Real-world evidence (RWE) is generated from routinely-collected real-world data — disease registries, electronic health records (EHRs), and administrative or insurance-claims databases — rather than from a controlled trial. It captures what happens to ordinary patients in ordinary care, which is exactly its strength and its weakness: it is generalisable but it is observational.

The picture

Real patients, real practice — but no randomisation to balance the groups.

What it shows

How treatments, devices and pathways actually perform in unselected patients over long periods. RWE shines where RCTs struggle: it is large and generalisable, good for rare events and harms, long-term and real-world effectiveness, and questions where a trial would be impractical or unethical to run.

How to read it

First ask the question type. For incidence, harms, prognosis or coverage, RWE is often ideal. For a causal treatment effect, be sceptical: the groups were never randomised, so they differ systematically — sicker patients get the active treatment (confounding by indication). Look for rigorous adjustment (matching, propensity scores, multivariable models) — and remember even the best adjustment leaves residual confounding.

Why it matters

Regulators and guideline groups increasingly lean on RWE, and the ED runs on registries and audit data. Knowing it is observational stops you from reading a registry “treatment effect” as if it were trial-grade proof — the single most common appraisal error with this evidence.

Key
  • RWE = observational: association, not proof of causation
  • Great for harms, rare events, long-term & real-world effectiveness
  • Beware confounding by indication + data quality / missingness
Pitfall
Pitfall Drawing a causal treatment-effect conclusion from registry data without rigorous confounding control — and even with careful adjustment, residual and unmeasured confounding remain. A registry shows what happened, not what the treatment caused.
emfinalexams.com · FRCEM / MRCEM revision
EM trial in the wild

TARN — the Trauma Audit & Research Network is the UK’s national trauma registry (the largest in Europe, now the National Major Trauma Registry). It powers case-mix-adjusted benchmarking and a vast body of observational trauma research — injury patterns, outcomes and process measures across the whole system. Its registry studies are observational: they describe associations and adjust for case mix, but cannot randomise — so a survival difference between groups is hypothesis-generating, not proof that a treatment caused it.

Examiner traps
  • Confounding by indication — the sicker patients were the ones who got (or missed) the treatment.
  • Data quality and missingness — coding errors and incomplete records distort the picture.
  • Immortal time bias — mis-classifying the period before a treatment could even be given.
Quick check

Why be cautious about a treatment “effect” seen in registry data?
Answer: Because it is observational, not randomised — confounding by indication and data limitations (missing/inaccurate records) mean the apparent effect may reflect who got the treatment rather than the treatment itself. Any causal claim needs rigorous adjustment, and even then residual confounding remains.

Related cards

Ready to build your plan? EMF Premium gives you all 40,000+ questions, 20 mocks and 1,215 OSCE stations from £29/month — or a one-off 3- or 6-month pass.

Share
0
    0
    Your Cart
    Your cart is emptyReturn to Shop