Home/Critical Appraisal
Critical Appraisal

Confidence Intervals

EM FINAL EXAMS Critical Appraisal · Statistics Confidence Intervals The plausible range for the true effect — and a direct read on how precise the estimate is. Definition A 95% confidence interval is the range that would contain the true value in 95% of repeated samples. Its width reflects precision — driven by sample size […]

EM FINAL EXAMS Critical Appraisal · Statistics

Confidence Intervals

The plausible range for the true effect — and a direct read on how precise the estimate is.

Definition

A 95% confidence interval is the range that would contain the true value in 95% of repeated samples. Its width reflects precision — driven by sample size and variability.

The picture
no effect (=1) Study A excludes line → significant Study B crosses line → not sig. Study C excludes line → significant 0.5 1 2 ← favours treatment Effect size (ratio)

CI excludes the null line (=1) → significant; a CI that crosses it is not

What it shows

Three effect estimates, each a point estimate (dot) with its 95% CI whisker, plotted against the vertical line of no effect (=1 for ratios). Studies A and C have intervals that exclude the null (significant); Study B’s wide interval crosses it (non-significant).

How to read it

If the 95% CI excludes the null (1 for ratios, 0 for differences) the result is statistically significant. A narrow interval means a precise estimate; a wide one means uncertainty. Then ask the clinical question: are the interval’s limits meaningful?

Why it matters

A CI conveys significance and clinical relevance at once — is the whole interval trivial, or does it span both meaningful benefit and harm? That makes it far more informative than a bare p-value, which tells you only whether, not how much.

Key
  • 95% CI excludes the null → statistically significant
  • Width = precision (narrower is better)
  • Prefer CIs to bare p-values — effect size + uncertainty together
Pitfall
Pitfall A 95% CI is not “where 95% of the data lie”, and overlapping CIs do not always mean no difference — and never confuse a confidence interval (precision of the estimate) with a prediction interval (range for a future individual).
emfinalexams.com · FRCEM / MRCEM revision
EM trial in the wild

CRASH-2 (Lancet 2010) — 20,211 trauma patients with, or at risk of, significant haemorrhage, TXA vs placebo. All-cause mortality 16.0% → 14.5%, RR 0.91 (95% CI 0.85–0.97): the interval excludes 1, so the benefit is statistically significant. Statistical significance ≠ importance — always check whether the interval’s limits are clinically meaningful, not just whether it clears the null line.

Examiner traps
  • Claiming “95% of the data lie within the CI” — it describes the estimate, not the spread of observations.
  • Assuming overlapping CIs automatically mean no significant difference.
  • Confusing a confidence interval with a prediction interval.
Quick check

An RR of 0.80 with 95% CI 0.62–1.03 — significant at p<0.05?
Answer: No — the CI crosses 1, so it’s non-significant (though it may simply be underpowered, not truly null).

Related cards

Ready to build your plan? EMF Premium gives you all 40,000+ questions, 20 mocks and 1,215 OSCE stations from £29/month — or a one-off 3- or 6-month pass.

Share
0
    0
    Your Cart
    Your cart is emptyReturn to Shop