Why qbank pass does not predict FRCEM SBA pass
Facts last verified .
TL;DR — why your qbank percentage lied to you
You sat the FRCEM SBA scoring 75%+ on a question bank. You walked out feeling shaky but not catastrophic. Then the result email arrived and you failed. You are not stupid, lazy, or uniquely unlucky. There are well-documented reasons a qbank score overstates how ready you are for the real paper. The five that matter most:
- Question repetition exposure — by the time you hit 75%, you have seen most stems before. You are testing recognition, not reasoning.
- Easier stem construction — most qbanks (especially smaller UK-focused ones) write shorter, more obvious stems than the real paper. The exam buries the lead.
- No real time pressure — sitting 30 questions on the sofa is not 180 questions across two two-hour papers at a Surpass test centre.
- No fatigue, no cognitive load — you do qbank fresh, in 20-minute chunks. The real exam is four hours of dense reading with one short break.
- Mid-quartile bias — qbank algorithms and pools tend to cluster around medium difficulty. Real FRCEM SBA spreads from easy to genuinely hard, and the hard ones are where borderline candidates lose the exam.
Below: why each one happens, what the evidence and other failed-then-passed candidates say, and a concrete plan to fix it before your resit.
For more on this, see our guide to common FRCEM SBA mistakes that cost marks.
I was getting 75% on the qbank. How did I fail?
First: this is one of the most common stories on r/doctorsUK and in WhatsApp study groups. You are not an outlier. The aggregate FRCEM SBA pass rate sits around 45–48% per diet, and a large chunk of those failures are candidates whose qbank percentages looked perfectly safe (RCEM Exam Pass Rate Report 2024; StudyFRCEM pass-rate breakdown).
The honest answer: your qbank percentage was measuring a different thing from what RCEM tests on the day. It was measuring how well you recognise and answer that qbank's questions under the conditions you usually do them. It was not measuring how well you read, reason, and pace under FRCEM SBA conditions. Those two skills overlap, but they are not the same — and the gap between them is where most resit-bound candidates live.
What is actually going wrong? The five reasons in detail
1. Question repetition exposure (the recognition trap)
UK-focused FRCEM SBA banks have maybe 1,500–3,000 unique questions. By the time you have done 2,000+ items, you have seen the majority of the pool at least once. Even with spaced-repetition shuffling, your brain is now scoring partly on recognition — "I have seen this stem before, I remember the keyword" — not on first-principles reasoning.
This matches the basic finding from retrieval-practice research: testing the same items repeatedly builds strong memory for those items, but transfer to novel items and novel formats is weaker (PMC: testing effect and far transfer). The real FRCEM paper is, by design, a set of stems you have never seen before. Your recognition advantage evaporates the moment you sit down.
For more on this, see our guide to why skipping mock exams is the biggest FRCEM SBA mistake.
2. Easier stem construction
Most question banks — even the good UK ones — write stems that flag the relevant clinical thread cleanly. The stem mentions the rash, the bloods, and the obs in roughly the order you need them. The real FRCEM SBA stem will give you a paragraph of context, a comorbidity that is irrelevant, a medication that is relevant but mentioned in passing, and a vital sign that anchors you to the wrong diagnosis if you read sloppily.
RCEMLearning's own published guide warns about exactly this — that you will read "blah blah blah" for half the stem only to find the question is actually about pituitary apoplexy, and you have wasted thinking time anchoring on something else (RCEMLearning: conquering the FRCEM SBA). Qbanks rarely train this skill because their writers do not have the time or pool size to layer noise into every stem.
3. No real time pressure
FRCEM SBA is 180 single-best-answer questions across two 2-hour papers. That is roughly 80 seconds per question per paper if you want any review time at all (90 questions in 120 minutes, then a second paper of the same). RCEM's own published failure analysis identifies poor time management as the single biggest cause of failure — around 35% of unsuccessful candidates run out of time and leave answers blank (StudyFRCEM analysis of failure patterns).
When you do 30 qbank questions in the evening, you are not on a 40-second clock. You are pausing to read the explanation, looking up a guideline, possibly glancing at WhatsApp. Your percentage reflects performance in those conditions. It is not predictive of performance under exam pacing.
4. No fatigue, no cognitive load
The real exam is four hours of high-density reading after weeks of cumulative stress. You will hit a wall somewhere around question 60 of paper one, and again around question 130 of paper two. Reading comprehension drops. Anchoring errors increase. You start picking answers that "feel right" rather than reasoning through.
For more on this, see our guide to how to bounce back after failing FRCEM SBA.
One residency-prep analysis puts it bluntly: doing question blocks while sleepy, post-call, or distracted produces "trash data" that overstates your knowledge under exam conditions (ResidencyAdvisor: misuse of qbank data). The corollary is also true — doing qbank rested and calm produces data that overstates how well you will think when you are not.
5. Mid-quartile bias in qbank difficulty
Commercial qbanks have a commercial incentive: candidates who score 30% give up and cancel, candidates who score 95% feel they have wasted their money. The pool gets calibrated, consciously or not, toward middle difficulty. The real FRCEM SBA paper uses borderline regression / modified Angoff standard-setting (RCEM standard-setting method), and the question pool is intentionally distributed across the full difficulty range. The hardest 20% of the paper is harder than almost anything you saw in your qbank. Those questions are where the pass/fail line actually sits for borderline candidates.
r/doctorsUK posts from candidates who eventually passed echo the same observation: question banks do not prepare you for the detail of the real stems. The qbanks teach you patterns; the exam tests whether you can reason when the pattern is broken.
The five reasons at a glance
| Reason | What it inflates | What the real exam does instead |
|---|---|---|
| Question repetition exposure | Recognition memory for seen stems | Every stem is novel; recognition advantage = zero |
| Easier stem construction | Speed and confidence on clean stems | Stems bury the lead, add irrelevant comorbidities |
| No time pressure | Accuracy when you can pause and check | ~80 seconds per question across two 90-question papers, with little room for a second pass |
| No fatigue / cognitive load | Performance fresh, in 20-minute chunks | 4 hours of dense reading; comprehension drops late |
| Mid-quartile bias | Score on medium-difficulty items | Full difficulty range; borderline pass line sits in the hard 20% |
So is my qbank useless?
No. Qbanks are still the highest-yield single resource for FRCEM SBA prep, and most candidates who pass use one or two heavily. The problem is not the qbank — it is treating the qbank percentage as a pass predictor when it was never designed to be one.
A useful frame: your qbank percentage is a process metric, not a score. It tells you how well you are doing qbank questions under your current conditions. It does not tell you what you will score on the real paper. Treat it the way a runner treats their average training pace — it tells you whether your training is progressing, not what your race time will be.
What should I do differently for the resit?
Concrete fixes, in priority order:
- Sit a full 180-question timed mock under exam conditions, today. Two 90-question papers, 2 hours each, no breaks inside the paper, phone in another room. This is the single most informative thing you can do. Your mock score is a far better predictor than your cumulative qbank percentage. Aim for 70–75%+ on full mocks to feel confident, not 75% on cherry-picked topic blocks.
- Stop tracking your overall qbank percentage. Track instead: percentage on fresh, never-seen, timed, random blocks of 30+ questions. That is the only number that approximates real-exam conditions.
- Add a second qbank or a different source for the final 4–6 weeks. Even 200–300 questions from a different writer's style stress-tests your reasoning against stems you have not learned the rhythm of. Bromley Emergency, FRCEM Tutor, and StudyFRCEM all sit on different stem-construction styles.
- Categorise every wrong answer. For each miss, tag it: K (knowledge gap), R (reasoning error), M (misread the stem), or T (time pressure / second-guessed). If your wrong-answer log is dominated by R/M/T, the problem is not knowledge — it is exam technique, and more qbank will not fix it.
- Build exam-stamina blocks. At least once a week in the final month, do a full 90-question paper in one sitting. Notice where your accuracy drops. That tail is where you lost marks on exam day.
- Audit the professional-domain SLOs. RCEM's own failure analysis flags SLO 7 (complex challenging situations), SLO 10 (research / stats), and SLO 12 (leadership) as the most commonly under-prepared. They are about 25 questions of the paper and they are the most predictable. If you skipped them last time, that alone could account for 15–20 marks.
- Defer if your full-mock scores are still <65% four weeks out. RCEM's own borderline data shows candidates who fail and then re-sit with a changed strategy pass at ~50–55% on the second attempt; candidates who re-sit using the same approach mostly fail again.
What does "exam-conditions practice" actually look like?
If you take nothing else from this article, take this — your weekly schedule for the last 6 weeks before the resit should include at least one of these blocks:
- 90 questions, 90 minutes, no pauses, no explanations until the end.
- Random topic mix (not single-system).
- Fresh questions you have not seen — reset your qbank if you must, or use the unused tail of a second bank.
- Phone out of the room.
- Done in the morning (matching exam timing) at least once.
Mark the paper, then categorise every miss as above. The categorisation is more useful than the score.
What about the cognitive science — is there evidence for any of this?
Yes. The relevant body of work is around the testing effect and transfer of retrieval practice. The headline finding is that retrieval practice produces strong gains for items and formats you have practised, but transfer to genuinely novel items, novel question formats, or higher-order reasoning is far smaller (PMC review; Karpicke 2025 review). In plain terms: the qbank trains you on the qbank. The exam tests something adjacent but not identical, and the gap is real.
Layer on top of that the standard finding that performance under fatigue, cognitive load, and time pressure is systematically worse than performance in low-stakes practice conditions, and you have the structural reason your qbank percentage overstated your readiness. It is not a quirk of you — it is what the literature predicts.
How many real questions do I need to do?
Aggregate guidance from candidates and prep providers converges on 2,000–2,500 quality practice questions with full review as the benchmark for first-attempt success on FRCEM SBA, with 1,500 a realistic floor (StudyMedical: practice question targets; StudyFRCEM benchmarks). But the number is less important than the conditions. 1,500 questions done fresh, timed, random, and properly reviewed will beat 4,000 questions done sleepily on repeat.
What if I have already done 4,000+ questions and still failed?
Then the problem is almost certainly not raw knowledge volume. It is one of:
- Reasoning / reading errors — you knew the content but misread the stem under pressure.
- Pacing — you ran out of time on paper one or paper two.
- Topic blind spots — professional-domain SLOs, paediatric resuscitation, statistics, toxicology in the more obscure forms.
- Recognition collapse — your qbank percentage was inflated by repeat exposure; on fresh stems you are actually scoring 60–65%, not 75%.
The diagnostic is a full, timed, fresh-question 180-question mock. If you score 70%+ on that, you are knowledge-ready and the issue is exam-day technique or anxiety. If you score <65%, your true knowledge level is below pass, and you need to rebuild the weak SLOs, not just do more questions.
FAQ
Is the FRCEM SBA actually harder than the qbanks make it look?
For the hardest 20–30 questions on the paper, yes. The middle-difficulty bulk of the exam is comparable to good qbanks. The borderline pass line sits in the harder questions, and that is where most failures lose the exam.
I scored 80% on my qbank and still failed by 4 marks. Was the exam unfair?
Almost certainly not. The exam uses standard-setting (modified Angoff / borderline regression) that adjusts the pass mark to keep the standard consistent across diets. A 4-mark fail with an 80% qbank average usually reflects (a) recognition inflation on repeated questions, (b) underperformance on the hardest 20% of the paper, and (c) lost marks on the professional-domain SLOs that qbanks often under-cover.
Should I switch qbanks for the resit?
Not entirely — your existing bank, with its review history, is still useful. But add a second source for the final 4–6 weeks. The goal is to break your over-fit to one writer's stem style, not to start from scratch.
How many full-length mocks should I sit before the resit?
At minimum, 3–4 full 180-question timed mocks in the last 6 weeks. Many successful candidates do more. The mock score is the most predictive number you have.
My weakest SLOs are research/statistics and complex situations. How do I fix them fast?
These are the highest-yield, lowest-effort fixes. RCEM publishes clear curriculum descriptors for SLOs 7, 10 and 12, and the question patterns are predictable. A focused 2-week block on these alone often shifts a borderline candidate above the pass line.
Is the exam test-anxiety, or is it real knowledge?
Run the diagnostic above: full, timed, fresh mock. If you score 70%+ in mock conditions but failed the real exam, anxiety and pacing are the dominant factors and you should address those (timed practice, sleep, mental rehearsal, sometimes formal anxiety management). If you score <65% in mock conditions, the issue is knowledge and you need targeted SLO rebuilding.
Does it help to defer the resit?
Yes, if your current full-mock scores are below 65%. RCEM's broader data shows candidates who re-sit with a changed strategy pass at noticeably higher rates than those who re-sit on the next available diet with no change.
What about cramming the week before — does it help?
Cramming low-yield trivia hurts more than it helps. The week before should be light review of high-yield guidelines (sepsis, ACS, paediatric resus, toxicology antidotes), full timed mocks under exam conditions, and sleep. The content you cram in the final 5 days is rarely the content the exam tests.
Do international medical graduates have lower pass rates on FRCEM SBA?
RCEM does not publish stratified data, but qualitative reports suggest IMGs face added challenges with UK-specific guidelines (NICE, RCEM clinical guidance), UK medicolegal and consent frameworks, and the implicit reasoning patterns the exam rewards. Extra preparation on UK-specific material is sensible.
Will doing more qbank questions raise my real-exam score?
Beyond about 2,000–2,500 well-reviewed questions, additional volume gives diminishing returns. Beyond 4,000, more questions usually do not move the needle — at that point the bottleneck is exam technique, fresh-question practice, or SLO blind spots, not raw question volume.
How long should I leave before the resit?
If you failed by a small margin and your mock scores are 65–70%, 3–4 months of focused, conditions-based practice is usually enough. If you failed by a wider margin or your mocks are below 65%, plan for 6 months and use the time to rebuild weak SLOs from the curriculum up.
Next step: if you want a focused, exam-conditions-first revision plan for your resit — including structured full-paper mocks and SLO-mapped weakness tracking — start at emfinalexams.com.
Facts last verified .
Ready to build your plan? EMF Premium gives you all 40,000 questions and 20 mocks for £59 — one payment, six months' access.