Common misconceptions

Common mistake
Wrong: Randomization eliminates bias by making the groups identical in all measured variables.
Right: Randomization distributes both known and unknown confounders equally between groups on average, enabling causal inference even when confounders are unmeasured.
Randomization's power is not that it makes groups identical — with finite sample sizes, groups will differ on many variables by chance. The key insight is that randomization makes these differences random rather than systematic, which means both known and unknown confounders are distributed equally between groups on average. This is what no observational design can replicate: you can control for confounders you measure, but you can never control for ones you don't know to measure.
Common mistake
Wrong: Phase II trials test efficacy in large populations.
Right: Phase II trials assess preliminary efficacy and dosing in a small group; large-scale efficacy is tested in Phase III trials.
Phase II trials are small and exploratory — they answer 'does this drug do anything in actual patients, and at what dose?' not 'does this drug work better than standard of care at scale?' That question belongs to Phase III, which uses large randomized samples to establish efficacy and compare against existing treatments. A reliable trigger: if a question says 'hundreds of patients' and 'comparative efficacy,' think Phase III; if it says 'small group' and 'dose-finding,' think Phase II.
Common mistake
Wrong: Intention-to-treat analysis excludes participants who dropped out or did not comply.
Right: Intention-to-treat analysis includes all randomized participants in their originally assigned groups regardless of compliance or dropout, preserving the benefits of randomization.
Intention-to-treat (ITT) analysis includes every participant in the group they were originally randomized to, even if they switched treatments, dropped out, or never actually took the drug. This preserves the randomization — if you only analyze completers (per-protocol), you systematically exclude sicker or less tolerant patients, reintroducing selection bias and defeating the purpose of randomization. ITT gives a conservative, real-world effectiveness estimate; per-protocol gives a best-case efficacy estimate under ideal adherence.
Common mistake
Wrong: Blinding only prevents placebo effect in the patient.
Right: Double-blinding prevents both patient placebo effect and investigator/observer bias in outcome assessment by keeping both parties unaware of treatment assignment.
Blinding does two separate jobs depending on who it targets. Blinding the patient prevents the placebo effect — the patient's belief about their treatment influencing their subjective outcomes. Blinding the investigator prevents observer bias — the researcher's knowledge of treatment assignment unconsciously influencing how they measure or record outcomes. Double-blinding does both simultaneously, which is why it's the standard for rigorous trials. Single-blinding covers only one of these, which is often insufficient.
Free Deck audit

See if your Anki deck covers this topic.

Upload your deck →
Guided session

Stuck on this? An AI tutor that probes your understanding.

Start a session →

What the exam tests

  1. Recognize RCTs as the only study design that can establish causation, and explain why other designs (cohort, case-control) cannot make the same claim
  2. Explain the mechanism by which randomization enables causal inference — specifically that it distributes unmeasured confounders between groups, not just measured ones
  3. Identify what each phase of a clinical trial tests: Phase I (safety/dosing in healthy volunteers), Phase II (preliminary efficacy and dosing in small patient groups), Phase III (large-scale efficacy and safety comparison), and Phase IV (post-market surveillance)
  4. Match each level of blinding (single, double, triple) to the specific bias it prevents — patient placebo effect, investigator/observer bias, and data analyst bias respectively
  5. Distinguish intention-to-treat analysis (all randomized participants analyzed as assigned) from per-protocol analysis (completers only), and know when each is preferred and what each preserves or sacrifices

Can you avoid these mistakes?

A Phase II trial of a new antihypertensive shows promising blood pressure reduction in 80 patients. The investigators conclude the drug is effective and want to submit for FDA approval. What critical step are they skipping, and why can't Phase II data alone support an approval claim?
In an RCT of a new antidepressant, 20% of participants in the treatment arm drop out due to side effects. The researchers analyze only the participants who completed the trial. What type of analysis is this, what bias does it introduce, and how would intention-to-treat analysis handle these dropouts differently?
A researcher claims that randomization in their RCT guarantees the treatment and control groups are balanced on all baseline characteristics. Is this accurate? Explain the actual mechanism by which randomization supports causal inference.
An RCT uses double-blinding. One critic argues that only the patient needs to be blinded because the investigator is objective. What specific bias does blinding the investigator prevent, and why would single-blinding (patient only) be insufficient in a trial with subjective outcome measures like pain scores?

Related topics

See how your Anki deck covers this topic.

Upload your deck for a free audit →