Study guide
18.1 Study Design, Bias & Causation
NBME Comprehensive Basic Science Examination CBSE
Track your progress as you read
Finished sections get a check mark.
1 Introduction & Exam Navigation
1.1 Current Exam Facts & Administration 1.2 Content Blueprint & Physician Tasks 1.3 Scoring, Score Reports & Step 1 Readiness
2 Human Development
2.1 Embryology & Congenital Development Patterns 2.2 Normal Age-Related Findings & Well-Patient Care
3 Blood & Hematologic Disease
3.1 Hematopoiesis, RBC Disorders & Anemias 3.2 Hemostasis, Thrombosis & Coagulopathies 3.3 WBC Disorders, Leukemia & Lymphoma Mechanisms
4 Immune System
4.1 Innate & Adaptive Immunity Mechanisms 4.2 Hypersensitivity, Autoimmunity & Immunodeficiency 4.3 Transplant Immunology & Immune Pharmacology
5 Nervous System Anatomy & Disease
5.1 Neuroanatomy Localization & Pathways 5.2 Stroke, Infection, Demyelination & Trauma 5.3 Seizures, Movement Disorders & Neurodegeneration 5.4 Special Senses: Eye & Ear Mechanisms
6 Behavioral Health
6.1 Psychiatric Disorders & Diagnostic Patterns 6.2 Psychopharmacology Mechanisms 6.3 Neurotransmitters, Learning & Behavioral Science
7 Musculoskeletal System
7.1 Bone Physiology, Fracture Healing & Bone Pathology 7.2 Joint Disease, Rheumatology & Connective Tissue 7.3 Muscle, NMJ & Peripheral Nerve Disorders
8 Skin & Soft Tissue
8.1 Dermatopathology High-Yield Lesions 8.2 Inflammation, Wound Healing & Soft-Tissue Infection
9 Cardiovascular Pathophysiology
9.1 Cardiac Cycle, Hemodynamics & Murmurs 9.2 Ischemic Heart Disease & Cardiomyopathy 9.3 Congenital & Valvular Heart Disease 9.4 Vascular Pathology & Hypertension
10 Cardiovascular Pharmacology
10.1 Antihypertensives, Heart Failure & Antiarrhythmics 10.2 Antiplatelets, Anticoagulants & Lipid Drugs
11 Respiratory System
11.1 Pulmonary Mechanics & Gas Exchange 11.2 Obstructive, Restrictive & Vascular Lung Disease 11.3 Pulmonary Infections, Neoplasms & Respiratory Pharmacology
12 Renal Physiology & Electrolytes
12.1 Nephron Transport & Renal Physiology 12.2 Electrolyte Disorders 12.3 Acid-Base Physiology & Compensation
13 Renal Pathology
13.1 Glomerular Disease Mechanisms 13.2 Tubulointerstitial, Vascular & Stone Disease
14 Gastrointestinal System
14.1 GI Physiology, Motility & Digestion 14.2 Esophagus, Stomach & Intestinal Pathology 14.3 Liver, Biliary Tree & Pancreas 14.4 GI Microbiology, Nutrition & Malabsorption
15 Endocrine System
15.1 Hormone Signaling & Hypothalamic-Pituitary Axes 15.2 Thyroid & Parathyroid Disease 15.3 Adrenal Disorders & Steroid Pharmacology 15.4 Diabetes, Glucose Homeostasis & Metabolic Syndrome
16 Reproductive System
16.1 Male & Female Reproductive Physiology 16.2 Pregnancy, Placenta & Developmental Toxicology 16.3 Reproductive Pathology & Hormone-Related Neoplasia
17 Multisystem Processes & Disorders
17.1 Cell Injury, Inflammation & Repair 17.2 Neoplasia Principles & Tumor Biology 17.3 Infection, Sepsis & Multisystem Microbial Disease 17.4 Genetics, Inborn Errors & Environmental Toxicology
18 Biostatistics & Epidemiology
18.1 Study Design, Bias & Causation 18.2 Diagnostic Test Metrics & Screening 18.3 Epidemiology Measures & Population Health
19 Social Sciences & Communication
19.1 Ethics Principles & Decision-Making Capacity 19.2 Communication Skills & Difficult Conversations 19.3 Professionalism, Systems & Practice-Based Learning
20 Integrated Disciplines Capstone
20.1 High-Yield Microbiology Anchors Across Systems 20.2 High-Yield Biochemistry & Molecular Mechanisms 20.3 Integrated Pharmacology Strategy & Exam-Day Execution
18.1 Study Design, Bias & Causation
Key Takeaways Explain This Topic AI
Evidence hierarchy (weakest → strongest for causal inference): case report/series → cross-sectional → case-control → cohort → RCT → systematic review/meta-analysis of RCTs; design choice still depends on feasibility and ethics.
Use relative risk (RR) from cohort or RCT data (incidence in exposed ÷ incidence in unexposed); use odds ratio (OR) from case-control studies when true incidence is unknown; OR ≈ RR only when the outcome is rare.
Absolute risk reduction (ARR) = control event rate − treatment event rate; NNT = 1/ARR; NNH = 1/ARI; relative measures alone overstate clinical impact when baseline risk is low.
Major biases: selection (who enters), recall (who remembers exposures), observer/information (who measures outcomes), and confounding (a third factor associated with both exposure and outcome); control with randomization, matching, restriction, stratification, and multivariable adjustment.
Intention-to-treat preserves randomization; lead-time bias advances diagnosis without changing death date; length-time bias preferentially detects slow-growing disease; Hill criteria support (do not prove) causal judgment.
Last updated: August 2026
18.1 Study Design, Bias & Causation
Quick Answer: Match design to question: prevalence → cross-sectional; rare disease/multiple exposures → case-control (OR); incidence/multiple outcomes → cohort (RR); efficacy with least confounding → RCT. ARR = CER − EER; NNT = 1/ARR. Randomize to balance confounders, blind to reduce observer bias, analyze by intention-to-treat, and do not confuse earlier diagnosis (lead-time) or indolent disease detection (length-time) with longer life.
Biostatistics and epidemiology on the CBSE (and Step 1–style exams) reward disciplined labeling: name the design, name the measure, name the bias, then compute. This section builds the design hierarchy, risk metrics with worked numbers, bias taxonomy, mitigation strategies, and light causal reasoning including screening artifacts.
Hierarchy of Study Designs
Think of designs as tools ordered by how strongly they support causal inference when well executed—not as a moral ranking of investigators.
- Design Unit / approach Typical question Strength for causation
- Case report / series One or few patients "What happened?" signal generation Weakest
Cross-sectional Exposure and outcome measured at one time Prevalence; association snapshot Weak (temporality unclear)
Case-control Sample by outcome; look back at exposures Rare disease; multiple exposures Moderate (selection/recall risk)
Cohort Sample by exposure; follow for outcomes Incidence; multiple outcomes; natural history Stronger (temporality clear)
Randomized controlled trial (RCT) Random assignment to intervention Treatment efficacy/safety Strong for intervention effect
Meta-analysis / systematic review Pooled estimates across studies Overall effect size, heterogeneity Potentially strongest if input RCTs are high quality
Case reports and series describe unusual presentations or clusters. They cannot estimate incidence or prove causality, but they generate hypotheses (e.g., a new drug rash series).
Cross-sectional studies measure exposure and disease at the same time (surveys, screening camps). They estimate prevalence and associations, but cannot establish whether exposure preceded disease. Classic trap: concluding that low exercise "causes" obesity from a one-time survey when reverse causation or confounding is equally plausible.
Case-control studies start with cases (disease) and controls (no disease), then compare prior odds of exposure . Ideal for rare outcomes and when many exposures are of interest. You generally cannot compute incidence from the sample (you fixed the number of cases), so the natural measure is the odds ratio (OR) .
Cohort studies start with exposed vs unexposed people free of the outcome and follow them forward (or reconstruct forward with historical records). You observe incidence , so relative risk (RR) is natural. Good for rare exposures and multiple outcomes; expensive and slow for rare diseases with long latency unless the cohort is huge or retrospective.
RCTs assign intervention by chance , balancing known and unknown confounders in expectation. Blinding and allocation concealment protect against performance and detection bias. Ethics limit RCTs when the intervention is clearly harmful or when the outcome is extremely rare.
Meta-analyses combine quantitative results. Quality tracks the underlying studies: pooling biased observational studies yields a precise but still biased summary.
- Relative Risk vs Odds Ratio
- Definitions
Build a classic 2×2 from a cohort or trial (rows = exposure/treatment; columns = disease yes/no):
- Disease + Disease −
- Exposed a b
- Unexposed c d
- Incidence in exposed = a / (a + b)
- Incidence in unexposed = c / (c + d)
- Relative risk (RR) = [a/(a+b)] ÷ [c/(c+d)]
- Odds of disease in exposed = a/b; in unexposed = c/d
- Odds ratio (OR) = (a/b) ÷ (c/d) = ad/bc
Rule for exams:
Cohort / RCT with incidence data → prefer RR (and absolute measures).
Case-control → OR (incidence usually not estimable).
When disease is rare (roughly <10% in both groups), OR ≈ RR; when common, OR exaggerates the association relative to RR.
Worked example 1 — Cohort RR and OR
In a 5-year cohort of 2,000 smokers and 2,000 nonsmokers:
- Lung cancer + Lung cancer − Total
- Smokers 80 1,920 2,000
- Nonsmokers 10 1,990 2,000
- Incidence smokers = 80/2000 = 0.040 (4.0%)
- Incidence nonsmokers = 10/2000 = 0.005 (0.5%)
- RR = 0.040 / 0.005 = 8.0
- OR = (80 × 1990) / (1920 × 10) = 159,200 / 19,200 ≈ 8.29
Disease is uncommon, so OR ≈ RR. Interpretation: smokers had eight times the risk of lung cancer versus nonsmokers over follow-up (observational—confounding by other factors still possible).
Worked example 2 — When OR diverges from RR
Common outcome (e.g., any infection after surgery):
- Infection + Infection − Total
- Drug A 40 60 100
- Drug B 20 80 100
- RR = (40/100) / (20/100) = 2.0
- OR = (40×80)/(60×20) = 3200/1200 ≈ 2.67
Same data, different numbers: reporting OR as if it were RR overstates relative effect when the outcome is common.
Worked example 3 — Case-control OR only
Investigators identify 100 myocardial infarction (MI) cases and 100 controls, then ascertain prior NSAID exposure:
- MI + MI −
- NSAID + 30 15
- NSAID − 70 85
- OR = (30×85)/(15×70) = 2550/1050 ≈ 2.43
You cannot say "2.43 times the risk" as a population RR without incidence data; say "odds of prior NSAID use were 2.43-fold higher among cases than controls" (still subject to confounding and selection of controls).
Absolute Risk Reduction, NNT, and NNH
Relative measures hide baseline risk. Always recover absolute metrics for clinical meaning.
- Control event rate (CER) = outcome rate in control arm
- Experimental event rate (EER) = outcome rate in treatment arm
- Absolute risk reduction (ARR) = CER − EER (for beneficial reduction of bad outcomes)
- Relative risk reduction (RRR) = ARR / CER = 1 − RR
- Number needed to treat (NNT) = 1 / ARR (round up to whole patients for teaching)
- Absolute risk increase (ARI) = EER − CER when treatment raises harm
- Number needed to harm (NNH) = 1 / ARI
- Worked example 4 — NNT with high baseline risk
In a secondary-prevention RCT, 5-year MI rates:
- Placebo: 20/100 = 0.20
- Drug X: 12/100 = 0.12
- ARR = 0.20 − 0.12 = 0.08
- RR = 0.12/0.20 = 0.60 (RRR = 40%)
- NNT = 1/0.08 = 12.5 → 13 patients treated for 5 years to prevent one MI
- Worked example 5 — Same RRR, different NNT (low baseline risk)
Primary prevention, same relative effect:
- Placebo event rate 2% (0.02)
- Drug event rate 1.2% (0.012)
- ARR = 0.008; RRR still 40%; NNT = 1/0.008 = 125
Marketing may advertise "40% fewer events" in both trials; NNT shows far less absolute benefit when baseline risk is low—high-yield exam contrast.
Worked example 6 — NNH
Serious bleed rates: drug 3/100, placebo 1/100.
ARI = 0.03 − 0.01 = 0.02 ; NNH = 50 .
If NNT for benefit is 13 and NNH is 50, roughly four patients benefit per one harmed for those endpoints (crude comparison—time frame and severity must match).
Bias Taxonomy
Bias is systematic error; it does not average out with larger n (unlike random error).
Bias Core idea Classic setting
Selection bias Who enters or is retained differs by exposure/outcome in a way that distorts association Healthy-worker effect; loss to follow-up related to outcome; case-control with noncomparable controls
Recall bias Cases remember exposures differently than controls Case-control of birth defects and prenatal meds
Observer / detection / information bias Measurement of exposure or outcome differs by group Unblinded outcome assessors; surveillance bias in more closely followed patients
Confounding Third factor associated with exposure and independently with outcome Coffee–MI association confounded by smoking
Lead-time bias Earlier diagnosis lengthens measured survival without delaying death Cancer screening survival from diagnosis date
Length-time bias Screening detects preferentially slow, indolent disease Overrepresentation of favorable biology among screen-detected cancers
Confounding vs bias language: Confounding is a mixing of effects; it can sometimes be controlled in analysis if measured. Selection and information biases often cannot be fully fixed after the fact.
Confounding worked sketch
Crude data: heavy coffee drinkers have higher MI rates. Smokers drink more coffee and have higher MI rates. After stratification by smoking, coffee–MI association shrinks toward null → smoking was a confounder . Randomization aims to balance smoking (and unmeasured factors) across arms so crude treatment effects are unconfounded in expectation.
Mitigating Bias and Confounding
- Strategy What it does
- Randomization Balances known/unknown confounders at baseline
- Allocation concealment Prevents selection bias at enrollment (who gets next assignment)
- Blinding Reduces performance and detection bias (patients, clinicians, assessors, analysts)
Matching (case-control or cohort) Balances selected confounders (age, sex); overmatching on intermediates can hurt
- Restriction Study only one level of confounder (nonsmokers only)
- Stratification / multivariable models Analytic control of measured confounders
- Standardized protocols / objective endpoints Reduce information bias
Intention-to-treat (ITT) Analyze as randomized, regardless of adherence; preserves prognostic balance; estimates real-world effectiveness under nonadherence
Per-protocol / as-treated analyses estimate effect among adherers but reintroduce selection confounding (who adheres differs). Exams often ask why ITT is preferred for primary superiority analyses of pragmatic trials.
Worked conceptual example — ITT vs per-protocol
RCT of exercise counseling: many assigned to exercise drop out. ITT still counts them in the exercise arm (conservative if dropouts do poorly). Per-protocol keeps only completers, who may be healthier → exaggerated benefit.
Causation: Hill Criteria (Light)
Bradford Hill viewpoints help judge whether an association is likely causal (none is absolute proof):
- Strength — large RR/OR more suggestive (not required)
- Consistency — repeated in different populations/methods
- Specificity — one exposure–one effect (weak criterion; many causes are multifactorial)
- Temporality — exposure before outcome ( essential )
- Biological gradient — dose–response
- Plausibility — fits known biology
- Coherence — consistent with natural history/lab data
- Experiment — removal of exposure reduces disease; RCT evidence
- Analogy — similar to other causal pairs
Exam use: absence of temporality kills causal claims; large, consistent, dose-responsive associations with experimental support are strongest narratives.
Lead-Time and Length-Time Bias (Screening Intro)
Lead-time bias: Screening diagnoses disease earlier. Survival measured from diagnosis appears longer even if death occurs at the same age. Fix: compare mortality rates (deaths per population-time), not survival from diagnosis alone.
Example sketch: Untreated aggressive cancer kills at age 60 whether diagnosed at 58 (2-year survival) or screened at 55 (5-year survival). Lead time = 3 years; true life span unchanged.
Length-time bias: Slowly progressive disease spends more time in a detectable preclinical phase, so screening disproportionately finds indolent cases with better prognosis. Aggressive interval cancers present clinically between screens. Fix: randomized screening trials with mortality endpoints; beware survival comparisons of screen-detected vs symptom-detected cases.
Integration for CBSE Vignettes
Stem samples by disease and looks backward → case-control → OR .
Stem follows exposed workers for incidence → cohort → RR , watch healthy-worker selection.
Stem randomizes drug vs placebo → compute ARR/NNT ; if they give only RRR, recover absolute rates if possible.
Positive association disappears after adjusting for smoking → confounding .
Unblinded radiologists more often call "progression" on new drug → observer bias .
Screening program boasts longer 5-year survival without mortality drop → lead-time (and possibly length-time/overdiagnosis ).
Map design → valid measure → absolute impact → residual bias. That sequence solves most study-design items on the CBSE.