Study guide

1.4 Evidence-Based Medicine, Study Design, & Clinical Statistics

Medical Council of Canada Qualifying Examination Part I MCCQE Part I

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: Exam Overview, Blueprint & Canadian Medical Practice

1.1 MCCQE Part I Format, Scoring (439 Scale), & Strategy 1.2 The MCC Blueprint Matrix: Dimensions of Care & Physician Activities 1.3 Canadian Healthcare System, CanMEDS Roles, & Interprofessional Care 1.4 Evidence-Based Medicine, Study Design, & Clinical Statistics

2 Chapter 2: Population Health, Health Promotion & Preventive Care

2.1 Canadian Task Force on Preventive Health Care (CTFPHC) Screening Guidelines 2.2 Immunization Schedules (NACI) & Vaccine-Preventable Diseases across Lifespan 2.3 Disease Prevention, Lifestyle Counselling, & Harm Reduction 2.4 Outbreak Management, Disease Surveillance, & Infection Control 2.5 Occupational, Environmental, & Travel Medicine in Canada

3 Chapter 3: Internal Medicine — Cardiovascular & Respiratory Systems

3.1 Hypertension Canada 2020/2025 Guidelines, Dyslipidemia, & Primary Prevention 3.2 Ischemic Heart Disease, Acute Coronary Syndromes, & Heart Failure Management 3.3 Arrhythmias, Valvular Heart Disease, & Infective Endocarditis 3.4 Asthma, COPD, & Respiratory Failure (CTS Guidelines) 3.5 Thromboembolic Disease (DVT/PE), Pneumonia, & Pleural Effusions

4 Chapter 4: Internal Medicine — GI, Endocrine, Renal & Hematology/Oncology

4.1 Gastrointestinal Disorders, Acute Abdomen, & Liver/Biliary Disease 4.2 Diabetes Canada 2020/2025 Guidelines & Glycemic Management 4.3 Thyroid, Adrenal, Pituitary, & Electrolyte Disturbances 4.4 Acute Kidney Injury (AKI), Chronic Kidney Disease (CKD), & Nephrology 4.5 Hematology, Anemia Evaluation, Transfusion Medicine, & Common Cancers

5 Chapter 5: General Surgery, Orthopedics, & Emergency Care

5.1 Surgical Evaluation, Preoperative Clearance, & Postoperative Complications 5.2 Trauma Management (ATLS Protocol) & Burns 5.3 Acute Surgical Conditions (Appendicitis, Cholecystitis, Bowel Obstruction) 5.4 Fractures, Dislocations, Joint Pain, & Musculoskeletal Emergencies 5.5 Vascular Emergencies, Wound Care, & Shock Recognition

6 Chapter 6: Pediatrics & Adolescent Health

6.1 Pediatric Growth, Developmental Milestones, & Well-Child Examinations 6.2 Neonatal Resuscitation, Jaundice, & Common Congenital Anomalies 6.3 Pediatric Respiratory Emergencies (Croup, Bronchiolitis, Asthma) 6.4 Common Pediatric Infections, Exanthems, & Fever of Unknown Origin 6.5 Pediatric Abdominal Pain, Dehydration, & Fluid Management

7 Chapter 7: Obstetrics & Gynecology

7.1 Routine Antepartum Care, Screening, & Prenatal Diagnosis (SOGC Guidelines) 7.2 Medical Complications of Pregnancy (Preeclampsia, Gestational Diabetes, Infections) 7.3 Labor, Intrapartum Management, & Postpartum Complications/Hemorrhage 7.4 Abnormal Uterine Bleeding, Gynecologic Infections, & Contraception/Menopause 7.5 Gynecologic Oncology & Pelvic Mass Evaluation

8 Chapter 8: Psychiatry & Mental Health

8.1 Mood Disorders (Depression, Bipolar) & Suicide Risk Assessment 8.2 Anxiety Disorders, OCD, PTSD, & Somatic Symptom Disorders 8.3 Psychotic Disorders & Schizophrenia Management 8.4 Substance Use Disorders, Withdrawal Syndromes, & Harm Reduction 8.5 Pediatric, Perinatal, & Geriatric Psychiatry (Cognitive Impairment / Delirium)

9 Chapter 9: Neurology, Rheumatology, & Dermatology

9.1 Acute Stroke, TIA, & Neurovascular Emergencies 9.2 Headaches, Seizures, Movement Disorders, & Neuromuscular Disease 9.3 Inflammatory Arthritides (RA, Gout, SpA) & Systemic Autoimmune Diseases (SLE, Vasculitis) 9.4 Common Dermatologic Conditions, Cutaneous Manifestations of Systemic Disease, & Skin Cancers 9.5 Musculoskeletal Soft Tissue Injuries, Back Pain, & Physical Medicine

10 Chapter 10: Legal, Ethical, & Professional Behaviours in Canadian Practice

10.1 Informed Consent, Capacity Assessment, & Substitute Decision-Making (CMPA) 10.2 Medical Confidentiality, Privacy Laws (PIPEDA/PHIPA), & Disclosure of Harm 10.3 CMA Code of Ethics, Professionalism, & Physician Health/Boundary Issues 10.4 Mandatory Reporting (Child/Elder Abuse, Driving Safety, Fitness to Practice) & Quality/Safety

1.4 Evidence-Based Medicine, Study Design, & Clinical Statistics

Key Takeaways Explain This Topic AI

Systematic reviews of randomized controlled trials (RCTs) represent the highest level of evidence for therapeutic interventions.

Sensitivity rules OUT disease when negative (SnNOut); Specificity rules IN disease when positive (SpPIn).

Positive and Negative Predictive Values (PPV/NPV) depend heavily on disease prevalence, whereas Likelihood Ratios (LR+/LR-) are independent of prevalence.

Absolute Risk Reduction (ARR) dictates the Number Needed to Treat (NNT = 1 / ARR); NNT calculations must always be rounded UP to the nearest integer.

Screening programs are vulnerable to lead-time bias (earlier detection mistaken for prolonged survival) and length-time bias (disproportionate detection of indolent cases).

Last updated: July 2026

1.4 Evidence-Based Medicine, Study Design, & Clinical Statistics

EBM Core Principle: Clinical decision-making on the MCCQE Part I requires integrating the best available research evidence with clinical expertise and patient values. Candidates must evaluate study designs, calculate diagnostic and therapeutic statistics, and identify methodological biases.

Hierarchy of Evidence & Study Designs

Medical evidence is structured hierarchically based on susceptibility to bias: ▲ [ Level 1: Systematic Reviews & Meta-Analyses ]

  • ╱ ╲
  • ╱ ╲ [ Level 2: Randomized Controlled Trials (RCTs) ]
  • ╱ ╲
  • ╱ ╲ [ Level 3: Cohort Studies (Prospective/Retrospective) ]
  • ╱ ╲
  • ╱ ╲ [ Level 4: Case-Control Studies (Retrospective) ]
  • ╱ ╲
  • ╱ ╲ [ Level 5: Cross-Sectional Studies / Case Series ]
  • └─────────────────┘
  • Epidemiological Study Design Summary

Study Design Temporal Direction Key Metric Primary Advantage Major Limitation

Randomized Controlled Trial (RCT) Prospective Relative Risk (RR) / ARR Establishes causality; minimizes confounding via randomization. Expensive; ethical constraints.

Cohort Study Prospective or Retrospective Relative Risk (RR) / Incidence Excellent for rare exposures ; assesses temporal sequence. Vulnerable to loss to follow-up and confounding.

Case-Control Study Retrospective Odds Ratio (OR) Excellent for rare diseases ; fast and inexpensive. Highly vulnerable to recall bias and selection bias.

Cross-Sectional Study Single point in time Prevalence Fast; generates hypotheses. Cannot establish causality or temporal sequence.

Diagnostic Testing Metrics & The 2x2 Table

Diagnostic testing performance is evaluated using a standard 2x2 contingency table comparing test results against a gold-standard reference.

Disease Present ( D + D+ D + ) Disease Absent ( D − D- D − ) Total

Test Positive ( T + T+ T + ) True Positive ( T P TP TP ) False Positive ( F P FP FP ) T P + F P TP + FP TP + FP

Test Negative ( T − T- T − ) False Negative ( F N FN FN ) True Negative ( T N TN TN ) F N + T N FN + TN FN + TN

  • Total T P + F N TP + FN TP + FN F P + T N FP + TN FP + TN N N N
  • Diagnostic Test Formulas

Sensitivity (Sn): T P T P + F N \frac{TP}{TP + FN} TP + FN TP ​ — Probability that a test is positive given the disease is present. High sensitivity tests have few false negatives ( SnNOut : Negative test rules OUT disease). Ideal for screening .

Specificity (Sp): T N T N + F P \frac{TN}{TN + FP} TN + FP TN ​ — Probability that a test is negative given the disease is absent. High specificity tests have few false positives ( SpPIn : Positive test rules IN disease). Ideal for confirmation .

Positive Predictive Value (PPV): T P T P + F P \frac{TP}{TP + FP} TP + FP TP ​ — Probability of having disease if test is positive. PPV increases as disease prevalence increases.

Negative Predictive Value (NPV): T N T N + F N \frac{TN}{TN + FN} TN + FN TN ​ — Probability of being disease-free if test is negative. NPV decreases as disease prevalence increases.

Positive Likelihood Ratio ( L R + LR+ L R + ): Sensitivity 1 − Specificity = TP Rate FP Rate \frac{\text{Sensitivity}}{1 - \text{Specificity}} = \frac{\text{TP Rate}}{\text{FP Rate}} 1 − Specificity Sensitivity ​ = FP Rate TP Rate ​ . An L R + > 10 LR+ > 10 L R + > 10 strongly confirms disease.

Negative Likelihood Ratio ( L R − LR- L R − ): 1 − Sensitivity Specificity = FN Rate TN Rate \frac{1 - \text{Sensitivity}}{\text{Specificity}} = \frac{\text{FN Rate}}{\text{TN Rate}} Specificity 1 − Sensitivity ​ = TN Rate FN Rate ​ . An L R − < 0.1 LR- < 0.1 L R − < 0.1 strongly rules out disease.

Key Distinction: Likelihood Ratios are independent of disease prevalence .

Interventional & Risk Statistics Formulas

When evaluating therapeutic clinical trials, risks must be expressed in absolute and relative terms:

  • Risk in Experimental Group ( R e R_e R e ​ ): a a + b \frac{a}{a + b} a + b a ​
  • Risk in Control Group ( R c R_c R c ​ ): c c + d \frac{c}{c + d} c + d c ​
  • Relative Risk (RR): R e R c \frac{R_e}{R_c} R c ​ R e ​ ​

Relative Risk Reduction (RRR): R c − R e R c = 1 − R R \frac{R_c - R_e}{R_c} = 1 - RR R c ​ R c ​ − R e ​ ​ = 1 − RR

Absolute Risk Reduction (ARR): ∣ R c − R e ∣ |R_c - R_e| ∣ R c ​ − R e ​ ∣

Number Needed to Treat (NNT): 1 ARR = 1 ∣ R c − R e ∣ \frac{1}{\text{ARR}} = \frac{1}{|R_c - R_e|} ARR 1 ​ = ∣ R c ​ − R e ​ ∣ 1 ​

Rule: Always round UP to the next whole integer (e.g., N N T = 14.2 → 15 NNT = 14.2 \rightarrow 15 NNT = 14.2 → 15 ).

Number Needed to Harm (NNH): 1 ARI \frac{1}{\text{ARI}} ARI 1 ​ (where ARI = Absolute Risk Increase).

Rule: Always round DOWN to the next whole integer.

  • Biases, Confounding, & Screening Fallacies
  • 1. Selection & Information Biases

Selection Bias: Non-random sampling leading to a study sample unrepresentative of the target population (e.g., Berkson bias in hospitalized patients).

Recall Bias: Patients with adverse outcomes recall past exposures more intensely than controls (major threat in case-control studies).

Hawthorne Effect: Participants alter behavior because they know they are being observed.

2. Screening Program Fallacies

Lead-Time Bias: Screening detects a disease earlier in its course without altering the natural history or time of death, creating an illusion of prolonged survival .

Length-Time Bias: Screening preferentially detects slow-growing, indolent lesions with a favorable prognosis, while missing rapidly progressive cases, creating an illusion of improved treatment efficacy .

3. Confounding vs Effect Modification

Confounding: A third variable linked to both exposure and outcome that distorts the true association. Can be controlled by stratification , matching , or multivariable regression .

Effect Modification: A third variable that naturally alters the magnitude of effect across strata (e.g., a drug works in men but not women). It is a biological reality, not a bias, and should be reported rather than controlled.

  • Common Exam Traps & Clinical Scenarios
  • ⚠️ EXAM TRAP: Misinterpreting RRR vs ARR

Pharmaceutical trials often highlight a "50% reduction in mortality" (Relative Risk Reduction). However, if baseline control risk is 2% and treatment risk is 1%, the Absolute Risk Reduction (ARR) is only 1% ( 0.02 − 0.01 = 0.01 0.02 - 0.01 = 0.01 0.02 − 0.01 = 0.01 ). The NNT is 1 / 0.01 = 100 1 / 0.01 = 100 1/0.01 = 100 . Always calculate ARR and NNT on the exam to determine true clinical impact!

🚨 CLINICAL SCENARIO CALLOUT

Vignette: In a randomized controlled trial of 1,000 patients with heart failure, 50 out of 500 patients receiving standard care died over 3 years (10%), compared to 25 out of 500 patients receiving a novel SGLT2 inhibitor (5%).

Step-by-Step Calculations:

Control Risk ( R c R_c R c ​ ): 50 / 500 = 0.10 50 / 500 = 0.10 50/500 = 0.10 (10%).

Experimental Risk ( R e R_e R e ​ ): 25 / 500 = 0.05 25 / 500 = 0.05 25/500 = 0.05 (5%).

Absolute Risk Reduction (ARR): 0.10 − 0.05 = 0.05 0.10 - 0.05 = 0.05 0.10 − 0.05 = 0.05 (5%).

Number Needed to Treat (NNT): 1 / 0.05 = 20 1 / 0.05 = 20 1/0.05 = 20 .

Interpretation: You need to treat 20 heart failure patients with the SGLT2 inhibitor for 3 years to prevent 1 additional death.

Loading diagram... Diagnostic Testing & 2x2 Contingency Matrix