Study guide

14.1 Study Designs, Bias & Validity

USMLE Step 2 CK Study Guide Exam

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: Human Development & Well-Patient Care

1.1 Infant, Child & Adolescent Development & Growth 1.2 Adult Development, Aging & Geriatric Assessment 1.3 Preventive Health, Immunization & Well-Patient Screening

2 Chapter 2: Immune System & Immunologic Disorders

2.1 Primary & Secondary Immunodeficiencies 2.2 Hypersensitivity Reactions, Allergy & Anaphylaxis 2.3 Autoimmune & Rheumatologic Disease Principles

3 Chapter 3: Blood & Lymphoreticular System

3.1 Anemias: Microcytic, Normocytic & Macrocytic Etiologies 3.2 Bleeding Disorders, Coagulopathies & Platelet Pathology 3.3 Hematologic Malignancies & Lymphoproliferative Disorders

4 Chapter 4: Behavioral Health & Psychiatric Disorders

4.1 Mood Disorders: Major Depression & Bipolar Spectrum 4.2 Anxiety, Trauma-Related & Somatic Symptom Disorders 4.3 Psychotic Disorders & Schizophrenia Spectrum 4.4 Substance Use Disorders & Psychopharmacology

5 Chapter 5: Nervous System & Special Senses

5.1 Cerebrovascular Disease, Stroke & Transients 5.2 Seizures, Epilepsy & Altered Mental Status 5.3 Movement Disorders, Dementia & Peripheral Neuropathies 5.4 Special Senses: Ophthalmologic & Otolaryngologic Emergencies

6 Chapter 6: Musculoskeletal System & Dermatology

6.1 Fractures, Dislocations & Orthopedic Trauma 6.2 Inflammatory Arthropathies & Crystal-Induced Diseases 6.3 Inflammatory & Infectious Dermatoses 6.4 Cutaneous Malignancies & Blistering Disorders

7 Chapter 7: Cardiovascular System

7.1 Coronary Artery Disease & Acute Coronary Syndromes 7.2 Heart Failure, Cardiomyopathies & Valvular Disease 7.3 Cardiac Arrhythmias, Conduction Blocks & EKG Interpretation 7.4 Vascular Emergencies: Aortic Aneurysms & Peripheral Arterial Disease

8 Chapter 8: Respiratory System

8.1 Obstructive Airway Diseases: Asthma & COPD 8.2 Infectious Pneumonias & Pleural Effusions 8.3 Pulmonary Vascular Disease & Thromboembolism 8.4 Acute Respiratory Distress Syndrome & Interstitial Lung Diseases

9 Chapter 9: Gastrointestinal System

9.1 Esophageal, Gastric & Peptic Ulcer Disorders 9.2 Inflammatory Bowel Disease & Colorectal Neoplasms 9.3 Hepatic Disorders, Cirrhosis & Portal Hypertension 9.4 Biliary Tract Diseases & Pancreatitis

10 Chapter 10: Renal, Urinary & Reproductive Systems

10.1 Acute Kidney Injury & Chronic Kidney Disease 10.2 Glomerular & Tubulointerstitial Diseases 10.3 Nephrolithiasis, Urinary Tract Infections & Prostate Pathology 10.4 Fluid, Electrolyte & Acid-Base Disorders 10.5 Female Reproductive Disorders & Gynecology 10.6 Breast Pathology & Clinical Breast Disease

11 Chapter 11: Pregnancy, Childbirth & Puerperium

11.1 Normal Prenatal Care & Maternal-Fetal Physiology 11.2 Medical & Obstetric Complications of Pregnancy 11.3 Labor, Delivery & Postpartum Management

12 Chapter 12: Endocrine System

12.1 Diabetes Mellitus, Hypoglycemia & Metabolic Emergencies 12.2 Thyroid & Parathyroid Disorders 12.3 Adrenal & Pituitary Axis Pathology

13 Chapter 13: Multisystem Processes & Critical Care

13.1 Shock States, Sepsis & Systemic Inflammatory Response 13.2 Environmental Emergencies, Toxicology & Overdose 13.3 Infectious Disease Principles & Systemic Pathogens

14 Chapter 14: Biostatistics, Epidemiology & Literature Interpretation

14.1 Study Designs, Bias & Validity 14.2 Diagnostic Testing: Sensitivity, Specificity, PPV & NPV 14.3 Statistical Significance, Risk Measures & Evidence-Based Medicine

15 Chapter 15: Social Sciences, Ethics & Systems-Based Practice

15.1 Medical Ethics, Informed Consent & Patient Autonomy 15.2 Legal Issues, Confidentiality & Surrogate Decision Making 15.3 Patient Safety, Quality Improvement & Medical Error Analysis 15.4 Health Care Delivery Systems, Interprofessional Care & Transitions

14.1 Study Designs, Bias & Validity

Key Takeaways Explain This Topic AI

Observational study hierarchy: Randomized Controlled Trials (RCTs) provide highest level of evidence, while Case Control studies measure Odds Ratio (OR) and Cohort studies measure Relative Risk (RR).

Selection bias (e.g., Berkson bias in hospitalized patients, Neyman bias in chronic conditions) threatens internal validity; corrected by random sampling and retention rates >80%.

Recall bias occurs when subjects with a disease report past exposures differently than controls; minimized by using prospective cohort designs or blinded objective records.

Lead-time bias occurs when early detection by screening artificially prolongs survival time without altering disease trajectory or overall mortality.

Cross-sectional studies measure prevalence at a single point in time, whereas cohort studies measure incidence over a defined follow-up period.

Last updated: July 2026

  • 14.1 Study Designs, Bias & Validity
  • Observational vs. Experimental Study Designs

Epidemiologic study designs are classified into observational and experimental categories based on whether the investigator assigns the intervention. In observational studies, researchers observe natural exposures and health outcomes without actively allocating treatments. In experimental studies, most notably randomized controlled trials (RCTs) , the investigator assigns exposures or interventions using controlled randomization.

Cross-Sectional Studies

A cross-sectional study evaluates exposure and disease status simultaneously in a specified population at a single point in time. It measures disease prevalence ("snapshot in time") rather than incidence. Because exposure and outcome are measured concurrently, cross-sectional designs cannot establish temporal precedence or causality. They are efficient for generating hypotheses, estimating public health burdens, and identifying associations (expressed via prevalence odds ratios).

Case-Control Studies

A case-control study is an observational, retrospective design that selects participants based on outcome status : individuals with the disease ( cases ) are compared to individuals without the disease ( controls ). Investigators then look backward in time to quantify past exposure frequencies.

Measure of Association : The primary metric is the Odds Ratio (OR) , defined as O R = a ⋅ d b ⋅ c OR = \frac{a \cdot d}{b \cdot c} OR = b ⋅ c a ⋅ d ​ , where a a a is exposed cases, b b b is exposed controls, c c c is unexposed cases, and d d d is unexposed controls.

Key Applications : Ideal for studying rare diseases (e.g., mesothelioma, angiosarcoma) or diseases with long latency periods.

Major Limitations : Highly susceptible to selection bias and recall bias . Relative risk cannot be calculated directly because population incidence is unknown.

Cohort Studies

A cohort study selects participants based on exposure status : an exposed group and an unexposed group, both initially free of the outcome of interest, are followed over time to compare the incidence of disease. Cohort studies may be prospective (tracking subjects forward from the present) or retrospective (using historical medical records to define past exposure and follow subjects to documented outcomes).

Measure of Association : The primary metric is Relative Risk (RR) or Risk Ratio , calculated as R R = a / ( a + b ) c / ( c + d ) RR = \frac{a / (a + b)}{c / (c + d)} RR = c / ( c + d ) a / ( a + b ) ​ , comparing disease incidence in the exposed ( a / [ a + b ] a/[a+b] a / [ a + b ] ) to incidence in the unexposed ( c / [ c + d ] c/[c+d] c / [ c + d ] ).

Key Applications : Optimal for studying rare exposures (e.g., occupational chemical exposures, radiation) and establishing temporal sequences.

Major Limitations : Expense, long duration, and vulnerability to loss to follow-up (attrition bias) .

Randomized Controlled Trials (RCTs)

An RCT is the gold standard experimental design for evaluating therapeutic efficacy. Participants are randomly allocated to an intervention group (e.g., novel drug) or control group (e.g., placebo or standard of care). Randomization minimizes baseline confounding by balancing both known and unknown prognostic factors across groups. Blinding (single, double, or triple) prevents investigator and participant bias. RCT results should be analyzed using an intention-to-treat (ITT) protocol, preserving randomization benefits by analyzing participants in their assigned groups regardless of compliance or dropouts.

Study Design Participant Selection Basis Primary Outcome Metric Major Advantage Key Vulnerability

Cross-Sectional Population sample at single point Prevalence / Prevalence OR Fast, inexpensive, hypothesis-generating Cannot determine temporality

Case-Control Outcome status (Cases vs Controls) Odds Ratio (OR) Excellent for rare diseases & long latency Recall bias, selection bias

Cohort Exposure status (Exposed vs Unexposed) Relative Risk (RR) & Incidence Establishes temporality; ideal for rare exposures Attrition bias, high cost/time

RCT Inclusion criteria, then randomized Relative Risk, ARR, NNT Establishes causality; minimizes confounding Expensive, ethical constraints, low external validity

  • Validity: Internal vs. External
  • Internal Validity

Internal validity reflects the degree to which a study's observed conclusions represent the true causal relationship within the specific sample studied, free from methodological flaws, bias, or unmeasured confounding. High internal validity requires rigorous study design, appropriate statistical controls, valid measurement instruments, and effective blinding.

External Validity (Generalizability)

External validity denotes the extent to which trial findings can be generalized to broader target populations in real-world clinical practice. A study conducted exclusively in young, healthy male military recruits may exhibit outstanding internal validity but poor external validity when applied to elderly female patients with multiple comorbidities.

  • Major Types of Bias & Mitigating Strategies
  • Selection Bias

Selection bias occurs when the sample chosen does not accurately represent the target population due to non-random selection or differential retention.

Berkson Bias : Occurs when hospitalized patients are chosen as controls in case-control studies. Hospitalized controls typically have higher rates of comorbid conditions than the general community, artificially distorting exposure-disease associations.

Neyman (Prevalence-Incidence) Bias : Occurs when exposure selection excludes patients who die rapidly or recover quickly before study enrollment, over-representing chronic, indolent cases.

Attrition Bias : Differential loss to follow-up between exposed and unexposed groups in cohort studies.

Mitigation : Utilize random sampling, consecutive recruitment, standardized enrollment criteria, and maintain follow-up rates > 80 % > 80\% > 80% .

Information and Measurement Bias

Information bias arises from systemic errors in gathering, recording, or interpreting data.

Recall Bias : Subjects with a negative outcome (cases) report past exposures more thoroughly or accurately than healthy controls due to search for explanations.

Observer / Hawthorne Effect : Behavior of study participants changes simply because they know they are being monitored.

Mitigation : Implement objective data collection methods, structured questionnaires, and double-blinding.

Confounding Bias

Confounding occurs when an unmeasured or uncontrolled third variable is independently associated with both the exposure and the outcome, without being an intermediate step in the causal pathway. For instance, an apparent association between coffee consumption and pancreatic cancer is confounded by smoking, because smoking is correlated with coffee drinking and directly causes pancreatic cancer. Confounder (e.g., Smoking)

  • / \
  • v v
  • Exposure (Coffee) ------> Outcome (Pancreatic Cancer)

?

Mitigation Strategies :

Design Phase : Randomization (balances unknown confounders), Restriction (limiting inclusion to specific sub-groups), and Matching (matching cases and controls by age, sex, or smoking status).

Analysis Phase : Stratification (analyzing exposure-outcome relationships across strata of the confounder) and Multivariable Regression Analysis (logistic or Cox regression adjusting for potential confounders).

Time-Related Biases in Screening

Lead-Time Bias : Early detection of a disease by screening creates the false appearance of prolonged survival, simply because the diagnosis was established earlier in the disease course, without altering the actual date of death or overall mortality.

Length-Time Bias : Screening selectively detects slowly progressive, indolent disease cases with long preclinical phases (better prognosis) while missing rapidly progressive, highly aggressive cases that become symptomatic between screening intervals.

Algorithmic Evaluation of Study Design & Bias

When analyzing clinical research vignettes on Step 2 CK, utilize the following decision algorithm:

Did the investigator assign the exposure or intervention?

Yes → \rightarrow → Experimental Design (RCT) . Check for blinding, allocation concealment, and intention-to-treat analysis.

No → \rightarrow → Observational Design . Proceed to Question 2.

How were participants initially categorized or sampled?

By Disease/Outcome Status (Cases vs Controls) → \rightarrow → Case-Control Study . Look for Odds Ratio and watch for recall bias .

By Exposure Status (Exposed vs Unexposed) → \rightarrow → Cohort Study . Look for Relative Risk and watch for loss to follow-up .

At a Single Point in Time (No follow-up) → \rightarrow → Cross-Sectional Study . Measures prevalence .

Does early screening increase survival time without reducing total mortality?

Yes → \rightarrow → Lead-Time Bias .

Is an extraneous variable linked to exposure AND outcome?

Yes → \rightarrow → Confounding . Correct via matching, stratification, or multivariable regression.