Study guide

24.3 Hypothesis Testing

PA-CAT Physician Assistant College Admission Test

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: Introduction & Exam Overview

1.1 PA-CAT Exam Facts & Overview 1.2 Exam Structure & the Nine-Subject Blueprint 1.3 Registration, Scheduling & Test Day 1.4 Scoring, Transcripts & Study Strategy

2 Chapter 2: Anatomy — Back & Abdomen

2.1 Curvatures of the Vertebral Column 2.2 The Vertebrae 2.3 Spinal Cord and Spinal Nerves 2.4 The Anterior Abdominal Wall 2.5 The Spleen, Esophagus & Stomach 2.6 Intestines, Pancreas, Liver, Biliary Ducts, Hepatic Circulation & Kidney/Ureters

3 Chapter 3: Anatomy — Head, Pelvis & Perineum

3.1 The Skull 3.2 The Face & The Ear 3.3 The Cranial Nerves 3.4 The Bony Pelvis 3.5 The Pelvic Viscera 3.6 Male & Female Perineum and Reproductive Organs

4 Chapter 4: Anatomy — Thorax & Limbs

4.1 Mediastinum & Thoracic Skeletal/Muscular Components 4.2 Lungs, Trachea, Bronchi & Pericardium 4.3 The Heart & Great Vessels 4.4 Pectoral Girdle, Axilla & Brachial Plexus 4.5 Arm, Forearm, Wrist & Hand 4.6 Hip, Thigh, Gluteal Region, Leg, Joints & Foot

5 Chapter 5: Physiology — Cell, Blood & Circulation

5.1 Functions of the Cellular Organelles 5.2 Translation & Transcription 5.3 Hemostasis & Blood Coagulation 5.4 Basics of Flow, Pressure & Resistance 5.5 Microcirculation & Mechanisms of Blood Flow Control 5.6 Cardiac Output, Venous Return & the Lymphatic System 5.7 Coronary Blood Flow

6 Chapter 6: Physiology — Endocrine, GI & Membrane

6.1 Hypothalamus & Pituitary Hormones 6.2 Thyroid & Parathyroid Hormones 6.3 Endocrine & Adrenocortical Hormones 6.4 GI Motility, Secretion, Digestion & Absorption 6.5 Diffusion, Osmosis & Membrane Transport 6.6 Membrane Potential & the Action Potential 6.7 Muscular Contraction & Carbohydrate/Protein/Lipid Metabolism

7 Chapter 7: Physiology — Nervous & Renal

7.1 Nerve Physiology, Conduction & Transmission 7.2 Somatic Sensations, Motor/Cerebral Circuits & the Autonomic Nervous System 7.3 Fluid Balance, Glomerular Filtration & Tubular Reabsorption/Secretion 7.4 Renal Ion & Acid-Base Regulation

8 Chapter 8: Physiology — Respiratory, Reproduction, Heart & Senses

8.1 Pulmonary Ventilation, Gas Exchange & Pulmonary Circulation/Edema 8.2 O2/CO2 Transport & Regulation of Respiration 8.3 Reproduction: Mitosis/Meiosis, Gametogenesis, Pregnancy & Fetal Physiology 8.4 Heart Structure, Cardiac Cycle, Electrical Activity, Heart Defects & Special Senses

9 Chapter 9: Chemistry — Acids, Atoms, Bonding & Gases

9.1 Brønsted-Lowry Acids/Bases, Measuring Acidity & Strengths 9.2 Atomic Theory, Ions & Molecules 9.3 Chemical Bonding & VSEPR Molecular Geometry 9.4 Balancing, Solubility Rules & Types of Reactions 9.5 Oxidation, Reduction & Electrochemistry 9.6 Gas Laws, Dalton's Partial Pressures & Ideal vs Real Gases

10 Chapter 10: Chemistry — Liquids, Stoichiometry, Thermochemistry & Organic I

10.1 Colligative Properties & Factors Affecting Solubility 10.2 Stoichiometry: Conservation of Matter/Energy & Reactant/Product Calculations 10.3 Thermochemistry & Energy in Chemical Changes 10.4 Alkanes & Cycloalkanes 10.5 Bond Properties & Resonance 10.6 Hybridization/LCAO & Stereochemistry

11 Chapter 11: Chemistry — Spectroscopy & Application

11.1 Spectroscopy 11.2 Acid-Base Titrations & Buffer Systems 11.3 Limiting-Reactant & Percent-Yield Calculations 11.4 Electrochemical Cells & Redox Applications 11.5 Organic Reactions & Functional-Group Reactivity 11.6 Spectroscopic Structure Determination

12 Chapter 12: General Biology — Bioenergetics, Cells & Respiration

12.1 Enzymes, Metabolism, Energy & ATP 12.2 Hydrogen/Electron Carriers & Thermodynamics/Free Energy 12.3 Genome Mapping, Characterizing & Sequencing (Biotechnology) 12.4 Cell Structures, Membranous Organelles & Cell Theory 12.5 Eukaryotic Cell Reproduction & Stages of Meiosis 12.6 Cellular Respiration & Fermentation

13 Chapter 13: General Biology — Transport, Building Blocks & Molecules

13.1 Diffusion/Osmosis, Facilitated & Active Transport, Pinocytosis/Phagocytosis 13.2 Chemical Building Blocks: Proteins, Carbohydrates, Carbon, Nucleic Acids & Lipids 13.3 Water, Organization of Matter & Acids/Bases/Salts 13.4 Biological Molecules: DNA Structure, Replication & Repair 13.5 Gene Expression: Regulation, RNA & Protein Degradation

14 Chapter 14: General Biology — RNA, Structure & Signaling

14.1 Types of RNA, tRNA & Ribosomes 14.2 Pre-mRNA Splicing & Eukaryotic Transcription 14.3 Signal Transduction & Intracellular Communication 14.4 Receptor Types & Intracellular Receptors 14.5 G Protein-Coupled Receptor & Receptor Kinase Signaling

15 Chapter 15: Microbiology — Bacteria

15.1 Intracellular Bacteria 15.2 Gram-Positive Cocci & Rods 15.3 Acid-Fast Bacteria 15.4 Gram-Negative Cocci/Coccobacilli & Fermentative/Nonfermenting Rods 15.5 Anaerobic & Spiral-Shaped Bacteria 15.6 Bacterial Role in Disease 15.7 Viruses: HIV & Human Herpesvirus

16 Chapter 16: Microbiology — Viruses, Fungi, Parasites & Host Interaction

16.1 Respiratory, Hepatitis & Gastrointestinal Viruses + Viral Role in Disease 16.2 Fungal Classification, Opportunistic & Cutaneous/Subcutaneous Fungi 16.3 Systemic Dimorphic Fungi 16.4 Parasites: Protozoa & Helminths (Trematodes, Nematodes, Cestodes) 16.5 Parasite Classification & Arthropods 16.6 Principles of Disease, Epidemiology & Microbial Pathogenicity 16.7 Innate/Adaptive Immunity, Pathology/Infection/Disease, Microorganisms & Human Disease, Environmental Microbiology

17 Chapter 17: Genetics — Molecular Structure & Patterns of Inheritance

17.1 Molecular Structure of DNA & RNA 17.2 Chromosome Organization & DNA Replication 17.3 Chromosome Transmission During Cell Division & Sexual Reproduction 17.4 Mendelian & Non-Mendelian Inheritance 17.5 Genetic Linkage & Mapping in Eukaryotes 17.6 Genetic Transfer & Mapping in Bacteria and Bacteriophages

18 Chapter 18: Genetics — Genes, Mutation, Technologies & Medical Genetics

18.1 Molecular Properties of Genes & the Central Dogma 18.2 Mutation: Types & Consequences 18.3 Recombinant DNA & Genetic Technologies 18.4 Gene Regulation in Prokaryotes & Eukaryotes 18.5 Medical Genetics: Mendelian/Chromosomal/Multifactorial Disorders & Screening 18.6 Cancer Genetics 18.7 Population, Developmental & Quantitative Genetics

19 Chapter 19: Behavioral Sciences — Biological Bases of Behavior & Psychology

19.1 Behavioral Neuroscience: Neuroanatomy & Function 19.2 Sensation & Movement 19.3 States of Consciousness 19.4 Learning & Memory 19.5 Cognition, Language & Intelligence 19.6 Psychology: Schools, Development & Personality

20 Chapter 20: Behavioral Sciences — Stress, Research Methods, Sociocultural & Psychological Disorders

20.1 Health, Stress & Coping 20.2 Psychological Research Methods 20.3 Sociocultural Identity & Development 20.4 Psychological Disorders 20.5 Treatment of Psychological Disorders 20.6 Applied & Lifespan Behavioral Science

21 Chapter 21: Biochemistry — Metabolism, Enzymes & Proteins

21.1 Enzymes: Kinetics & Regulation 21.2 Carbohydrate Metabolism 21.3 TCA Cycle, Electron Transport & Oxidative Phosphorylation 21.4 Lipid Metabolism 21.5 Amino Acid & Nitrogen Metabolism + Protein Structure

22 Chapter 22: Biochemistry — Nucleic Acids, Hormones & Lipids

22.1 Nucleic Acids & Nucleotide Biochemistry 22.2 Hormone Biochemistry & Second-Messenger Systems 22.3 Vitamins & Minerals 22.4 Lipid Structure, Membranes & Transport 22.5 Tissue-Specific Biochemistry & Metabolic Integration

23 Chapter 23: Statistics — Anticipating Patterns & Exploring Data

23.1 Exploring & Describing Data 23.2 Probability 23.3 Random Variables & Probability Distributions 23.4 Sampling Distributions & Simulations

24 Chapter 24: Statistics — Sampling, Experimentation & Statistical Inference

24.1 Sampling, Experimentation & Data Collection 24.2 Confidence Intervals 24.3 Hypothesis Testing 24.4 Inference for Comparisons, Chi-Square & Regression

24.3 Hypothesis Testing

Key Takeaways Explain This Topic AI

The null hypothesis is the default claim of no effect; the alternative carries the burden of proof and may be one-tailed or two-tailed.

The p-value is the probability of data at least as extreme as observed assuming H0 is true; it is not the probability that H0 is true.

A Type I error (false positive) has probability α, which the investigator sets; a Type II error (false negative) has probability β, which depends on sample size and effect size.

Power equals 1 − β and rises with larger samples, larger true effects, lower variability, and higher α.

Paired designs are analyzed with a one-sample t-test on within-subject differences; independent groups use a two-sample t-test.

Last updated: August 2026

The Logic of Hypothesis Testing

Hypothesis testing is the formal framework for deciding whether observed sample evidence is compatible with a default claim about a population. The PA-CAT expects you to set up hypotheses, identify the correct test statistic, interpret a p-value, and distinguish Type I from Type II errors (PA-CAT Bulletin of Information, rev. 20240815, Table 11).

Null and Alternative Hypotheses

The null hypothesis (H₀) is the default claim, typically "no effect" or "no difference": μ = μ₀, p = p₀, μ₁ = μ₂. The alternative hypothesis (H₁ or Hₐ) is what the investigator hopes to find evidence for. H₁ may be:

One-tailed (directional) : μ > μ₀ or μ < μ₀. Used only when a directional claim is pre-specified and justified.

Two-tailed (non-directional) : μ ≠ μ₀. The default in most clinical research because an effect in either direction is scientifically meaningful.

The burden of proof falls on H₁. We either reject H₀ (evidence favors H₁) or fail to reject H₀ (insufficient evidence). We never "accept H₀"—absence of evidence is not evidence of absence.

Test Statistics

A test statistic measures how far the sample estimate falls from the value claimed by H₀, in standard-error units:

  • z-statistic (mean, σ known): z = (x̄ − μ₀)/(σ/√n)
  • t-statistic (mean, σ unknown): t = (x̄ − μ₀)/(s/√n), df = n − 1
  • z-statistic (proportion): z = (p̂ − p₀)/√(p₀(1−p₀)/n)

Larger absolute values of the statistic indicate stronger evidence against H₀.

p-value and Significance Level

The p-value is the probability of obtaining a test statistic at least as extreme as the observed value, assuming H₀ is true. A small p-value means the observed data would be unusual under H₀. The significance level α is a pre-chosen cutoff (commonly 0.05) defining how unusual is "too unusual." If p ≤ α, reject H₀; if p > α, fail to reject. The p-value is not the probability that H₀ is true, nor the probability that the result is due to chance alone, nor the probability of a Type I error.

Type I and Type II Errors, Power

Because we decide on incomplete data, two errors are possible:

  • Decision H₀ true H₀ false
  • Reject H₀ Type I error (false positive), probability α Correct (power = 1 − β)
  • Fail to reject H₀ Correct Type II error (false negative), probability β

α = P(Type I error) — the probability of declaring an effect when none exists. We set α; it is not computed from data.

β = P(Type II error) — the probability of missing a real effect. β depends on sample size, effect size, variability, and α.

Power = 1 − β — the probability of detecting a real effect of a given size. Conventionally, studies are designed for 80% or 90% power.

Power increases with larger sample size, larger true effect size, lower variability, and higher α. A nonsignificant result from an underpowered study does not confirm H₀; it reflects inadequate evidence.

Steps of Hypothesis Testing

State H₀ and H₁, choose α (typically 0.05) and one- or two-tailed.

Check assumptions (SRS, normality or large n, independence).

Compute the test statistic.

Find the p-value (or compare the statistic to the critical value).

Decide: reject H₀ if p ≤ α; otherwise fail to reject.

Interpret in context: "At the 0.05 level, there is sufficient evidence that the mean HbA1c reduction differs from 0."

Tests for a Mean and a Proportion

One-sample t-test : tests H₀: μ = μ₀ against a sample mean; df = n − 1.

One-proportion z-test : tests H₀: p = p₀; requires np₀ ≥ 10 and n(1−p₀) ≥ 10.

Example: A new lipid-lowering agent is tested in 36 patients. Mean LDL change is −18 mg/dL, s = 24. H₀: μ = 0; H₁: μ ≠ 0. t = −18/(24/√36) = −4.5, df = 35. The two-tailed p-value is < 0.001; reject H₀. There is strong evidence the drug lowers LDL.

Paired vs Independent Samples

Paired (dependent) samples arise when two measurements are taken on the same subject (before/after, two ears) or on matched pairs. The analysis uses the differences dᵢ = xᵢ − yᵢ and a one-sample t-test on the mean difference: t = d̄/(s_d/√n), df = n − 1. Example: diastolic blood pressure before and after a DASH diet in the same 20 patients.

Independent samples come from two separate groups. The two-sample t-test statistic is t = (x̄₁ − x̄₂)/√(s₁²/n₁ + s₂²/n₂). The conservative Welch (Satterthwaite) approximation for df is preferred on the PA-CAT when the two group variances may differ; the pooled version assumes equal variances.

Statistical Significance vs Practical Significance

A very large sample can produce a tiny p-value for a trivial effect. Always pair the hypothesis test with a confidence interval to judge practical importance: a mean reduction of 0.5 mm Hg may be statistically significant yet clinically irrelevant. The PA-CAT may frame items around exactly this distinction.

Loading diagram...