Study guide

15.2 Inferential Statistics: Hypothesis Testing, Alpha Levels, Power, and Effect Sizes

GRE Subject Test: Psychology Study Guide Exam

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: Neuroanatomy, Neural Transmission, and Neuroscience Methods

1.1 Cellular Neuroscience: Neurons, Action Potentials, and Synaptic Transmission 1.2 Functional Neuroanatomy: Brain Structures, Hemispheric Specialization, and Cortical Lobes 1.3 Neurotransmitters, Neuromodulators, and Psychopharmacology 1.4 The Endocrine System, Autonomic Nervous System, and Behavioral Genetics 1.5 Cognitive Neuroscience Methods, Lateralization Testing, and Neuroplasticity

2 Chapter 2: Sensation and Perception

2.1 Psychophysics, Sensory Thresholds, and Signal Detection Theory 2.2 Visual Processing: Photoreceptors, Pathways, Color Vision, and Feature Detection 2.3 Auditory Systems, Pitch Perception, Gustation, and Olfaction 2.4 Somatosensation, Vestibular Senses, Perceptual Organization, and Theories of Perception

3 Chapter 3: Biological Drives, Consciousness, and Ethology

3.1 Sleep Architecture, Circadian Rhythms, and States of Consciousness 3.2 Biological Mechanisms of Hunger, Thirst, Sexual Behavior, and Emotion 3.3 Ethology and Comparative Psychology: Instincts, Imprinting, and Evolutionary Adaptation

4 Chapter 4: Principles of Conditioning and Learning

4.1 Classical Conditioning: Paradigms, Extinction, Spontaneous Recovery, and Biological Constraints 4.2 Operant Conditioning: Reinforcement Schedules, Punishment, and Behavior Modification 4.3 Observational Learning, Social Cognitive Theory, and Latent Learning

5 Chapter 5: Memory Architecture and Processes

5.1 Memory Architecture: Sensory Buffers, Working Memory, and Multi-Store Models 5.2 Long-Term Memory Systems: Episodic, Semantic, Procedural, and Implicit Memory 5.3 Retrieval Processes, Forgetting Curves, Interference Theory, and Memory Reconstruction

6 Chapter 6: Language, Thought, Decision Making, and Intelligence

6.1 Language Structure, Psycholinguistics, and Language Acquisition Theories 6.2 Concept Formation, Mental Representation, and Problem-Solving Strategies 6.3 Judgment, Heuristics, Cognitive Biases, and Decision-Making Models 6.4 Selective Attention, Divided Attention, and Executive Cognitive Control 6.5 Reading Processes, Bilingualism, and Verbal and Nonverbal Communication 6.6 Intelligence: Theories, Measurement, Heritability, and Metacognition

7 Chapter 7: Social Perception, Attribution, Attitudes, and the Self

7.1 Attribution Theories, Heider, Kelley, and Systematic Attribution Errors 7.2 Attitude Formation, Consistency Theories, and Cognitive Dissonance 7.3 Persuasion Models: Elaboration Likelihood Model and Persuasion Techniques 7.4 The Self, Social Comparison, Self-Esteem, and the Need to Belong

8 Chapter 8: Social Influence, Groups, Relationships, Culture, and Gender

8.1 Conformity, Compliance, and Obedience: Classic Studies and Mechanisms 8.2 Group Dynamics: Social Facilitation, Loafing, Polarization, and Groupthink 8.3 Stereotyping, Prejudice, Discrimination, and Intergroup Conflict 8.4 Prosocial Behavior, Bystander Intervention, Aggression, Interpersonal Attraction, and Close Relationships 8.5 Emotion, Affect, and Motivation in Social Life; Cultural and Gender Influences

9 Chapter 9: Physical, Cognitive, and Moral Development

9.1 Prenatal Development, Teratogens, Neonatal Reflexes, and Motor Milestones 9.2 Piaget's Cognitive Developmental Stages, Neo-Piagetian Theories, and Post-Piagetian Critiques 9.3 Vygotsky's Sociocultural Theory, Scaffolding, and the Zone of Proximal Development 9.4 Moral Development: Kohlberg's Stage Model and Gilligan's Care Perspective

10 Chapter 10: Social, Emotional, Gender, and Lifespan Development

10.1 Attachment Theory, Bowlby, Ainsworth's Strange Situation, and Temperament 10.2 Erikson's Psychosocial Stages and Baumrind's Parenting Typologies 10.3 Adolescent Identity Exploration, Adult Transitions, and Cognitive Changes in Aging 10.4 Emotional Development, Gender Development, Peer Relations, and Ecological Systems

11 Chapter 11: Theories of Personality

11.1 Psychodynamic and Neo-Freudian Personality Theories 11.2 Humanistic, Existential, and Phenomenological Approaches to Personality 11.3 Trait Theories: The Big Five (Five-Factor Model), Allport, Cattell, and Eysenck

12 Chapter 12: Psychological Disorders and Psychopathology

12.1 Anxiety Disorders, OCD, and Trauma- and Stressor-Related Disorders 12.2 Depressive Disorders, Bipolar and Related Disorders, and Suicide Risk 12.3 Schizophrenia Spectrum, Psychotic Disorders, and Personality Disorders 12.4 Neurodevelopmental, Eating, Substance-Related, Dissociative, Somatic Symptom, and Neurocognitive Disorders 12.5 Causes and Development of Disorders, Epidemiology, and Cultural and Gender Issues in Psychopathology

13 Chapter 13: Clinical Assessment, Treatment, Health Psychology, and Prevention

13.1 Clinical Assessment: Objective Inventories, Projective Tests, and Clinical Interviews 13.2 Psychotherapeutic Modalities: CBT, Behavioral, Psychodynamic, and Humanistic Therapies 13.3 Biological and Somatic Treatments: Psychotropic Medications and Neuromodulation 13.4 Stress, Conflict, Coping, Health Psychology, and Prevention

14 Chapter 14: Research Design and Experimental Methodology

14.1 The Scientific Method, Variables, and Operational Definitions 14.2 Between-Subjects, Within-Subjects, Quasi-Experimental, and Correlational Designs 14.3 Threats to Internal and External Validity, Demand Characteristics, and Experimenter Bias

15 Chapter 15: Statistical Analysis in Psychological Science

15.1 Descriptive Statistics, Measures of Central Tendency, Variability, and Normal Distributions 15.2 Inferential Statistics: Hypothesis Testing, Alpha Levels, Power, and Effect Sizes 15.3 Bivariate and Multivariate Techniques: t-Tests, ANOVA Models, Correlation, and Regression

16 Chapter 16: Psychometrics, Ethics, History, and Applied Psychology

16.1 Psychometric Theory: Classical Test Theory, Reliability Types, and Validity Constructs 16.2 Research Ethics, APA Ethical Principles, Institutional Review Boards, and Animal Welfare 16.3 Historical Foundations of Psychology, Major Schools of Thought, and Professional Milestones 16.4 Industrial-Organizational and Educational Psychology

15.2 Inferential Statistics: Hypothesis Testing, Alpha Levels, Power, and Effect Sizes

Key Takeaways Explain This Topic AI

The Central Limit Theorem dictates that the sampling distribution of the mean approaches normality as N ≥ 30 regardless of the underlying population shape, with a mean equal to the population mean and a standard error of SE = σ / √N.

Null Hypothesis Significance Testing (NHST) evaluates the conditional probability of the observed data given that the null hypothesis is true (p = P(Data | H0)), which must never be confused with the probability that the hypothesis itself is true.

Statistical decisions involve a fundamental 2 × 2 matrix: Type I error (α) is a false positive (rejecting true H0), Type II error (β) is a false negative (failing to reject false H0), and statistical power is defined as 1 - β.

Statistical power (1 - β) is maximized by increasing sample size N, targeting larger true effect sizes, setting a more liberal α, using directional one-tailed tests when justified, and minimizing measurement error.

Because p-values depend directly on sample size and fail to quantify the magnitude of experimental divergence, researchers must report standardized effect sizes such as Cohen's d, r², and η², alongside confidence intervals.

Last updated: October 2026

Inferential Statistics: Hypothesis Testing, Alpha Levels, Power, and Effect Sizes

While descriptive statistics summarize observed samples, inferential statistics allow psychologists to draw probabilistic conclusions about broader populations based on sample data. Because researchers rarely have access to entire populations, they must quantify the likelihood that observed sample differences reflect genuine psychological phenomena rather than mere sampling error.

1. Probability, Sampling Distributions, and the Central Limit Theorem

To make valid inferences, researchers rely on theoretical sampling distributions —the probability distribution of a specific statistic (such as the sample mean X ˉ \bar{X} X ˉ ) computed from an infinite number of random samples of size N N N drawn from the same population.

The Central Limit Theorem (CLT)

The Central Limit Theorem is the foundational mathematical theorem of inferential statistics. It states that for any population with mean μ \mu μ and finite standard deviation σ \sigma σ , as sample size N N N increases, the sampling distribution of the sample mean approaches a normal distribution , regardless of the shape of the parent population (whether skewed, bimodal, or uniform). Parent Population (Heavily Skewed) Sampling Distribution of the Mean

  • /\ (Normal Bell Curve)
  • / \ /\
  • / \ / \
  • / \__________ / \
  • ────────────────────> ────────
  • Raw Scores (X) Sample Means (X̄)
  • Approaches Normality as N ≥ 30
  • Core Properties of the Sampling Distribution of the Mean

Mean of the Sampling Distribution (Expected Value): The average of all sample means in the sampling distribution is identically equal to the population mean μ \mu μ :

μ X ˉ = μ \mu_{\bar{X}} = \mu μ X ˉ ​ = μ

This property establishes that the sample mean X ˉ \bar{X} X ˉ is an unbiased estimator of μ \mu μ .

Standard Error of the Mean ( S E SE SE or σ X ˉ \sigma_{\bar{X}} σ X ˉ ​ ): The standard deviation of the sampling distribution of the mean is termed the standard error . It quantifies the expected margin of sampling error between a sample mean and the population mean:

σ X ˉ = σ N or estimated as s X ˉ = s N \sigma_{\bar{X}} = \frac{\sigma}{\sqrt{N}} \quad \text{or estimated as} \quad s_{\bar{X}} = \frac{s}{\sqrt{N}} σ X ˉ ​ = N ​ σ ​ or estimated as s X ˉ ​ = N ​ s ​

The Inverse Square Root Law

Because the denominator of the standard error formula contains N \sqrt{N} N ​ , reducing the standard error by half requires quadrupling the sample size ( 4 N 4N 4 N ):

If N = 25 N = 25 N = 25 and σ = 20 \sigma = 20 σ = 20 , S E = 20 25 = 20 5 = 4.0 SE = \frac{20}{\sqrt{25}} = \frac{20}{5} = 4.0 SE = 25 ​ 20 ​ = 5 20 ​ = 4.0 .

To reduce S E SE SE to 2.0 2.0 2.0 , sample size must increase to N = 100 N = 100 N = 100 ( S E = 20 100 = 20 10 = 2.0 SE = \frac{20}{\sqrt{100}} = \frac{20}{10} = 2.0 SE = 100 ​ 20 ​ = 10 20 ​ = 2.0 ).

To reduce S E SE SE to 1.0 1.0 1.0 , sample size must increase to N = 400 N = 400 N = 400 ( S E = 20 400 = 20 20 = 1.0 SE = \frac{20}{\sqrt{400}} = \frac{20}{20} = 1.0 SE = 400 ​ 20 ​ = 20 20 ​ = 1.0 ).

This principle illustrates the law of diminishing returns in empirical sample size planning.

2. The Logic of Null Hypothesis Significance Testing (NHST)

Null Hypothesis Significance Testing (NHST) merges the probabilistic decision frameworks of Ronald Fisher, Jerzy Neyman, and Egon Pearson. In this framework, an empirical claim is tested by evaluating the plausibility of its direct opposite.

Hypotheses Formulation

Null Hypothesis ( H 0 H_0 H 0 ​ ): States that in the population, there is no true difference, no experimental effect, or no relationship between variables. Any observed difference in the sample is attributed entirely to random sampling error:

H 0 : μ treatment − μ control = 0 H_0: \mu_{\text{treatment}} - \mu_{\text{control}} = 0 H 0 ​ : μ treatment ​ − μ control ​ = 0

Alternative Hypothesis ( H 1 H_1 H 1 ​ or H A H_A H A ​ ): The experimental or research hypothesis predicting that a genuine difference, effect, or relationship exists in the population:

H 1 : μ treatment − μ control ≠ 0 (non-directional / two-tailed) H_1: \mu_{\text{treatment}} - \mu_{\text{control}} \neq 0 \quad \text{(non-directional / two-tailed)} H 1 ​ : μ treatment ​ − μ control ​  = 0 (non-directional / two-tailed)

H 1 : μ treatment > μ control (directional / one-tailed) H_1: \mu_{\text{treatment}} > \mu_{\text{control}} \quad \text{(directional / one-tailed)} H 1 ​ : μ treatment ​ > μ control ​ (directional / one-tailed)

The Alpha Level ( α \alpha α ) and Critical Regions

Before collecting data, the experimenter specifies the significance level ( α \alpha α ) , which represents the maximum probability of committing a Type I error that the researcher is willing to tolerate. By historical convention in psychology, α \alpha α is typically set at .05 .05 .05 , .01 .01 .01 , or .001 .001 .001 .

The α \alpha α level demarcates the critical region (rejection region) in the sampling distribution.

If the calculated test statistic falls within this critical region, the researcher rejects H 0 H_0 H 0 ​ and concludes the effect is statistically significant.

If the test statistic falls outside the critical region, the researcher fails to reject H 0 H_0 H 0 ​ (never "accepts H 0 H_0 H 0 ​ ", because absence of evidence is not evidence of absence).

Deconstructing the p-Value

The p p p -value is the exact probability of obtaining a test statistic at least as extreme as the one observed in the sample, assuming that the null hypothesis is true :

p = P ( Data as or more extreme than observed ∣ H 0 is True ) p = P(\text{Data as or more extreme than observed} \mid H_0 \text{ is True}) p = P ( Data as or more extreme than observed ∣ H 0 ​ is True )

Warning

The Inverse Fallacy: A widespread misconception among students is believing that the p p p -value represents the probability that the null hypothesis is true, or that 1 − p 1 - p 1 − p represents the probability that the research hypothesis is true. In conditional probability notation, P ( Data ∣ H 0 ) ≠ P ( H 0 ∣ Data ) P(\text{Data} \mid H_0) \neq P(H_0 \mid \text{Data}) P ( Data ∣ H 0 ​ )  = P ( H 0 ​ ∣ Data ) . Calculating P ( H 0 ∣ Data ) P(H_0 \mid \text{Data}) P ( H 0 ​ ∣ Data ) requires Bayesian inference incorporating prior probabilities.

3. Decision Matrix, Error Typology, and Statistical Power

Every statistical decision in NHST is subject to uncertainty, yielding four possible outcomes structured across a 2 × 2 2 \times 2 2 × 2 truth matrix:

Researcher's Decision Reality: H 0 H_0 H 0 ​ is Actually True (No Effect) Reality: H 0 H_0 H 0 ​ is Actually False (Real Effect Exists)

Reject H 0 H_0 H 0 ​ (Claim effect exists) Type I Error (False Positive) ; Probability = α = \alpha = α ; (Incorrectly convicting an innocent person) Correct Decision (Power / True Positive) ; Probability = 1 − β = 1 - \beta = 1 − β ; (Correctly convicting a guilty person)

Fail to Reject H 0 H_0 H 0 ​ (Claim no effect detected) Correct Decision (True Negative) ; Probability = 1 − α = 1 - \alpha = 1 − α ; (Correctly acquitting an innocent person) Type II Error (False Negative) ; Probability = β = \beta = β ; (Incorrectly acquitting a guilty person)

The Fundamental Trade-Off Between Type I and Type II Errors

There is an inherent trade-off between α \alpha α and β \beta β :

If an experimenter becomes extremely conservative to prevent false positives and lowers α \alpha α from .05 .05 .05 to .01 .01 .01 or .001 .001 .001 , the critical threshold moves further out into the tail of the distribution.

This shift widens the non-rejection region, making it harder to reject H 0 H_0 H 0 ​ . Consequently, the risk of a false negative ( Type II error, β \beta β ) directly increases , which depresses statistical power ( 1 − β 1 - \beta 1 − β ). Sampling Distribution under H0 Sampling Distribution under H1

  • │ │
  • ▼ ▼
  • ┌─────┐ ┌─────┐
  • / │ \ / │ \
  • / │ \ / │ \
  • / │ \ Critical Boundary (α) / │ \
  • / │ \ │ / │ \
  • ───┴───────┼───────┴──────────────┼───────────────┴───────┼───────┴───
  • μ0 │ μ1
  • [ Correct Decision ] │ [ Statistical Power ]
  • Area = 1 - α │ Area = 1 - β
  • [ Type I Error α ]
  • │
  • [ Type II Error β (under H1 left of boundary) ]
  • Statistical Power ( 1 − β 1 - \beta 1 − β )

Statistical power ( 1 − β 1 - \beta 1 − β ) is the probability of correctly rejecting a false null hypothesis—that is, the probability of detecting a true experimental effect when one genuinely exists in the population. Jacob Cohen established that psychological studies should aim for a minimum statistical power of .80 .80 .80 (corresponding to an acceptable Type II error rate of β = .20 \beta = .20 β = .20 ).

The Determinants of Statistical Power

Statistical power is governed by six interacting factors:

Sample Size ( N N N ): Increasing N N N reduces the standard error ( S E = σ / N SE = \sigma / \sqrt{N} SE = σ / N ​ ), narrowing both sampling distributions and reducing their overlap. This is the primary mechanism researchers use to boost power during study design.

Magnitude of the Effect Size: Larger true differences between population means produce greater physical separation between the H 0 H_0 H 0 ​ and H 1 H_1 H 1 ​ sampling distributions, increasing the proportion of the H 1 H_1 H 1 ​ curve that clears the critical boundary.

Significance Level ( α \alpha α ): Setting a more liberal α \alpha α (e.g., .05 .05 .05 instead of .01 .01 .01 ) shifts the critical boundary toward the center of the H 0 H_0 H 0 ​ distribution, increasing the area under H 1 H_1 H 1 ​ to the right of the cutoff and elevating power.

Directionality of Test (One-Tailed vs. Two-Tailed): A directional (one-tailed) test places the entire α \alpha α level into a single tail, moving the critical threshold closer to the distribution center and increasing power for effects in that predicted direction.

Measurement Reliability and Error Variance: Reducing extraneous noise and utilizing highly reliable measurement tools shrinks sample variance ( s 2 s^2 s 2 ), narrowing the standard error and boosting power.

Experimental Design (Within-Subjects vs. Between-Subjects): Repeated-measures designs partial out individual baseline differences from the error term, substantially increasing power compared to between-subjects designs with identical sample sizes.

4. Directional (One-Tailed) vs. Non-Directional (Two-Tailed) Tests

When formulating statistical hypotheses, researchers choose between non-directional and directional tests based on their theoretical expectations.

Non-Directional (Two-Tailed) Tests

Hypotheses: H 0 : μ 1 = μ 2 H_0: \mu_1 = \mu_2 H 0 ​ : μ 1 ​ = μ 2 ​ versus H 1 : μ 1 ≠ μ 2 H_1: \mu_1 \neq \mu_2 H 1 ​ : μ 1 ​  = μ 2 ​ .

Critical Region Allocation: The nominal alpha level is split equally between the two extreme tails of the sampling distribution (e.g., for α = .05 \alpha = .05 α = .05 , α / 2 = .025 \alpha / 2 = .025 α /2 = .025 in each tail).

Critical Values: For a standard normal z z z -test with α = .05 \alpha = .05 α = .05 , the critical cutoffs are z crit = ± 1.96 z_{\text{crit}} = \pm 1.96 z crit ​ = ± 1.96 .

Methodological Advantage: A two-tailed test detects significant effects regardless of whether the treatment group performs significantly better or significantly worse than the control group. It is the accepted scientific default in psychological research.

Directional (One-Tailed) Tests

Hypotheses: H 0 : μ 1 ≤ μ 2 H_0: \mu_1 \le \mu_2 H 0 ​ : μ 1 ​ ≤ μ 2 ​ versus H 1 : μ 1 > μ 2 H_1: \mu_1 > \mu_2 H 1 ​ : μ 1 ​ > μ 2 ​ (or vice versa).

Critical Region Allocation: The entire α \alpha α level is concentrated into the single tail corresponding to the predicted direction (e.g., all α = .05 \alpha = .05 α = .05 in the upper tail).

Critical Values: For a standard normal z z z -test with α = .05 \alpha = .05 α = .05 , the critical cutoff is z crit = + 1.645 z_{\text{crit}} = +1.645 z crit ​ = + 1.645 .

Methodological Consideration: Because 1.645 < 1.96 1.645 < 1.96 1.645 < 1.96 , a one-tailed test has greater statistical power to detect an effect in the predicted direction. However, if the experimental manipulation produces a massive effect in the opposite direction, the researcher cannot reject the null hypothesis, regardless of how extreme the data are.

5. Effect Size Metrics and Confidence Intervals

A major limitation of Null Hypothesis Significance Testing is that statistical significance ( p < .05 p < .05 p < .05 ) is not equivalent to practical or theoretical importance . Because the standard error shrinks as sample size grows ( S E = s / N SE = s / \sqrt{N} SE = s / N ​ ), an extraordinarily large sample ( N = 50 , 000 N = 50,000 N = 50 , 000 ) can render an utterly trivial difference (e.g., a memory enhancement of 0.05 0.05 0.05 words) statistically significant at p < .001 p < .001 p < .001 .

To decouple the magnitude of a psychological phenomenon from sample size, researchers report standardized effect sizes and confidence intervals .

Cohen's d (Standardized Mean Difference)

Developed by Jacob Cohen, d d d expresses the difference between two sample means in units of pooled standard deviation:

d = X ˉ 1 − X ˉ 2 s pooled d = \frac{\bar{X}_1 - \bar{X}_2}{s_{\text{pooled}}} d = s pooled ​ X ˉ 1 ​ − X ˉ 2 ​ ​

Where s pooled = ( n 1 − 1 ) s 1 2 + ( n 2 − 1 ) s 2 2 n 1 + n 2 − 2 \text{Where } s_{\text{pooled}} = \sqrt{\frac{(n_1 - 1)s_1^2 + (n_2 - 1)s_2^2}{n_1 + n_2 - 2}} Where s pooled ​ = n 1 ​ + n 2 ​ − 2 ( n 1 ​ − 1 ) s 1 2 ​ + ( n 2 ​ − 1 ) s 2 2 ​ ​ ​

Unlike the t t t -statistic, Cohen's d d d is independent of sample size. Cohen established widely recognized interpretive benchmarks for psychological research:

Small Effect ( d = 0.20 d = 0.20 d = 0.20 ): The difference between means equals 0.2 0.2 0.2 standard deviations. The groups overlap by approximately 85 % 85\% 85% . Cohen's example: the difference in mean height between 15- and 16-year-old girls.

Medium Effect ( d = 0.50 d = 0.50 d = 0.50 ): The difference equals half a standard deviation. Overlap is approximately 67 % 67\% 67% . Noticeable to a trained observer without formal measurement.

Large Effect ( d = 0.80 d = 0.80 d = 0.80 ): The difference equals 0.8 0.8 0.8 standard deviations. Overlap drops to approximately 53 % 53\% 53% . Cohen's example: the difference in mean height between 13- and 18-year-old girls.

Variance-Accounted-For Effect Sizes

Other effect size indices quantify the proportion of total variance in the dependent variable that is explained by the independent variable:

Coefficient of Determination ( r 2 r^2 r 2 ): In correlational designs, r 2 r^2 r 2 represents the proportion of variance shared between two continuous variables.

Eta-Squared ( η 2 \eta^2 η 2 ): In Analysis of Variance (ANOVA), η 2 \eta^2 η 2 represents the proportion of total variation attributed to the experimental treatment:

η 2 = S S between S S total \eta^2 = \frac{SS_{\text{between}}}{SS_{\text{total}}} η 2 = S S total ​ S S between ​ ​

Partial Eta-Squared ( η p 2 \eta_p^2 η p 2 ​ ): In factorial ANOVA, η p 2 \eta_p^2 η p 2 ​ isolates the effect of interest by removing variance explained by other factors from the denominator:

η p 2 = S S effect S S effect + S S error \eta_p^2 = \frac{SS_{\text{effect}}}{SS_{\text{effect}} + SS_{\text{error}}} η p 2 ​ = S S effect ​ + S S error ​ S S effect ​ ​

Confidence Intervals (CIs)

A confidence interval provides an estimated range of values calculated from sample statistics that is likely to include the unknown population parameter at a specified confidence level (typically 95 % 95\% 95% or 99 % 99\% 99% ):

95 % CI = X ˉ ± ( t critical × s X ˉ ) 95\%\text{ CI} = \bar{X} \pm (t_{\text{critical}} \times s_{\bar{X}}) 95% CI = X ˉ ± ( t critical ​ × s X ˉ ​ )

Frequentist Interpretation: A 95 % 95\% 95% confidence interval does not mean there is a 95 % 95\% 95% probability that the true population mean lies within that specific interval. Rather, if an experiment were repeated infinitely using identical methods, 95 % 95\% 95% of the computed intervals would capture the true population parameter μ \mu μ .

Relation to Hypothesis Testing: Confidence intervals provide a direct test of the null hypothesis. If a 95 % 95\% 95% confidence interval for the difference between two means contains zero (e.g., 95 % CI [ − 1.20 , + 3.40 ] 95\%\text{ CI } [-1.20, +3.40] 95% CI [ − 1.20 , + 3.40 ] ), the difference is not statistically significant at α = .05 \alpha = .05 α = .05 . Conversely, if zero falls outside the interval (e.g., 95 % CI [ + 0.85 , + 4.10 ] 95\%\text{ CI } [+0.85, +4.10] 95% CI [ + 0.85 , + 4.10 ] ), the null hypothesis is rejected at p < .05 p < .05 p < .05 .