Study guide
15.3 Bivariate and Multivariate Techniques: t-Tests, ANOVA Models, Correlation, and Regression
GRE Subject Test: Psychology Study Guide Exam
Track your progress as you read
Finished sections get a check mark.
1 Chapter 1: Neuroanatomy, Neural Transmission, and Neuroscience Methods
1.1 Cellular Neuroscience: Neurons, Action Potentials, and Synaptic Transmission 1.2 Functional Neuroanatomy: Brain Structures, Hemispheric Specialization, and Cortical Lobes 1.3 Neurotransmitters, Neuromodulators, and Psychopharmacology 1.4 The Endocrine System, Autonomic Nervous System, and Behavioral Genetics 1.5 Cognitive Neuroscience Methods, Lateralization Testing, and Neuroplasticity
2 Chapter 2: Sensation and Perception
2.1 Psychophysics, Sensory Thresholds, and Signal Detection Theory 2.2 Visual Processing: Photoreceptors, Pathways, Color Vision, and Feature Detection 2.3 Auditory Systems, Pitch Perception, Gustation, and Olfaction 2.4 Somatosensation, Vestibular Senses, Perceptual Organization, and Theories of Perception
3 Chapter 3: Biological Drives, Consciousness, and Ethology
3.1 Sleep Architecture, Circadian Rhythms, and States of Consciousness 3.2 Biological Mechanisms of Hunger, Thirst, Sexual Behavior, and Emotion 3.3 Ethology and Comparative Psychology: Instincts, Imprinting, and Evolutionary Adaptation
4 Chapter 4: Principles of Conditioning and Learning
4.1 Classical Conditioning: Paradigms, Extinction, Spontaneous Recovery, and Biological Constraints 4.2 Operant Conditioning: Reinforcement Schedules, Punishment, and Behavior Modification 4.3 Observational Learning, Social Cognitive Theory, and Latent Learning
5 Chapter 5: Memory Architecture and Processes
5.1 Memory Architecture: Sensory Buffers, Working Memory, and Multi-Store Models 5.2 Long-Term Memory Systems: Episodic, Semantic, Procedural, and Implicit Memory 5.3 Retrieval Processes, Forgetting Curves, Interference Theory, and Memory Reconstruction
6 Chapter 6: Language, Thought, Decision Making, and Intelligence
6.1 Language Structure, Psycholinguistics, and Language Acquisition Theories 6.2 Concept Formation, Mental Representation, and Problem-Solving Strategies 6.3 Judgment, Heuristics, Cognitive Biases, and Decision-Making Models 6.4 Selective Attention, Divided Attention, and Executive Cognitive Control 6.5 Reading Processes, Bilingualism, and Verbal and Nonverbal Communication 6.6 Intelligence: Theories, Measurement, Heritability, and Metacognition
7 Chapter 7: Social Perception, Attribution, Attitudes, and the Self
7.1 Attribution Theories, Heider, Kelley, and Systematic Attribution Errors 7.2 Attitude Formation, Consistency Theories, and Cognitive Dissonance 7.3 Persuasion Models: Elaboration Likelihood Model and Persuasion Techniques 7.4 The Self, Social Comparison, Self-Esteem, and the Need to Belong
8 Chapter 8: Social Influence, Groups, Relationships, Culture, and Gender
8.1 Conformity, Compliance, and Obedience: Classic Studies and Mechanisms 8.2 Group Dynamics: Social Facilitation, Loafing, Polarization, and Groupthink 8.3 Stereotyping, Prejudice, Discrimination, and Intergroup Conflict 8.4 Prosocial Behavior, Bystander Intervention, Aggression, Interpersonal Attraction, and Close Relationships 8.5 Emotion, Affect, and Motivation in Social Life; Cultural and Gender Influences
9 Chapter 9: Physical, Cognitive, and Moral Development
9.1 Prenatal Development, Teratogens, Neonatal Reflexes, and Motor Milestones 9.2 Piaget's Cognitive Developmental Stages, Neo-Piagetian Theories, and Post-Piagetian Critiques 9.3 Vygotsky's Sociocultural Theory, Scaffolding, and the Zone of Proximal Development 9.4 Moral Development: Kohlberg's Stage Model and Gilligan's Care Perspective
10 Chapter 10: Social, Emotional, Gender, and Lifespan Development
10.1 Attachment Theory, Bowlby, Ainsworth's Strange Situation, and Temperament 10.2 Erikson's Psychosocial Stages and Baumrind's Parenting Typologies 10.3 Adolescent Identity Exploration, Adult Transitions, and Cognitive Changes in Aging 10.4 Emotional Development, Gender Development, Peer Relations, and Ecological Systems
11 Chapter 11: Theories of Personality
11.1 Psychodynamic and Neo-Freudian Personality Theories 11.2 Humanistic, Existential, and Phenomenological Approaches to Personality 11.3 Trait Theories: The Big Five (Five-Factor Model), Allport, Cattell, and Eysenck
12 Chapter 12: Psychological Disorders and Psychopathology
12.1 Anxiety Disorders, OCD, and Trauma- and Stressor-Related Disorders 12.2 Depressive Disorders, Bipolar and Related Disorders, and Suicide Risk 12.3 Schizophrenia Spectrum, Psychotic Disorders, and Personality Disorders 12.4 Neurodevelopmental, Eating, Substance-Related, Dissociative, Somatic Symptom, and Neurocognitive Disorders 12.5 Causes and Development of Disorders, Epidemiology, and Cultural and Gender Issues in Psychopathology
13 Chapter 13: Clinical Assessment, Treatment, Health Psychology, and Prevention
13.1 Clinical Assessment: Objective Inventories, Projective Tests, and Clinical Interviews 13.2 Psychotherapeutic Modalities: CBT, Behavioral, Psychodynamic, and Humanistic Therapies 13.3 Biological and Somatic Treatments: Psychotropic Medications and Neuromodulation 13.4 Stress, Conflict, Coping, Health Psychology, and Prevention
14 Chapter 14: Research Design and Experimental Methodology
14.1 The Scientific Method, Variables, and Operational Definitions 14.2 Between-Subjects, Within-Subjects, Quasi-Experimental, and Correlational Designs 14.3 Threats to Internal and External Validity, Demand Characteristics, and Experimenter Bias
15 Chapter 15: Statistical Analysis in Psychological Science
15.1 Descriptive Statistics, Measures of Central Tendency, Variability, and Normal Distributions 15.2 Inferential Statistics: Hypothesis Testing, Alpha Levels, Power, and Effect Sizes 15.3 Bivariate and Multivariate Techniques: t-Tests, ANOVA Models, Correlation, and Regression
16 Chapter 16: Psychometrics, Ethics, History, and Applied Psychology
16.1 Psychometric Theory: Classical Test Theory, Reliability Types, and Validity Constructs 16.2 Research Ethics, APA Ethical Principles, Institutional Review Boards, and Animal Welfare 16.3 Historical Foundations of Psychology, Major Schools of Thought, and Professional Milestones 16.4 Industrial-Organizational and Educational Psychology
15.3 Bivariate and Multivariate Techniques: t-Tests, ANOVA Models, Correlation, and Regression
Key Takeaways Explain This Topic AI
Parametric tests require continuous interval/ratio data, independent observations, bivariate/multivariate normality, and homogeneity of variance across groups (evaluated via Levene's test).
Student's t-test evaluates mean differences across one-sample (df = N - 1), independent-samples (df = n1 + n2 - 2), and paired-samples (df = Npairs - 1) designs, with paired designs achieving greater power by partialing out inter-subject variance.
Analysis of Variance (ANOVA) resolves familywise error rate inflation (α_FW = 1 - (1 - α)^c) via an omnibus F-ratio (MS_between / MS_within); factorial ANOVA enables simultaneous testing of main effects and interaction dynamics (A × B).
Pearson r measures linear bivariate association and Ordinary Least Squares (OLS) regression calculates optimal predictive trajectories (Ŷ = bX + a), while non-parametric tests (Chi-Square, Mann-Whitney U, Wilcoxon, Kruskal-Wallis) analyze categorical or rank-ordered distributions free of distributional assumptions.
Last updated: October 2026
Bivariate and Multivariate Techniques: t-Tests, ANOVA Models, Correlation, and Regression
Psychological investigations evaluate hypotheses spanning diverse designs, from comparing treatment groups to modeling complex multivariate associations. Selecting the appropriate statistical test requires assessing the scale of measurement, the number of independent and dependent variables, the research design (between-subjects vs. within-subjects), and adherence to distributional assumptions.
1. Assumptions of Parametric Statistical Tests
Parametric statistical tests (e.g., t t t -tests, ANOVA, Pearson correlation, linear regression) estimate population parameters under specific mathematical assumptions. Violating these assumptions can inflate Type I error rates or diminish statistical power.
The Four Core Parametric Assumptions
Scale of Measurement: The dependent variable must be measured on a continuous interval or ratio scale .
Independence of Observations: Each observation within a group must be statistically independent of every other observation. Violations of independence (e.g., testing participants in social groups without accounting for clustering) represent the most severe threat to validity, inflating Type I error rates substantially.
Normality: The population distribution from which samples are drawn (or the distribution of sample residuals) is normally distributed. Due to the Central Limit Theorem, parametric tests are relatively robust to moderate violations of normality when sample sizes are sufficiently large ( N ≥ 30 N \ge 30 N ≥ 30 per group).
Homogeneity of Variance (Homoscedasticity): In multi-group designs, the variance of the populations must be equal across all groups:
σ 1 2 = σ 2 2 = ⋯ = σ k 2 \sigma_1^2 = \sigma_2^2 = \dots = \sigma_k^2 σ 1 2 = σ 2 2 = ⋯ = σ k 2
Diagnostic Assessment: Homogeneity of variance is assessed empirically using Levene's test or Hartley's F max F_{\max} F m a x test. A statistically significant Levene's test ( p < .05 p < .05 p < .05 ) indicates that the assumption of equal variances has been violated.
Remedy: When variances are unequal (heteroscedasticity), particularly with unequal sample sizes, researchers use Welch's t t t -test (which applies Satterthwaite's adjusted degrees of freedom) or the Welch/Brown-Forsythe robust ANOVA.
2. Student's t-Test Family
Developed by William Sealy Gosset under the pseudonym "Student" while working at the Guinness Brewery, the t t t -distribution accounts for the added uncertainty of estimating the population variance from a sample.
t t t -Test Type Research Application Formula Degrees of Freedom ( d f df df )
One-Sample t t t -Test Compares a single sample mean ( X ˉ \bar{X} X ˉ ) to a known or hypothesized population mean ( μ 0 \mu_0 μ 0 ). t = X ˉ − μ 0 s / N t = \frac{\bar{X} - \mu_0}{s / \sqrt{N}} t = s / N X ˉ − μ 0 d f = N − 1 df = N - 1 df = N − 1
Independent-Samples t t t -Test Compares means from two completely separate, unrelated groups of participants (between-subjects design). t = X ˉ 1 − X ˉ 2 s p 2 n 1 + s p 2 n 2 t = \frac{\bar{X}_1 - \bar{X}_2}{\sqrt{\frac{s_p^2}{n_1} + \frac{s_p^2}{n_2}}} t = n 1 s p 2 + n 2 s p 2 X ˉ 1 − X ˉ 2 d f = n 1 + n 2 − 2 df = n_1 + n_2 - 2 df = n 1 + n 2 − 2
Paired / Dependent-Samples t t t -Test Compares two means from the same participants tested twice (pretest-posttest) or matched participant pairs (within-subjects design). t = D ˉ s D / N t = \frac{\bar{D}}{s_D / \sqrt{N}} t = s D / N D ˉ d f = N pairs − 1 df = N_{\text{pairs}} - 1 df = N pairs − 1
Why Paired t-Tests Yield Greater Statistical Power
In a paired-samples design, researchers compute a difference score for each participant:
D i = X 1 i − X 2 i D_i = X_{1i} - X_{2i} D i = X 1 i − X 2 i
By analyzing difference scores, the paired t t t -test eliminates between-subject variability (individual differences in baseline intelligence, personality, or genetics) from the error denominator ( s D s_D s D ). Because between-subject variance is often substantial, removing it shrinks the standard error of difference scores, yielding a larger t t t -value and substantially higher statistical power than an independent-samples test with an equivalent number of observations.
3. Analysis of Variance (ANOVA)
When an experiment involves three or more group means, conducting multiple independent t t t -tests causes exponential inflation of the familywise Type I error rate ( α FW \alpha_{\text{FW}} α FW ) .
The Problem of Multiple Comparisons
If an experiment compares k k k groups, the number of unique pairwise comparisons is given by:
c = k ( k − 1 ) 2 c = \frac{k(k - 1)}{2} c = 2 k ( k − 1 )
The probability of committing at least one Type I error across c c c independent comparisons at α = .05 \alpha = .05 α = .05 is calculated as:
α FW = 1 − ( 1 − α ) c \alpha_{\text{FW}} = 1 - (1 - \alpha)^c α FW = 1 − ( 1 − α ) c
For k = 3 k = 3 k = 3 groups: c = 3 c = 3 c = 3 comparisons → α FW = 1 − ( 0.95 ) 3 ≈ .143 \rightarrow \alpha_{\text{FW}} = 1 - (0.95)^3 \approx .143 → α FW = 1 − ( 0.95 ) 3 ≈ .143 ( 14.3 % 14.3\% 14.3% error risk).
For k = 4 k = 4 k = 4 groups: c = 6 c = 6 c = 6 comparisons → α FW = 1 − ( 0.95 ) 6 ≈ .265 \rightarrow \alpha_{\text{FW}} = 1 - (0.95)^6 \approx .265 → α FW = 1 − ( 0.95 ) 6 ≈ .265 ( 26.5 % 26.5\% 26.5% error risk).
For k = 5 k = 5 k = 5 groups: c = 10 c = 10 c = 10 comparisons → α FW = 1 − ( 0.95 ) 10 ≈ .401 \rightarrow \alpha_{\text{FW}} = 1 - (0.95)^{10} \approx .401 → α FW = 1 − ( 0.95 ) 10 ≈ .401 ( 40.1 % 40.1\% 40.1% error risk).
Ronald Fisher developed Analysis of Variance (ANOVA) to solve this problem. ANOVA performs a single omnibus test evaluating whether any differences exist among the k k k group means while holding the overall false-positive rate at α = .05 \alpha = .05 α = .05 .
Partitioning Variance in One-Way Between-Subjects ANOVA
ANOVA decomposes the total variation in the data ( S S total SS_{\text{total}} S S total ) into two independent additive components:
S S total = S S between + S S within SS_{\text{total}} = SS_{\text{between}} + SS_{\text{within}} S S total = S S between + S S within
Between-Groups Variance ( S S between SS_{\text{between}} S S between ): Reflects differences between group means and the grand mean. This variation stems from two sources: genuine experimental treatment effects PLUS random individual sampling error.
Within-Groups Variance ( S S within SS_{\text{within}} S S within or Error Variance): Reflects variability among participants within the same treatment condition. Because all participants within a group receive identical treatment, this variability is attributable purely to random individual differences and measurement error. Total Variance (SStotal, df = N - 1)
- │
- ┌─────────────────────────────┴─────────────────────────────┐
- ▼ ▼
- Between-Groups Variance Within-Groups Variance
- (SSbetween, df = k - 1) (SSwithin, df = N - k)
- Treatment Effect + Random Error Random Error Alone
- │ │
- └─────────────────────────────┬─────────────────────────────┘
- ▼
- F-Ratio = MSbetween / MSwithin
- The F-Ratio and Expected Mean Squares
Dividing each sum of squares by its respective degrees of freedom produces the Mean Squares ( M S MS MS ) :
M S between = S S between k − 1 and M S within = S S within N − k MS_{\text{between}} = \frac{SS_{\text{between}}}{k - 1} \quad \text{and} \quad MS_{\text{within}} = \frac{SS_{\text{within}}}{N - k} M S between = k − 1 S S between and M S within = N − k S S within
The test statistic is the F F F -ratio :
F = M S between M S within = Treatment Effect + Random Error Random Error F = \frac{MS_{\text{between}}}{MS_{\text{within}}} = \frac{\text{Treatment Effect} + \text{Random Error}}{\text{Random Error}} F = M S within M S between = Random Error Treatment Effect + Random Error
Under H 0 H_0 H 0 (No Treatment Effect): Treatment Effect = 0 = 0 = 0 . Therefore, F = 0 + Random Error Random Error ≈ 1.0 F = \frac{0 + \text{Random Error}}{\text{Random Error}} \approx 1.0 F = Random Error 0 + Random Error ≈ 1.0 . The expected value of F F F under the null hypothesis is approximately 1.0 1.0 1.0 .
Under H 1 H_1 H 1 (Treatment Effect Exists): Treatment Effect > 0 > 0 > 0 . Therefore, M S between MS_{\text{between}} M S between exceeds M S within MS_{\text{within}} M S within , producing an F F F -ratio substantially greater than 1.0 1.0 1.0 . If F F F exceeds the critical value, H 0 H_0 H 0 is rejected.
Post-Hoc Tests vs. Planned Comparisons
A significant omnibus F F F -test confirms that at least one group mean differs from another, but does not indicate which specific pairs differ. Researchers resolve this ambiguity using planned contrasts or post-hoc tests:
Planned (A Priori) Contrasts: Specified before data collection based on explicit theoretical hypotheses. They do not require a significant omnibus F F F and possess higher statistical power.
Post-Hoc (A Posteriori) Tests: Conducted after obtaining a significant omnibus F F F to explore all possible pairwise differences while strictly controlling α FW \alpha_{\text{FW}} α FW :
Tukey's Honestly Significant Difference (HSD): The standard post-hoc test in psychology; controls familywise error across all pairwise comparisons while maintaining high power.
Bonferroni Correction: Extremely versatile but conservative adjustment that divides nominal alpha by the number of comparisons ( α adj = α / c \alpha_{\text{adj}} = \alpha / c α adj = α / c ).
Scheffé Test: The most conservative post-hoc test; controls familywise error for all possible simple and complex linear combinations of means.
- 4. Factorial ANOVA and Multivariate Extensions
- Factorial ANOVA ( A × B A \times B A × B Designs)
In a factorial ANOVA , two or more categorical independent variables (factors) are manipulated simultaneously. In a 2 × 2 2 \times 2 2 × 2 factorial design, two independent variables each possess two levels, yielding four distinct treatment cells.
A two-way factorial ANOVA yields three independent F F F -tests :
Main Effect of Factor A: The effect of Factor A averaged across all levels of Factor B.
Main Effect of Factor B: The effect of Factor B averaged across all levels of Factor A.
Interaction Effect ( A × B A \times B A × B ): Evaluates whether the effect of Factor A on the dependent variable depends upon the specific level of Factor B. Factorial ANOVA Interaction Graphs:
- No Interaction (Parallel Lines) Significant Interaction (Non-Parallel Lines)
- DV DV
- High ┌────────────────────── B2 (Caffeine) High ┌─────────\────────────── B2 (Caffeine)
- │ / │ \ /
- │ / │ \ /
- │ / │ \ /
- │ / │ \ /
- │ / │ \ /
- │ / │ \ /
- │ / │ \/
- Low └───────────────/────── B1 (Placebo) Low └────────────────/\────── B1 (Placebo)
- Low Stress High Stress Low Stress High Stress
Important
On the GRE Psychology Subject Test, interactions are frequently presented graphically. If the lines connecting condition means are parallel , there is no interaction . If the lines are non-parallel —whether they converge, diverge, or cross each other completely ( crossover interaction )—a statistically significant interaction is present, indicating moderation.
Repeated-Measures ANOVA and Sphericity
When the same participants are tested across three or more experimental conditions, researchers employ a repeated-measures ANOVA . This design partitions inter-subject variation out of the error term, maximizing power.
The Sphericity Assumption: Repeated-measures ANOVA requires sphericity —the assumption that the variances of the differences between all possible pairs of conditions are equal.
Evaluation and Correction: Sphericity is evaluated using Mauchly's test of sphericity . If violated ( p < .05 p < .05 p < .05 ), degrees of freedom are reduced using the Greenhouse-Geisser ( ϵ ^ \hat{\epsilon} ϵ ^ ) or Huynh-Feldt epsilon adjustments to prevent Type I error inflation.
Analysis of Covariance (ANCOVA)
ANCOVA combines ANOVA with linear regression. It evaluates group differences on a continuous dependent variable while statistically controlling for one or more continuous extraneous variables known as covariates . Controlling for the covariate removes extraneous error variance, increasing statistical precision and power.
- 5. Correlation and Linear Regression
- Pearson Product-Moment Correlation ( r r r )
Developed by Karl Pearson, r r r quantifies the direction and strength of the linear association between two continuous variables ( X X X and Y Y Y ):
r = Covariance ( X , Y ) s X s Y = ∑ ( X − X ˉ ) ( Y − Y ˉ ) ∑ ( X − X ˉ ) 2 ∑ ( Y − Y ˉ ) 2 r = \frac{\text{Covariance}(X, Y)}{s_X s_Y} = \frac{\sum (X - \bar{X})(Y - \bar{Y})}{\sqrt{\sum (X - \bar{X})^2 \sum (Y - \bar{Y})^2}} r = s X s Y Covariance ( X , Y ) = ∑ ( X − X ˉ ) 2 ∑ ( Y − Y ˉ ) 2 ∑ ( X − X ˉ ) ( Y − Y ˉ )
Properties:
Values range strictly from − 1.00 -1.00 − 1.00 to + 1.00 +1.00 + 1.00 .
The sign indicates direction: positive (direct) or negative (inverse).
The absolute value ( ∣ r ∣ |r| ∣ r ∣ ) indicates strength.
It is scale-invariant; linear transformations of X X X or Y Y Y do not alter r r r .
Coefficient of Determination ( r 2 r^2 r 2 ): Squaring the correlation coefficient yields r 2 r^2 r 2 , representing the proportion of variance in Y Y Y that is predictable from or shared with X X X . If r = .50 r = .50 r = .50 , r 2 = .25 r^2 = .25 r 2 = .25 , meaning 25 % 25\% 25% of the variance is shared and 75 % 75\% 75% remains unexplained.
Critical Limitations and Nuances of Correlation
Correlation Does Not Imply Causation: An observed correlation between X X X and Y Y Y may stem from X X X causing Y Y Y , Y Y Y causing X X X (directionality problem), or an unmeasured third variable Z Z Z causing both (third-variable problem).
Restriction of Range: Artificially truncating the range of either variable dramatically attenuates (depresses) the observed correlation coefficient relative to the true population value (e.g., assessing the correlation between SAT scores and college GPA exclusively among Ivy League students).
Curvilinear Relationships: Pearson's r r r evaluates strictly linear relationships. If two variables share a strong non-linear relationship—such as the Yerkes-Dodson Law relating physiological arousal to task performance (an inverted-U function)—the Pearson r r r can be approximately 0.00 0.00 0.00 despite a powerful, deterministic association.
Specialized Correlation Coefficients
Coefficient Symbol Nature of Variable X Nature of Variable Y Research Example
Pearson Product-Moment r r r Continuous (Interval/Ratio) Continuous (Interval/Ratio) Neuroticism score and Beck Depression Inventory score
Spearman Rank-Order r s r_s r s or ρ \rho ρ Ranked / Ordinal Ranked / Ordinal (or non-linear monotonic) Class rank in high school and class rank in college
Point-Biserial r p b r_{pb} r p b Truly Dichotomous (Binary) Continuous (Interval/Ratio) Biological sex ( 0 / 1 0/1 0/1 ) and spatial rotation reaction time
Biserial r b r_b r b Artificially Dichotomized Continuous (Interval/Ratio) Pass/Fail on an exam and continuous IQ score
Phi Coefficient ϕ \phi ϕ Truly Dichotomous ( 0 / 1 0/1 0/1 ) Truly Dichotomous ( 0 / 1 0/1 0/1 ) Handedness (Left/Right) and Psychiatric diagnosis (Schizophrenia Yes/No)
Simple and Multiple Linear Regression
While correlation describes association, regression uses scores on one or more predictor variables to predict performance on a criterion variable.
Simple Linear Regression
The trajectory of a simple bivariate regression line is expressed as:
Y ^ = b X + a \hat{Y} = bX + a Y ^ = b X + a
Y ^ \hat{Y} Y ^ is the predicted value of the criterion variable.
b b b is the unstandardized regression slope , reflecting the predicted change in Y Y Y for every one-unit increase in X X X :
b = r ( s Y s X ) b = r \left( \frac{s_Y}{s_X} \right) b = r ( s X s Y )
a a a is the Y Y Y -intercept , representing the predicted value of Y Y Y when X = 0 X = 0 X = 0 :
a = Y ˉ − b X ˉ a = \bar{Y} - b\bar{X} a = Y ˉ − b X ˉ
Ordinary Least Squares (OLS) Criterion: The regression line is fitted by minimizing the sum of squared vertical residuals (prediction errors) between observed data points and the line:
∑ i = 1 N ( Y i − Y ^ i ) 2 = minimum \sum_{i=1}^N (Y_i - \hat{Y}_i)^2 = \text{minimum} ∑ i = 1 N ( Y i − Y ^ i ) 2 = minimum
Multiple Linear Regression
When multiple continuous predictors ( X 1 , X 2 , … , X k X_1, X_2, \dots, X_k X 1 , X 2 , … , X k ) predict a single continuous criterion ( Y Y Y ):
Y ^ = b 1 X 1 + b 2 X 2 + ⋯ + b k X k + a \hat{Y} = b_1 X_1 + b_2 X_2 + \dots + b_k X_k + a Y ^ = b 1 X 1 + b 2 X 2 + ⋯ + b k X k + a
Standardized Beta Weights ( β \beta β ): When predictors are converted to standard scores ( z z z -scores), their coefficients are expressed as β \beta β . A standardized beta weight represents the unique contribution of that specific predictor to the criterion, holding all other predictors constant .
Multicollinearity: Occurs when two or more predictor variables in a multiple regression model are highly correlated with each other ( r > .80 r > .80 r > .80 ). Multicollinearity inflates the standard errors of the regression coefficients, rendering individual β \beta β estimates unstable and erratic.
6. Nonparametric Statistical Methods
When research data violate the assumptions of parametric tests—such as analyzing categorical counts, ordinal ranks, or small samples with extreme skewness and heteroscedasticity—researchers turn to nonparametric tests (distribution-free tests).
Chi-Square ( χ 2 \chi^2 χ 2 ) Tests for Categorical Data
Chi-square tests evaluate frequencies of observations across discrete categorical bins.
1. Chi-Square Goodness-of-Fit Test
Evaluates whether an observed sample frequency distribution across a single nominal variable conforms to a theoretical or hypothesized population distribution:
χ 2 = ∑ ( O − E ) 2 E with d f = k − 1 \chi^2 = \sum \frac{(O - E)^2}{E} \quad \text{with} \quad df = k - 1 χ 2 = ∑ E ( O − E ) 2 with df = k − 1
O O O is the observed frequency in each category.
E E E is the expected frequency under the null hypothesis.
k k k is the number of categories.
2. Chi-Square Test of Independence
Evaluates whether two categorical variables are statistically independent or contingency-associated in a two-way contingency table:
χ 2 = ∑ ( O − E ) 2 E with d f = ( r − 1 ) ( c − 1 ) \chi^2 = \sum \frac{(O - E)^2}{E} \quad \text{with} \quad df = (r - 1)(c - 1) χ 2 = ∑ E ( O − E ) 2 with df = ( r − 1 ) ( c − 1 )
r r r is the number of rows and c c c is the number of columns.
The expected frequency for each cell is computed as:
E = ( Row Total ) × ( Column Total ) N total E = \frac{(\text{Row Total}) \times (\text{Column Total})}{N_{\text{total}}} E = N total ( Row Total ) × ( Column Total )
Nonparametric Rank-Order Tests and Their Parametric Counterparts
Parametric Test Nonparametric Equivalent Primary Data Level Test Mechanism
Independent-Samples t t t -Test Mann-Whitney U U U Test (or Wilcoxon Rank-Sum) Ordinal ranks (Between-subjects, 2 groups) Converts continuous scores to ranks; evaluates whether the sum of ranks differs significantly between two independent groups.
Paired-Samples t t t -Test Wilcoxon Signed-Rank Test Ordinal ranks (Within-subjects, 2 conditions) Ranks the absolute differences between paired scores, assigns positive/negative signs, and sums ranks.
One-Way Between-Subjects ANOVA Kruskal-Wallis H H H -Test Ordinal ranks (Between-subjects, ≥ 3 \ge 3 ≥ 3 groups) Nonparametric omnibus test evaluating rank sum distributions across three or more independent groups.
Repeated-Measures ANOVA Friedman Test Ordinal ranks (Within-subjects, ≥ 3 \ge 3 ≥ 3 conditions) Ranks scores across conditions within each individual participant; evaluates condition rank distributions.
Pearson Correlation ( r r r ) Spearman Rank Correlation ( r s r_s r s ) Ordinal ranks / Monotonic association Computes Pearson correlation on the rank-transformed variables.