Study guide

7.4 Validity Threats and Causal Inference

EPPP Study Guide Exam

Track your progress as you read

Finished sections get a check mark.

1 Orientation: EPPP Two-Part Exam, Eligibility, Fees, Authorization, Scoring, and Retakes

1.1 Two-Part 2026 EPPP and the Candidate Handbook 1.2 Jurisdiction Eligibility and Authorization to Test 1.3 Fees and Budget Control 1.4 Pearson VUE Appointments, Timing, and Identification 1.5 Scaled Scoring and Passing Recommendations 1.6 Retakes, Remediation, and Board Follow-Up

2 Part 1 and Part 2 Domain Map, Pretest Items, Pacing, and Study Strategy

2.1 Part 1-Knowledge Domain Map 2.2 Part 2-Skills Domain Map 2.3 Pretest Items and Exam Development 2.4 Timing, Pacing, and Review Discipline 2.5 Domain Weighting and Score Equating 2.6 Study Strategy Across Both Parts

3 Biological Bases and Cognitive-Affective Bases of Behavior

3.1 Part 1 Map for Biological and Cognitive-Affective Bases 3.2 Neuroanatomy, Neurotransmission, and Imaging 3.3 Psychopharmacology and Substance Effects 3.4 Genetics, Epigenetics, Endocrine Systems, and Health Behavior 3.5 Attention, Learning, Memory, and Executive Function 3.6 Emotion, Motivation, Stress, and Affect-Behavior Links

4 Social/Cultural Bases and Growth/Lifespan Development

4.1 Part 1 Map for Social/Cultural and Lifespan Domains 4.2 Social Cognition, Attitudes, and Attribution 4.3 Groups, Social Influence, and Relationships 4.4 Culture, Diversity, Identity, and Clinical Reasoning 4.5 Lifespan Theories, Developmental Tasks, and Aging 4.6 Risk, Protective Factors, and Developmental Psychopathology

5 Assessment and Diagnosis: Psychometrics, Differential Diagnosis, and Communication

5.1 Assessment Domain Orientation for EPPP Part 1 5.2 Psychometric Foundations: Reliability, Validity, Norms, and Error 5.3 Clinical Interviewing, Mental Status, Collateral Data, and Risk 5.4 Diagnostic Frameworks and Differential Diagnosis 5.5 Test Selection, Administration, Scoring, and Interpretation 5.6 Diversity-Responsive Assessment and Fair Interpretation 5.7 Assessment Reports, Feedback, and Communication of Findings

6 Treatment, Intervention, Prevention, Consultation, and Supervision Knowledge

6.1 Treatment Domain Orientation and Evidence-Based Practice 6.2 Case Formulation and Treatment Planning 6.3 Major Intervention Models and Mechanisms of Change 6.4 Prevention, Crisis Intervention, and Risk Management 6.5 Consultation, Interprofessional Work, and Systems Practice 6.6 Supervision Models, Competence, Evaluation, and Telepsychology

7 Research Methods, Statistics, and Evidence-Based Practice

7.1 Research Domain Map and Exam Logic 7.2 Designs, Sampling, and Variable Control 7.3 Measurement, Reliability, and Validity 7.4 Validity Threats and Causal Inference 7.5 Descriptive, Inferential, and Predictive Statistics 7.6 Effect Size, Power, Clinical Significance, and Program Evaluation

8 Ethical, Legal, and Professional Issues for Part 1

8.1 Ethics Domain, Sources, and Decision Model 8.2 Competence, Scope, Impairment, Consultation, and Referral 8.3 Informed Consent, Confidentiality, Privacy, and Records 8.4 Boundaries, Multiple Relationships, Conflicts, and Fees 8.5 Assessment, Intervention, Supervision, and Evidence Ethics 8.6 Telepsychology, Emerging Issues, Rights, and Jurisdiction

9 Part 2 Skills I: Scientific Orientation, Assessment, and Intervention

9.1 Scientific Orientation in Real Practice Decisions 9.2 Critical Appraisal and Evidence Fit 9.3 Assessment Method Selection and Measurement Planning 9.4 Interviewing, Observation, Collateral Data, and Diagnosis 9.5 Risk Assessment, Safety Planning, and Crisis Decisions 9.6 Intervention Planning, Adaptation, and Informed Consent 9.7 Progress Monitoring, Outcomes, and Course Correction

10 Part 2 Skills II: Relational Competence, Professionalism, and Ethical Practice

10.1 Relational Competence, Alliance, and Boundaries 10.2 Diversity, Culture, Language, and Bias in Practice 10.3 Self-Reflection, Competence, and Professional Limits 10.4 Professional Responsibility, Records, and Practice Management 10.5 Ethical Documentation, Consent, and Confidentiality 10.6 Billing, Multiple Relationships, and Ethical Consultation

11 Part 2 Skills III: Collaboration, Consultation, Supervision, and Systems Practice

11.1 Interdisciplinary Collaboration, Role Clarity, and Shared Decisions 11.2 Consultation Models, Referral Questions, and Boundaries 11.3 Supervision Structure, Alliance, Feedback, and Gatekeeping 11.4 Supervisee Compliance, Documentation, and Risk Response 11.5 Systems Practice, Program Evaluation, and Quality Improvement 11.6 Integrated Part 2 Decision Practice for Collaboration and Systems

12 Final EPPP Review: Test Day, Results, Score Transfer, and Licensure Next Steps

12.1 Final Two-Part Review and Official Fact Check 12.2 Authorization, Scheduling, Fees, and Identification 12.3 Test-Day Timing, Tutorial, Survey, and Pacing 12.4 Results, Scaled Scores, Feedback, and Score Meaning 12.5 Retakes, Score Transfer, and Board Follow-Up 12.6 Jurisprudence, Supervised Experience, and the Final Licensure File

7.4 Validity Threats and Causal Inference

Key Takeaways Explain This Topic AI

Internal validity concerns whether the intervention, not an alternative, caused the observed effect.

External validity concerns whether findings generalize across people, settings, times, and procedures.

Construct validity concerns whether the operationalization captures the intended psychological construct.

Statistical conclusion validity concerns whether the statistical inference is accurate given power, assumptions, and error rate.

Last updated: June 2026

Identify Which Inference Is Under Attack

Validity in research is not one issue but four. A study can have strong internal validity and weak external validity, or strong analysis and poor construct measurement. EPPP items typically describe a flaw and ask for the name of the threat. The fastest route is to ask which inference the flaw damages: causation (internal), generalization (external), construct meaning (construct), or statistical accuracy (statistical conclusion) .

Internal validity asks whether the independent variable caused the effect. The classic Campbell-and-Stanley threats:

  • Threat What it weakens Example cue
  • History Causal inference An outside event occurs between pre- and posttest
  • Maturation Causal inference Participants change naturally over time
  • Testing Causal inference Taking the pretest alters posttest performance
  • Instrumentation Measurement comparability The measure, rater, or scoring procedure shifts mid-study
  • Regression to the mean Causal inference Extreme-scoring groups drift toward average on retest
  • Selection Group comparability Intact groups differ before the intervention
  • Attrition (mortality) Group comparability Differential dropout across conditions
  • Diffusion of treatment Causal inference Control group is exposed to the intervention

Regression to the mean is heavily tested. When participants are selected for extreme initial scores (e.g., the most distressed), some apparent improvement on retest is statistical artifact, not treatment effect, because extreme scores tend to move toward the average. A single-group pre-post design with an extreme-scoring sample is especially vulnerable, which is why a control group is essential.

External, Construct, and Statistical Conclusion Validity

Selection threats arise when intact groups differ before intervention, common in quasi-experiments. If one clinic delivers a new treatment and another delivers usual care, clinic differences (staff, clientele, resources) may explain outcomes. Matching and statistical control help but never fully substitute for random assignment.

External validity asks whether findings travel across populations, settings, times, and measures. A therapy trial run on highly selected university-clinic adults may not generalize to adolescents, older adults, rural clients, court-referred clients, or those with complex comorbidity. The correct EPPP answer often preserves the finding while limiting the population to which it applies. Threats include interaction of selection with treatment, reactive arrangements (the Hawthorne effect), and testing-by-treatment interactions.

Construct validity (of the cause/effect) asks whether the study measured or manipulated what it claimed. If "social support" is operationalized only as number of social-media contacts, the definition misses quality, availability, reciprocity, and perceived support; the problem is conceptual, not statistical. Mono-operation bias (one measure of the construct) and experimenter expectancy are construct threats.

Statistical conclusion validity asks whether the analysis supports the inference. Threats include:

Low power — too small a sample misses a real effect (raises Type II error).

Inflated Type I error — many unplanned comparisons without correction produce false positives.

Violated assumptions — non-normality, heteroscedasticity, or non-independence distort tests.

Unreliable measurement — attenuates observed relationships.

Outliers and restricted range — shrink or exaggerate estimated effects.

When validity options look alike, name the inference in your head. If the issue is whether the treatment caused change, think internal validity. If it is whether the result applies elsewhere , think external. If it is whether the variable represents the construct , think construct. If it is whether the statistical test supports the conclusion, think statistical conclusion validity. The best answer fixes the threat directly rather than adding unrelated study features.

Designing Out the Threats

Knowing a threat is only half the item; the EPPP often asks how to control it. Each threat has a standard remedy, and matching threat to remedy is high-yield:

  • Threat Standard control
  • Selection Random assignment; if impossible, matching or statistical covariate adjustment
  • History / maturation A no-treatment or waitlist control group experiencing the same time period
  • Testing A control group also pretested, or a Solomon four-group design
  • Instrumentation Standardized, unchanging measures and calibrated, retrained raters
  • Regression to the mean A control group; avoid selecting on extreme single scores
  • Attrition Track and report dropouts; intention-to-treat analysis
  • Low statistical power A priori power analysis to set sample size; reliable measures

The Solomon four-group design deserves recognition because it directly isolates a testing effect: two groups are pretested and two are not, and one of each receives treatment, so the researcher can see whether the pretest itself altered the outcome. When a stem describes worry about a pretest sensitizing participants, this design is the targeted fix.

A second exam favorite is the trade-off between internal and external validity. Tight laboratory control maximizes internal validity but can reduce external validity because the artificial setting differs from real practice; loosely controlled field studies do the reverse. There is no universal winner: the credited answer depends on the study's purpose. An efficacy trial (does it work under ideal conditions?) prioritizes internal validity, whereas an effectiveness trial (does it work in routine care?) prioritizes external validity. The EPPP wants candidates to recognize this tension rather than treat one validity as always supreme.

Finally, distinguish a confound from a simple nuisance variable . A confound varies systematically with the independent variable and offers a rival explanation (e.g., the treatment group also got more therapist contact time). A nuisance variable adds random error but does not bias the comparison. Controlling, holding constant, or randomizing a confound is essential; randomization is powerful precisely because it distributes unknown confounds roughly evenly across conditions.

When two options both name plausible threats, the stronger answer identifies the one that systematically differs with the conditions, because that is the threat capable of masquerading as a treatment effect.